Sep 03 14:12:21 devstack cinder-volume[76035]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 03 14:12:21 devstack cinder-volume[76035]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 03 14:12:21 devstack cinder-volume[76035]: we strongly recommend against using it for new projects. Sep 03 14:12:21 devstack cinder-volume[76035]: If you are already using Eventlet, we recommend migrating to a different Sep 03 14:12:21 devstack cinder-volume[76035]: framework. For more detail see Sep 03 14:12:21 devstack cinder-volume[76035]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 03 14:12:21 devstack cinder-volume[76035]: import eventlet # noqa Sep 03 14:12:24 devstack cinder-volume[76035]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76035) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 03 14:12:24 devstack cinder-volume[76035]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76035) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 03 14:12:24 devstack cinder-volume[76035]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76035) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 03 14:12:25 devstack cinder-volume[76035]: INFO dbcounter [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] Registered counter for database cinder Sep 03 14:12:25 devstack cinder-volume[76035]: DEBUG oslo_db.sqlalchemy.engines [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76035) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 14:12:25 devstack cinder-volume[76035]: DEBUG dbcounter [-] [76035] Writer thread running {{(pid=76035) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 03 14:12:25 devstack cinder-volume[76035]: INFO cinder.rpc [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 03 14:12:25 devstack cinder-volume[76035]: INFO cinder.rpc [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 03 14:12:25 devstack cinder-volume[76035]: DEBUG oslo_db.sqlalchemy.engines [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76035) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 14:12:25 devstack cinder-volume[76035]: INFO cinder.volume.manager [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] Determined volume DB was empty at startup. Sep 03 14:12:25 devstack cinder-volume[76035]: DEBUG cinder.volume.manager [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76035) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 03 14:12:25 devstack cinder-volume[76035]: INFO cinder.volume.manager [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 03 14:12:25 devstack cinder-volume[76035]: WARNING stevedore.named [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 03 14:12:25 devstack cinder-volume[76035]: WARNING castellan.key_manager [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 03 14:12:25 devstack cinder-volume[76035]: WARNING cinder.keymgr.conf_key_mgr [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 03 14:12:25 devstack cinder-volume[76035]: DEBUG cinder.volume.drivers.lvm [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76035) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 03 14:12:25 devstack cinder-volume[76035]: DEBUG oslo_concurrency.processutils [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76035) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_concurrency.processutils [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] CMD "cinder-rtstool verify" returned: 0 in 0.466s {{(pid=76035) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_db.sqlalchemy.engines [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76035) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 14:12:26 devstack cinder-volume[76035]: INFO cinder.rpc [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 03 14:12:26 devstack cinder-volume[76035]: INFO cinder.rpc [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 03 14:12:26 devstack cinder-volume[76035]: WARNING stevedore.named [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 03 14:12:26 devstack cinder-volume[76035]: WARNING castellan.key_manager [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 03 14:12:26 devstack cinder-volume[76035]: INFO cinder.volume.manager [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_db.sqlalchemy.engines [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76035) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 14:12:26 devstack cinder-volume[76035]: INFO oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] Starting 1 workers Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] Started child 76190 {{(pid=76035) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] Full set of CONF: {{(pid=76035) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] ******************************************************************************** {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] Configuration options gathered from: {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] ================================================================================ {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 03 14:12:26 devstack cinder-volume[76190]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] allow_availability_zone_fallback = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] allow_compression_on_image_upload = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] allowed_direct_url_schemes = [] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] api_rate_limit = True {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] auth_strategy = keystone {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] az_cache_duration = 3600 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_availability_zone = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_host = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_name = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_stats_polling_interval = 60 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backup_api_class = cinder.backup.api.API {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backup_name_template = backup-%s {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backup_use_same_host = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backup_use_temp_snapshot = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] chap_password = **** {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] chap_username = {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cinder_internal_tenant_project_id = db9df8027b6a4ddc9615818c15da3030 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cinder_internal_tenant_user_id = c2adb37de5f24929a76e79d6b715dd69 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cloned_volume_same_az = True {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cluster = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] compression_format = gzip {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] compute_api_class = cinder.compute.nova.API {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] config_dir = [] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] config_source = [] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] control_exchange = openstack {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] debug = True {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] default_availability_zone = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] default_group_type = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] default_volume_type = lvmdriver-1 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] disk_geometry = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] driver_client_cert = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] driver_client_cert_key = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] driver_data_namespace = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] driver_ssl_cert_path = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] driver_ssl_cert_verify = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] driver_use_ssl = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] enable_force_upload = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] enable_new_services = True {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] enable_unsupported_driver = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] enabled_backends = ['lvmdriver-1'] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] enforce_multipath_for_image_xfer = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] filter_function = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] glance_api_insecure = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] glance_api_servers = ['http://192.168.122.242/image'] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] glance_api_ssl_compression = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] glance_ca_certificates_file = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] glance_catalog_info = image:glance:publicURL {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] glance_certfile = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] glance_keyfile = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] glance_num_retries = 3 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] glance_request_timeout = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] goodness_function = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] graceful_shutdown_timeout = 5 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] group_api_class = cinder.group.api.API {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] host = devstack {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] image_compress_on_upload = True {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] image_conversion_address_space_limit = 1 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] image_conversion_cpu_limit = 60 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] image_conversion_disable = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] image_upload_use_cinder_backend = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] image_upload_use_internal_tenant = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] image_volume_cache_enabled = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] image_volume_cache_max_count = 0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] image_volume_cache_max_size_gb = 0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] init_host_max_objects_retrieval = 0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] instance_format = [instance: %(uuid)s] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] iscsi_target_flags = {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] iscsi_write_cache = on {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] iser_helper = tgtadm {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] iser_ip_address = 192.168.122.242 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] iser_port = 3260 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] log_color = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] log_config_append = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] log_dir = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76190]: INFO cinder.volume.manager [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] log_file = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] log_options = True {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] log_rotate_interval = 1 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] log_rotate_interval_type = days {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] log_rotation_type = none {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] max_age = 0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] max_logfile_count = 30 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] max_logfile_size_mb = 200 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] max_over_subscription_ratio = 20.0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] message_reap_interval = 86400 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] message_ttl = 2592000 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] migration_create_volume_timeout_secs = 300 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] monkey_patch = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] monkey_patch_modules = [] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] my_ip = 192.168.122.242 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] no_snapshot_gb_quota = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] num_iser_scan_tries = 3 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] num_shell_tries = 3 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] num_volume_device_scan_tries = 3 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] nvmeof_conn_info_version = 1 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] nvmet_ns_id = 10 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] nvmet_port_id = 1 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] osapi_max_limit = 1000 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] osapi_volume_ext_list = [] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] osapi_volume_listen = 0.0.0.0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] osapi_volume_listen_port = 8776 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] osapi_volume_use_ssl = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] osapi_volume_workers = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] per_volume_size_limit = -1 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] periodic_fuzzy_delay = 60 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] periodic_interval = 60 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] project_id_regex = [0-9a-f\-]+ {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] public_endpoint = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] publish_errors = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] quota_backup_gigabytes = 1000 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] quota_backups = 10 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] quota_gigabytes = 1000 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] quota_groups = 10 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] quota_snapshots = 10 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] quota_volumes = 10 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] rate_limit_burst = 0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] rate_limit_except_level = CRITICAL {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] rate_limit_interval = 0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] reinit_driver_count = 3 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] replication_device = **** {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] report_discard_supported = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] report_interval = 120 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] reservation_clean_interval = 86400 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] reservation_expire = 86400 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] reserved_image_namespaces = [] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] reserved_percentage = 0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] rpc_response_timeout = 120 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] run_external_periodic_tasks = True {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] scst_target_driver = iscsi {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] scst_target_iqn_name = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] service_down_time = 720 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] shell_completion = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] snapshot_name_template = snapshot-%s {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] snapshot_same_host = True {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] split_loggers = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] state_path = /opt/stack/data/cinder {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] storage_availability_zone = nova {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] storage_protocol = iSCSI {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] syslog_log_facility = LOG_USER {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] target_helper = lioadm {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] target_ip_address = 192.168.122.242 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] target_port = 3260 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] target_protocol = iscsi {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] target_secondary_ip_addresses = [] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] trace_flags = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] transfer_api_class = cinder.transfer.api.API {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] transport_url = **** {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] until_refresh = 0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] use_chap_auth = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] use_default_quota_class = True {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] use_journal = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] use_json = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] use_multipath_for_image_xfer = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] use_stderr = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] use_syslog = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] verify_glance_signatures = enabled {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] volume_api_class = cinder.volume.api.API {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] volume_backend_name = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] volume_clear = zero {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] volume_clear_ionice = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] volume_clear_size = 0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] volume_copy_bps_limit = 0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] volume_dd_blocksize = 1M {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] volume_name_template = volume-%s {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] volume_service_inithost_offload = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] volume_usage_audit_period = month {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] zoning_mode = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_concurrency.disable_process_locking = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] keystone_authtoken.auth_section = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] keystone_authtoken.auth_type = password {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] keystone_authtoken.auth_version = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] keystone_authtoken.cache = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] keystone_authtoken.certfile = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] keystone_authtoken.delay_auth_decision = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] keystone_authtoken.http_connect_timeout = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] keystone_authtoken.include_service_catalog = True {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] keystone_authtoken.insecure = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] keystone_authtoken.interface = public {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] keystone_authtoken.keyfile = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] keystone_authtoken.memcache_password = **** {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] keystone_authtoken.memcache_username = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] keystone_authtoken.region_name = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] keystone_authtoken.service_token_roles_required = True {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] keystone_authtoken.service_type = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] keystone_authtoken.token_cache_time = 300 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.242/identity {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cache.backend = dogpile.cache.null {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cache.backend_argument = **** {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cache.backend_expiration_time = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cache.config_prefix = cache.oslo {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cache.debug_cache_backend = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cache.enable_retry_client = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cache.enable_socket_keepalive = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cache.enabled = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cache.expiration_time = 600 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cache.hashclient_retry_attempts = 2 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cache.memcache_dead_retry = 300 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cache.memcache_pool_maxsize = 10 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cache.memcache_sasl_enabled = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cache.password = **** {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cache.proxies = [] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cache.redis_db = 0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cache.redis_sentinel_service_name = mymaster {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cache.redis_server = localhost:6379 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cache.retry_attempts = 2 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cache.retry_delay = 0.0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cache.socket_keepalive_count = 1 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cache.socket_keepalive_idle = 1 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cache.socket_keepalive_interval = 1 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cache.socket_timeout = 1.0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cache.tls_allowed_ciphers = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cache.tls_cafile = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cache.tls_certfile = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cache.tls_enabled = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cache.tls_keyfile = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cache.username = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] coordination.backend_url = **** {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] database.asyncio_connection = **** {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] database.asyncio_slave_connection = **** {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] database.backend = sqlalchemy {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] database.connection = **** {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] database.connection_debug = 0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] database.connection_parameters = {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] database.connection_recycle_time = 3600 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] database.connection_trace = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] database.db_inc_retry_interval = True {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] database.db_max_retries = 20 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] database.db_max_retry_interval = 10 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] database.db_retry_interval = 1 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] database.max_overflow = 50 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] database.max_pool_size = 5 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] database.max_retries = 10 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] database.mysql_wsrep_sync_wait = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] database.pool_timeout = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] database.retry_interval = 10 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] database.slave_connection = **** {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] database.sqlite_synchronous = True {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] database.synchronous_reader = True {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] database.use_db_reconnect = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_tracing.insecure = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] profiler.connection_string = messaging:// {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] profiler.enabled = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] profiler.es_doc_type = notification {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] profiler.es_scroll_size = 10000 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] profiler.es_scroll_time = 2m {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] profiler.filter_error_trace = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] profiler.hmac_keys = **** {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] profiler.sentinel_service_name = mymaster {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] profiler.socket_timeout = 0.1 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] profiler.trace_requests = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] profiler.trace_sqlalchemy = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] profiler_jaeger.process_tags = {} {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] profiler_jaeger.service_name_prefix = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] profiler_otlp.service_name_prefix = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_policy.enforce_new_defaults = True {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_policy.policy_default_rule = default {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_policy.policy_file = policy.yaml {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_policy.remote_timeout = 60.0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] privsep_osbrick.group = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] privsep_osbrick.helper_command = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] privsep_osbrick.user = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cinder_sys_admin.group = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cinder_sys_admin.helper_command = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] cinder_sys_admin.user = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] service_user.auth_section = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] service_user.auth_type = password {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] service_user.cafile = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] service_user.certfile = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] service_user.collect_timing = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] service_user.insecure = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] service_user.keyfile = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] service_user.send_service_user_token = True {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] service_user.split_loggers = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] service_user.timeout = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] service_user.tls_ciphers = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] service_user.tls_min_version = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] glance.auth_section = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] glance.auth_type = password {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] glance.certfile = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] glance.collect_timing = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack sudo[76244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] glance.insecure = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] glance.keyfile = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] glance.region_name = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] glance.split_loggers = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] glance.timeout = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] glance.tls_ciphers = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] glance.tls_min_version = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.backend_availability_zone = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack sudo[76244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.chap_password = **** {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.chap_username = {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.disk_geometry = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.driver_client_cert = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.driver_client_cert_key = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.driver_data_namespace = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.driver_use_ssl = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.enable_unsupported_driver = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.extra_capabilities = {} {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.filter_function = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.goodness_function = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.iscsi_target_flags = {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.iscsi_write_cache = on {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.iser_helper = tgtadm {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.iser_ip_address = 192.168.122.242 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.iser_port = 3260 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.lvm_mirrors = 0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.lvm_share_target = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.lvm_type = auto {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.num_shell_tries = 3 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.nvmet_port_id = 1 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.replication_device = **** {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.report_discard_supported = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.reserved_percentage = 0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.scst_target_driver = iscsi {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.scst_target_iqn_name = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.storage_protocol = iSCSI {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.target_helper = tgtadm {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.target_ip_address = 192.168.122.242 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.target_port = 3260 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.target_protocol = iscsi {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.trace_flags = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.unique_fqdn_network = True {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.use_chap_auth = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.volume_backend_name = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.volume_clear = zero {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.volume_clear_ionice = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.volume_clear_size = 0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.volume_group = cinder-volumes {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_reports.file_event_handler = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_reports.log_dir = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.backend_availability_zone = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.backend_host = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.chap_password = **** {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.chap_username = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.chiscsi_conf = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.disk_geometry = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.driver_client_cert = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.driver_data_namespace = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.driver_use_ssl = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.extra_capabilities = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.filter_function = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.goodness_function = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.iser_helper = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.iser_ip_address = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.iser_port = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.iser_target_prefix = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.lvm_conf_file = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.lvm_mirrors = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.lvm_share_target = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.lvm_type = auto {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.num_shell_tries = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.nvmet_port_id = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.replication_device = **** {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.report_discard_supported = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.reserved_percentage = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.scst_target_driver = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.storage_protocol = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.target_helper = lioadm {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.target_ip_address = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.target_port = 3260 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.target_protocol = iscsi {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.trace_flags = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.use_chap_auth = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.volume_clear = zero {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.volume_clear_size = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] lvmdriver-1.volumes_dir = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_rabbit.ssl = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_rabbit.ssl_version = {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_notifications.driver = [] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_notifications.retry = -1 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] oslo_messaging_notifications.transport_url = **** {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] key_manager.fixed_key = **** {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] barbican.barbican_api_version = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] barbican.barbican_endpoint = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] barbican.barbican_endpoint_type = public {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] barbican.barbican_region_name = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] barbican.cafile = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] barbican.certfile = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] barbican.collect_timing = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] barbican.insecure = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] barbican.keyfile = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] barbican.number_of_retries = 60 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] barbican.retry_delay = 1 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] barbican.send_service_user_token = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] barbican.split_loggers = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] barbican.timeout = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] barbican.tls_ciphers = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] barbican.tls_min_version = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] barbican.verify_ssl = True {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] barbican.verify_ssl_path = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] barbican_service_user.auth_section = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] barbican_service_user.auth_type = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] barbican_service_user.cafile = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] barbican_service_user.certfile = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] barbican_service_user.collect_timing = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] barbican_service_user.insecure = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] barbican_service_user.keyfile = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] barbican_service_user.split_loggers = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] barbican_service_user.timeout = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] barbican_service_user.tls_ciphers = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] barbican_service_user.tls_min_version = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] vault.approle_role_id = **** {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] vault.approle_secret_id = **** {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] vault.auth_method = approle {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] vault.auth_path = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] vault.kv_mountpoint = secret {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] vault.kv_path = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] vault.kv_version = 2 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] vault.namespace = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] vault.root_token_id = **** {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] vault.ssl_ca_crt_file = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] vault.timeout = 60.0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] vault.token_file = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] vault.token_role = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] vault.use_ssl = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:12:26 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] ******************************************************************************** {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 03 14:12:27 devstack sudo[76244]: pam_unix(sudo:session): session closed for user root Sep 03 14:12:27 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.335s {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:12:27 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:12:27 devstack sudo[76385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 14:12:27 devstack sudo[76385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:12:27 devstack sudo[76385]: pam_unix(sudo:session): session closed for user root Sep 03 14:12:27 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.243s {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:12:27 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 14:12:27 devstack cinder-volume[76190]: INFO cinder.brick.local_dev.lvm [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 03 14:12:27 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:12:27 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:12:27 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:12:27 devstack sudo[76468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 14:12:27 devstack sudo[76468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:12:27 devstack sudo[76468]: pam_unix(sudo:session): session closed for user root Sep 03 14:12:27 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:12:27 devstack cinder-volume[76190]: DEBUG cinder.brick.local_dev.lvm [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76190) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 03 14:12:27 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:12:27 devstack sudo[76558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 14:12:27 devstack sudo[76558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:12:28 devstack sudo[76558]: pam_unix(sudo:session): session closed for user root Sep 03 14:12:28 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.523s {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:12:28 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:12:28 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:12:28 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:12:28 devstack sudo[76724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 14:12:28 devstack sudo[76724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:12:28 devstack sudo[76724]: pam_unix(sudo:session): session closed for user root Sep 03 14:12:28 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.329s {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:12:28 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:12:28 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:12:28 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:12:28 devstack sudo[76804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 03 14:12:28 devstack sudo[76804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:12:28 devstack sudo[76804]: pam_unix(sudo:session): session closed for user root Sep 03 14:12:28 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.299s {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:12:28 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:12:28 devstack sudo[76831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 14:12:28 devstack sudo[76831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:12:29 devstack sudo[76831]: pam_unix(sudo:session): session closed for user root Sep 03 14:12:29 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.319s {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:12:29 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:12:29 devstack sudo[76891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 14:12:29 devstack sudo[76891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:12:29 devstack sudo[76891]: pam_unix(sudo:session): session closed for user root Sep 03 14:12:29 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:12:29 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:12:29 devstack sudo[76900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 14:12:29 devstack sudo[76900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:12:29 devstack sudo[76900]: pam_unix(sudo:session): session closed for user root Sep 03 14:12:29 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.305s {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:12:29 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:12:29 devstack sudo[76983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 14:12:29 devstack sudo[76983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:12:30 devstack sudo[76983]: pam_unix(sudo:session): session closed for user root Sep 03 14:12:30 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:12:30 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:12:30 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:12:30 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:12:30 devstack sudo[76987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 14:12:30 devstack sudo[76987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:12:30 devstack sudo[76987]: pam_unix(sudo:session): session closed for user root Sep 03 14:12:30 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:12:30 devstack cinder-volume[76190]: INFO cinder.volume.drivers.lvm [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 03 14:12:30 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:12:30 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:12:30 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:12:30 devstack sudo[76997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 14:12:30 devstack sudo[76997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:12:30 devstack sudo[76997]: pam_unix(sudo:session): session closed for user root Sep 03 14:12:30 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.236s {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:12:30 devstack cinder-volume[76190]: DEBUG cinder.volume.drivers.lvm [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Updating volume stats {{(pid=76190) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 03 14:12:30 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:12:30 devstack sudo[77000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 14:12:30 devstack sudo[77000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:12:30 devstack sudo[77000]: pam_unix(sudo:session): session closed for user root Sep 03 14:12:30 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.234s {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:12:30 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:12:30 devstack sudo[77003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 14:12:30 devstack sudo[77003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:12:31 devstack sudo[77003]: pam_unix(sudo:session): session closed for user root Sep 03 14:12:31 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:12:31 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:12:31 devstack sudo[77006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 14:12:31 devstack sudo[77006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:12:31 devstack sudo[77006]: pam_unix(sudo:session): session closed for user root Sep 03 14:12:31 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.241s {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:12:31 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:12:31 devstack sudo[77009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 14:12:31 devstack sudo[77009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:12:31 devstack sudo[77009]: pam_unix(sudo:session): session closed for user root Sep 03 14:12:31 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:12:31 devstack cinder-volume[76190]: INFO cinder.volume.driver [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Driver hasn't implemented _init_vendor_properties() Sep 03 14:12:31 devstack cinder-volume[76190]: DEBUG cinder.volume.driver [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76190) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 03 14:12:31 devstack cinder-volume[76190]: DEBUG oslo_db.sqlalchemy.engines [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76190) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 14:12:31 devstack cinder-volume[76190]: DEBUG dbcounter [-] [76190] Writer thread running {{(pid=76190) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 03 14:12:31 devstack cinder-volume[76190]: DEBUG cinder.db.api [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Building query based on filter {{(pid=76190) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 03 14:12:31 devstack cinder-volume[76190]: DEBUG cinder.image.image_utils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76190) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 03 14:12:31 devstack cinder-volume[76190]: INFO cinder.keymgr.migration [None req-deb9569a-6769-41f8-9336-d9dfd53490d2 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 03 14:12:31 devstack cinder-volume[76190]: DEBUG cinder.volume.drivers.lvm [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Updating volume stats {{(pid=76190) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 03 14:12:31 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:12:31 devstack sudo[77012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 14:12:31 devstack sudo[77012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:12:32 devstack sudo[77012]: pam_unix(sudo:session): session closed for user root Sep 03 14:12:32 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:12:32 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:12:32 devstack sudo[77018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 14:12:32 devstack sudo[77018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:12:32 devstack sudo[77018]: pam_unix(sudo:session): session closed for user root Sep 03 14:12:32 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:12:32 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:12:32 devstack sudo[77021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 14:12:32 devstack sudo[77021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:12:32 devstack sudo[77021]: pam_unix(sudo:session): session closed for user root Sep 03 14:12:32 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:12:32 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:12:32 devstack sudo[77024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 14:12:32 devstack sudo[77024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:12:32 devstack sudo[77024]: pam_unix(sudo:session): session closed for user root Sep 03 14:12:32 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:12:32 devstack cinder-volume[76190]: DEBUG cinder.manager [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Notifying Schedulers of capabilities ... {{(pid=76190) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:12:32 devstack cinder-volume[76190]: INFO cinder.volume.manager [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Driver initialization completed successfully. Sep 03 14:12:32 devstack cinder-volume[76190]: INFO cinder.manager [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Initiating service 2 cleanup Sep 03 14:12:32 devstack cinder-volume[76190]: INFO cinder.manager [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Service 2 cleanup completed. Sep 03 14:12:32 devstack cinder-volume[76190]: DEBUG cinder.service [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Creating RPC server for service cinder-volume {{(pid=76190) start /opt/stack/cinder/cinder/service.py:231}} Sep 03 14:12:32 devstack cinder-volume[76190]: DEBUG cinder.service [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76190) start /opt/stack/cinder/cinder/service.py:237}} Sep 03 14:12:33 devstack cinder-volume[76190]: INFO cinder.volume.manager [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 03 14:12:33 devstack cinder-volume[76190]: DEBUG cinder.volume.drivers.lvm [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Updating volume stats {{(pid=76190) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 03 14:12:33 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:12:33 devstack sudo[77027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 14:12:33 devstack sudo[77027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:12:33 devstack sudo[77027]: pam_unix(sudo:session): session closed for user root Sep 03 14:12:33 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:12:33 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:12:33 devstack sudo[77034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 14:12:33 devstack sudo[77034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:12:33 devstack sudo[77034]: pam_unix(sudo:session): session closed for user root Sep 03 14:12:33 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.237s {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:12:33 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:12:33 devstack sudo[77040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 14:12:33 devstack sudo[77040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:12:33 devstack sudo[77040]: pam_unix(sudo:session): session closed for user root Sep 03 14:12:33 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.234s {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:12:33 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:12:33 devstack sudo[77043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 14:12:33 devstack sudo[77043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:12:34 devstack sudo[77043]: pam_unix(sudo:session): session closed for user root Sep 03 14:12:34 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.235s {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:12:34 devstack cinder-volume[76190]: INFO cinder.volume.manager [None req-46dff6d1-877f-48eb-825a-369ec4c2ecbf None None] Driver post RPC initialization completed successfully. Sep 03 14:12:36 devstack cinder-volume[76035]: DEBUG dbcounter [-] [76035] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76035) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:12:44 devstack cinder-volume[76190]: DEBUG dbcounter [-] [76190] Writing DB stats cinder:SELECT=2 {{(pid=76190) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:12:44 devstack cinder-volume[76190]: DEBUG dbcounter [-] [76190] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76190) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:13:27 devstack cinder-volume[76190]: DEBUG oslo_service.periodic_task [None req-593822a2-4647-4fea-a9eb-e3d20fb54559 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76190) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 14:13:27 devstack cinder-volume[76190]: DEBUG cinder.volume.drivers.lvm [None req-593822a2-4647-4fea-a9eb-e3d20fb54559 None None] Updating volume stats {{(pid=76190) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 03 14:13:27 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-593822a2-4647-4fea-a9eb-e3d20fb54559 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:13:27 devstack sudo[78976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 14:13:27 devstack sudo[78976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:13:27 devstack sudo[78976]: pam_unix(sudo:session): session closed for user root Sep 03 14:13:27 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-593822a2-4647-4fea-a9eb-e3d20fb54559 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:13:27 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-593822a2-4647-4fea-a9eb-e3d20fb54559 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:13:27 devstack sudo[79019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 14:13:27 devstack sudo[79019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:13:27 devstack sudo[79019]: pam_unix(sudo:session): session closed for user root Sep 03 14:13:27 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-593822a2-4647-4fea-a9eb-e3d20fb54559 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:13:27 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-593822a2-4647-4fea-a9eb-e3d20fb54559 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:13:27 devstack sudo[79022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 14:13:27 devstack sudo[79022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:13:27 devstack sudo[79022]: pam_unix(sudo:session): session closed for user root Sep 03 14:13:27 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-593822a2-4647-4fea-a9eb-e3d20fb54559 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.238s {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:13:27 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-593822a2-4647-4fea-a9eb-e3d20fb54559 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:13:27 devstack sudo[79025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 14:13:27 devstack sudo[79025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:13:28 devstack sudo[79025]: pam_unix(sudo:session): session closed for user root Sep 03 14:13:28 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-593822a2-4647-4fea-a9eb-e3d20fb54559 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.239s {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:13:28 devstack cinder-volume[76190]: DEBUG cinder.manager [None req-593822a2-4647-4fea-a9eb-e3d20fb54559 None None] Notifying Schedulers of capabilities ... {{(pid=76190) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:13:28 devstack cinder-volume[76190]: DEBUG oslo_service.periodic_task [None req-593822a2-4647-4fea-a9eb-e3d20fb54559 None None] Running periodic task VolumeManager._thread_info {{(pid=76190) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 14:13:28 devstack cinder-volume[76190]: DEBUG cinder.volume.manager [None req-593822a2-4647-4fea-a9eb-e3d20fb54559 None None] thread count: 6 {{(pid=76190) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 14:13:28 devstack cinder-volume[76190]: DEBUG cinder.volume.manager [None req-593822a2-4647-4fea-a9eb-e3d20fb54559 None None] thread info: [<_MainThread(MainThread, started 133167976562816)>, , , , , ] {{(pid=76190) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 14:14:27 devstack cinder-volume[76190]: DEBUG oslo_service.periodic_task [None req-593822a2-4647-4fea-a9eb-e3d20fb54559 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76190) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 14:14:27 devstack cinder-volume[76190]: DEBUG cinder.volume.drivers.lvm [None req-593822a2-4647-4fea-a9eb-e3d20fb54559 None None] Updating volume stats {{(pid=76190) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 03 14:14:27 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-593822a2-4647-4fea-a9eb-e3d20fb54559 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:14:27 devstack sudo[82318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 14:14:27 devstack sudo[82318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:14:27 devstack sudo[82318]: pam_unix(sudo:session): session closed for user root Sep 03 14:14:27 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-593822a2-4647-4fea-a9eb-e3d20fb54559 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:14:27 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-593822a2-4647-4fea-a9eb-e3d20fb54559 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:14:27 devstack sudo[82322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 14:14:27 devstack sudo[82322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:14:27 devstack sudo[82322]: pam_unix(sudo:session): session closed for user root Sep 03 14:14:27 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-593822a2-4647-4fea-a9eb-e3d20fb54559 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:14:27 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-593822a2-4647-4fea-a9eb-e3d20fb54559 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:14:27 devstack sudo[82326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 14:14:27 devstack sudo[82326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:14:27 devstack sudo[82326]: pam_unix(sudo:session): session closed for user root Sep 03 14:14:27 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-593822a2-4647-4fea-a9eb-e3d20fb54559 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:14:27 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-593822a2-4647-4fea-a9eb-e3d20fb54559 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:14:27 devstack sudo[82333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 14:14:27 devstack sudo[82333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:14:28 devstack sudo[82333]: pam_unix(sudo:session): session closed for user root Sep 03 14:14:28 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-593822a2-4647-4fea-a9eb-e3d20fb54559 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:14:28 devstack cinder-volume[76190]: DEBUG cinder.manager [None req-593822a2-4647-4fea-a9eb-e3d20fb54559 None None] Notifying Schedulers of capabilities ... {{(pid=76190) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:14:28 devstack cinder-volume[76190]: DEBUG oslo_service.periodic_task [None req-593822a2-4647-4fea-a9eb-e3d20fb54559 None None] Running periodic task VolumeManager._thread_info {{(pid=76190) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 14:14:28 devstack cinder-volume[76190]: DEBUG cinder.volume.manager [None req-593822a2-4647-4fea-a9eb-e3d20fb54559 None None] thread count: 6 {{(pid=76190) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 14:14:28 devstack cinder-volume[76190]: DEBUG cinder.volume.manager [None req-593822a2-4647-4fea-a9eb-e3d20fb54559 None None] thread info: [<_MainThread(MainThread, started 133167976562816)>, , , , , ] {{(pid=76190) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 14:14:44 devstack cinder-volume[76190]: DEBUG dbcounter [-] [76190] Writing DB stats cinder:SELECT=1 {{(pid=76190) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:14:44 devstack cinder-volume[76190]: DEBUG dbcounter [-] [76190] Writing DB stats cinder:UPDATE=1 {{(pid=76190) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:16:27 devstack cinder-volume[76190]: DEBUG oslo_service.periodic_task [None req-593822a2-4647-4fea-a9eb-e3d20fb54559 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76190) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 14:16:27 devstack cinder-volume[76190]: DEBUG cinder.volume.drivers.lvm [None req-593822a2-4647-4fea-a9eb-e3d20fb54559 None None] Updating volume stats {{(pid=76190) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 03 14:16:27 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-593822a2-4647-4fea-a9eb-e3d20fb54559 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:16:27 devstack sudo[85555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 14:16:27 devstack sudo[85555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:16:27 devstack sudo[85555]: pam_unix(sudo:session): session closed for user root Sep 03 14:16:27 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-593822a2-4647-4fea-a9eb-e3d20fb54559 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:16:27 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-593822a2-4647-4fea-a9eb-e3d20fb54559 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:16:27 devstack sudo[85558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 14:16:27 devstack sudo[85558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:16:27 devstack sudo[85558]: pam_unix(sudo:session): session closed for user root Sep 03 14:16:27 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-593822a2-4647-4fea-a9eb-e3d20fb54559 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:16:27 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-593822a2-4647-4fea-a9eb-e3d20fb54559 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:16:27 devstack sudo[85561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 14:16:27 devstack sudo[85561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:16:27 devstack sudo[85561]: pam_unix(sudo:session): session closed for user root Sep 03 14:16:27 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-593822a2-4647-4fea-a9eb-e3d20fb54559 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:16:27 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-593822a2-4647-4fea-a9eb-e3d20fb54559 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:16:27 devstack sudo[85564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 14:16:27 devstack sudo[85564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:16:28 devstack sudo[85564]: pam_unix(sudo:session): session closed for user root Sep 03 14:16:28 devstack cinder-volume[76190]: DEBUG oslo_concurrency.processutils [None req-593822a2-4647-4fea-a9eb-e3d20fb54559 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:16:28 devstack cinder-volume[76190]: DEBUG cinder.manager [None req-593822a2-4647-4fea-a9eb-e3d20fb54559 None None] Notifying Schedulers of capabilities ... {{(pid=76190) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:16:28 devstack cinder-volume[76190]: DEBUG oslo_service.periodic_task [None req-593822a2-4647-4fea-a9eb-e3d20fb54559 None None] Running periodic task VolumeManager._thread_info {{(pid=76190) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 14:16:28 devstack cinder-volume[76190]: DEBUG cinder.volume.manager [None req-593822a2-4647-4fea-a9eb-e3d20fb54559 None None] thread count: 6 {{(pid=76190) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 14:16:28 devstack cinder-volume[76190]: DEBUG cinder.volume.manager [None req-593822a2-4647-4fea-a9eb-e3d20fb54559 None None] thread info: [<_MainThread(MainThread, started 133167976562816)>, , , , , ] {{(pid=76190) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 14:16:44 devstack cinder-volume[76190]: DEBUG dbcounter [-] [76190] Writing DB stats cinder:SELECT=1 {{(pid=76190) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:16:44 devstack cinder-volume[76190]: DEBUG dbcounter [-] [76190] Writing DB stats cinder:UPDATE=1 {{(pid=76190) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:16:51 devstack cinder-volume[76035]: INFO oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] Caught SIGTERM, stopping children Sep 03 14:16:51 devstack cinder-volume[76035]: DEBUG oslo_concurrency.lockutils [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] Acquiring lock "singleton_lock" {{(pid=76035) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 03 14:16:51 devstack cinder-volume[76035]: DEBUG oslo_concurrency.lockutils [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] Acquired lock "singleton_lock" {{(pid=76035) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 03 14:16:51 devstack cinder-volume[76035]: DEBUG oslo_concurrency.lockutils [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] Releasing lock "singleton_lock" {{(pid=76035) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 03 14:16:51 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] Stop services. {{(pid=76035) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 03 14:16:51 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] Killing children. {{(pid=76035) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 03 14:16:51 devstack cinder-volume[76035]: INFO oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] Waiting on 1 children to exit Sep 03 14:16:53 devstack cinder-volume[76190]: DEBUG oslo_concurrency.lockutils [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] Acquiring lock "singleton_lock" {{(pid=76190) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 03 14:16:53 devstack cinder-volume[76190]: DEBUG oslo_concurrency.lockutils [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] Acquired lock "singleton_lock" {{(pid=76190) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 03 14:16:53 devstack cinder-volume[76190]: DEBUG oslo_concurrency.lockutils [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] Releasing lock "singleton_lock" {{(pid=76190) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 03 14:16:53 devstack cinder-volume[76190]: WARNING amqp [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 03 14:16:53 devstack cinder-volume[76190]: WARNING amqp [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 03 14:16:53 devstack cinder-volume[76035]: INFO oslo_service.backend._eventlet.service [None req-e38abcba-03d6-4072-9adf-eed0b9400bca None None] Child 76190 exited with status 0 Sep 03 14:16:53 devstack cinder-volume[86164]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 03 14:16:53 devstack cinder-volume[86164]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 03 14:16:53 devstack cinder-volume[86164]: we strongly recommend against using it for new projects. Sep 03 14:16:53 devstack cinder-volume[86164]: If you are already using Eventlet, we recommend migrating to a different Sep 03 14:16:53 devstack cinder-volume[86164]: framework. For more detail see Sep 03 14:16:53 devstack cinder-volume[86164]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 03 14:16:53 devstack cinder-volume[86164]: import eventlet # noqa Sep 03 14:16:55 devstack cinder-volume[86164]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86164) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 03 14:16:55 devstack cinder-volume[86164]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86164) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 03 14:16:55 devstack cinder-volume[86164]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86164) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 03 14:16:56 devstack cinder-volume[86164]: INFO dbcounter [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] Registered counter for database cinder Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_db.sqlalchemy.engines [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86164) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG dbcounter [-] [86164] Writer thread running {{(pid=86164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 03 14:16:56 devstack cinder-volume[86164]: INFO cinder.rpc [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 03 14:16:56 devstack cinder-volume[86164]: INFO cinder.rpc [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_db.sqlalchemy.engines [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86164) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 14:16:56 devstack cinder-volume[86164]: INFO cinder.volume.manager [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] Determined volume DB was empty at startup. Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG cinder.volume.manager [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86164) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 03 14:16:56 devstack cinder-volume[86164]: INFO cinder.volume.manager [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 03 14:16:56 devstack cinder-volume[86164]: WARNING stevedore.named [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 03 14:16:56 devstack cinder-volume[86164]: WARNING castellan.key_manager [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 03 14:16:56 devstack cinder-volume[86164]: WARNING cinder.keymgr.conf_key_mgr [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 03 14:16:56 devstack cinder-volume[86164]: INFO cinder.volume.manager [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_db.sqlalchemy.engines [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86164) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 14:16:56 devstack cinder-volume[86164]: INFO oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] Starting 1 workers Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] Started child 86415 {{(pid=86164) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] Full set of CONF: {{(pid=86164) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] ******************************************************************************** {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] Configuration options gathered from: {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] ================================================================================ {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] allow_availability_zone_fallback = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] allow_compression_on_image_upload = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86415]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] allowed_direct_url_schemes = [] {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] api_rate_limit = True {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] auth_strategy = keystone {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_availability_zone = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_host = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_name = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_stats_polling_interval = 60 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backup_api_class = cinder.backup.api.API {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backup_name_template = backup-%s {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backup_use_same_host = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backup_use_temp_snapshot = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] chap_password = **** {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] chap_username = {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] cinder_internal_tenant_project_id = db9df8027b6a4ddc9615818c15da3030 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] cinder_internal_tenant_user_id = c2adb37de5f24929a76e79d6b715dd69 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] cluster = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] compression_format = gzip {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] compute_api_class = cinder.compute.nova.API {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] config_dir = [] {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] config_source = [] {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] control_exchange = openstack {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] debug = True {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] default_availability_zone = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] default_group_type = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] default_volume_type = QuobyteHD {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] disk_geometry = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] driver_client_cert = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] driver_client_cert_key = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] driver_data_namespace = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] driver_ssl_cert_path = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] driver_ssl_cert_verify = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] driver_use_ssl = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] enable_new_services = True {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] enable_unsupported_driver = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] enabled_backends = ['QuobyteHD'] {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] enforce_multipath_for_image_xfer = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] filter_function = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] glance_api_insecure = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] glance_api_servers = ['http://192.168.122.242/image'] {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] glance_api_ssl_compression = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] glance_ca_certificates_file = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] glance_catalog_info = image:glance:publicURL {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] glance_certfile = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] glance_keyfile = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] glance_num_retries = 3 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] glance_request_timeout = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] goodness_function = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] graceful_shutdown_timeout = 5 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] group_api_class = cinder.group.api.API {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] host = devstack {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] image_compress_on_upload = True {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] image_conversion_address_space_limit = 1 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] image_conversion_cpu_limit = 60 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] image_conversion_disable = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] image_upload_use_cinder_backend = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] image_upload_use_internal_tenant = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] image_volume_cache_enabled = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] image_volume_cache_max_count = 0 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] image_volume_cache_max_size_gb = 0 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] init_host_max_objects_retrieval = 0 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] instance_format = [instance: %(uuid)s] {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] iscsi_target_flags = {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] iscsi_write_cache = on {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] iser_helper = tgtadm {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] iser_ip_address = 192.168.122.242 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] iser_port = 3260 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] log_color = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] log_config_append = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] log_dir = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] log_file = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] log_options = True {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86415]: INFO cinder.volume.manager [None req-44bd70b9-ce76-4ab0-ba71-52ec41fbba00 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] log_rotate_interval = 1 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] log_rotate_interval_type = days {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] log_rotation_type = none {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86415]: DEBUG cinder.volume.drivers.remotefs [None req-44bd70b9-ce76-4ab0-ba71-52ec41fbba00 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86415) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] max_age = 0 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] max_logfile_count = 30 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] max_logfile_size_mb = 200 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] max_over_subscription_ratio = 20.0 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] message_reap_interval = 86400 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] message_ttl = 2592000 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] migration_create_volume_timeout_secs = 300 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] monkey_patch = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] monkey_patch_modules = [] {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] my_ip = 192.168.122.242 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] no_snapshot_gb_quota = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] num_iser_scan_tries = 3 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] num_shell_tries = 3 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] num_volume_device_scan_tries = 3 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] nvmeof_conn_info_version = 1 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] nvmet_ns_id = 10 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] nvmet_port_id = 1 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] osapi_max_limit = 1000 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] osapi_volume_ext_list = [] {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] osapi_volume_listen_port = 8776 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] osapi_volume_use_ssl = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] osapi_volume_workers = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] per_volume_size_limit = -1 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] periodic_fuzzy_delay = 60 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] periodic_interval = 60 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] public_endpoint = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] publish_errors = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] quota_backup_gigabytes = 1000 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] quota_backups = 10 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] quota_gigabytes = 1000 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] quota_groups = 10 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] quota_snapshots = 10 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] quota_volumes = 10 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] rate_limit_burst = 0 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] rate_limit_except_level = CRITICAL {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] rate_limit_interval = 0 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] reinit_driver_count = 3 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] replication_device = **** {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] report_discard_supported = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] report_interval = 120 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] reservation_clean_interval = 86400 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] reservation_expire = 86400 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] reserved_image_namespaces = [] {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] reserved_percentage = 0 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] rpc_response_timeout = 120 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] run_external_periodic_tasks = True {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] scst_target_driver = iscsi {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] scst_target_iqn_name = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] service_down_time = 720 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] shell_completion = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] snapshot_name_template = snapshot-%s {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] split_loggers = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] state_path = /opt/stack/data/cinder {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] storage_availability_zone = nova {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] storage_protocol = iSCSI {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] syslog_log_facility = LOG_USER {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] target_helper = lioadm {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] target_ip_address = 192.168.122.242 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] target_port = 3260 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] target_protocol = iscsi {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] target_secondary_ip_addresses = [] {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] trace_flags = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] transport_url = **** {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] until_refresh = 0 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] use_chap_auth = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] use_default_quota_class = True {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] use_journal = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] use_json = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:56 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] use_multipath_for_image_xfer = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] use_stderr = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] use_syslog = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] verify_glance_signatures = enabled {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] volume_api_class = cinder.volume.api.API {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] volume_backend_name = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] volume_clear = zero {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] volume_clear_ionice = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] volume_clear_size = 0 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] volume_copy_bps_limit = 0 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] volume_dd_blocksize = 1M {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] volume_name_template = volume-%s {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] volume_service_inithost_offload = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] volume_usage_audit_period = month {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] zoning_mode = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_concurrency.disable_process_locking = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] keystone_authtoken.auth_section = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] keystone_authtoken.auth_type = password {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] keystone_authtoken.auth_version = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] keystone_authtoken.cache = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] keystone_authtoken.certfile = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] keystone_authtoken.include_service_catalog = True {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] keystone_authtoken.insecure = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] keystone_authtoken.interface = public {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] keystone_authtoken.keyfile = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] keystone_authtoken.memcache_password = **** {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] keystone_authtoken.memcache_username = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] keystone_authtoken.region_name = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] keystone_authtoken.service_type = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.242/identity {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] cache.backend = dogpile.cache.null {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] cache.backend_argument = **** {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] cache.backend_expiration_time = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] cache.config_prefix = cache.oslo {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] cache.debug_cache_backend = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] cache.enable_retry_client = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] cache.enable_socket_keepalive = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] cache.enabled = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] cache.expiration_time = 600 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] cache.hashclient_retry_attempts = 2 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] cache.memcache_dead_retry = 300 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] cache.memcache_pool_maxsize = 10 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] cache.memcache_sasl_enabled = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] cache.password = **** {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] cache.proxies = [] {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] cache.redis_db = 0 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] cache.redis_server = localhost:6379 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] cache.retry_attempts = 2 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] cache.retry_delay = 0.0 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] cache.socket_keepalive_count = 1 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] cache.socket_keepalive_idle = 1 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] cache.socket_keepalive_interval = 1 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] cache.socket_timeout = 1.0 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] cache.tls_allowed_ciphers = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] cache.tls_cafile = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] cache.tls_certfile = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] cache.tls_enabled = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] cache.tls_keyfile = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] cache.username = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] coordination.backend_url = **** {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] database.asyncio_connection = **** {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] database.asyncio_slave_connection = **** {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] database.backend = sqlalchemy {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] database.connection = **** {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] database.connection_debug = 0 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] database.connection_parameters = {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] database.connection_recycle_time = 3600 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] database.connection_trace = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] database.db_inc_retry_interval = True {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] database.db_max_retries = 20 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] database.db_max_retry_interval = 10 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] database.db_retry_interval = 1 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] database.max_overflow = 50 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] database.max_pool_size = 5 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] database.max_retries = 10 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] database.mysql_wsrep_sync_wait = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] database.pool_timeout = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] database.retry_interval = 10 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] database.slave_connection = **** {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] database.sqlite_synchronous = True {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] database.synchronous_reader = True {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] database.use_db_reconnect = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_tracing.insecure = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] profiler.connection_string = messaging:// {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] profiler.enabled = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] profiler.es_doc_type = notification {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] profiler.es_scroll_size = 10000 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] profiler.es_scroll_time = 2m {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] profiler.filter_error_trace = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] profiler.hmac_keys = **** {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] profiler.sentinel_service_name = mymaster {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] profiler.socket_timeout = 0.1 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86415]: DEBUG cinder.volume.drivers.quobyte [None req-44bd70b9-ce76-4ab0-ba71-52ec41fbba00 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86415) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 03 14:16:57 devstack cinder-volume[86415]: WARNING cinder.volume.drivers.quobyte [None req-44bd70b9-ce76-4ab0-ba71-52ec41fbba00 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] profiler.trace_requests = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] profiler.trace_sqlalchemy = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] profiler_jaeger.process_tags = {} {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] profiler_jaeger.service_name_prefix = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] profiler_otlp.service_name_prefix = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_policy.enforce_new_defaults = True {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_policy.policy_default_rule = default {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_policy.policy_file = policy.yaml {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86415]: WARNING cinder.volume.drivers.quobyte [None req-44bd70b9-ce76-4ab0-ba71-52ec41fbba00 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] privsep_osbrick.group = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] privsep_osbrick.helper_command = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86415]: DEBUG oslo_concurrency.processutils [None req-44bd70b9-ce76-4ab0-ba71-52ec41fbba00 None None] Running cmd (subprocess): mount.quobyte {{(pid=86415) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] privsep_osbrick.user = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] cinder_sys_admin.group = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] cinder_sys_admin.helper_command = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] cinder_sys_admin.user = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] service_user.auth_section = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] service_user.auth_type = password {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] service_user.cafile = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] service_user.certfile = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] service_user.collect_timing = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] service_user.insecure = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] service_user.keyfile = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] service_user.send_service_user_token = True {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] service_user.split_loggers = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] service_user.timeout = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] service_user.tls_ciphers = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] service_user.tls_min_version = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] glance.auth_section = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] glance.auth_type = password {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] glance.certfile = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] glance.collect_timing = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] glance.insecure = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] glance.keyfile = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] glance.region_name = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] glance.split_loggers = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] glance.timeout = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] glance.tls_ciphers = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] glance.tls_min_version = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.backend_availability_zone = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.chap_password = **** {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.chap_username = {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.disk_geometry = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.driver_client_cert = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.driver_client_cert_key = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.driver_data_namespace = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.driver_use_ssl = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.extra_capabilities = {} {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.filter_function = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.goodness_function = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.iscsi_target_flags = {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.iscsi_write_cache = on {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.iser_helper = tgtadm {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.iser_ip_address = 192.168.122.242 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.iser_port = 3260 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.nas_host = {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.nas_login = admin {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.nas_mount_options = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.nas_password = **** {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.nas_private_key = {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.nas_share_path = {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.num_shell_tries = 3 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.quobyte_volume_url = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.replication_device = **** {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.report_discard_supported = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.reserved_percentage = 0 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.target_helper = tgtadm {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.target_ip_address = 192.168.122.242 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.target_port = 3260 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.target_protocol = iscsi {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.trace_flags = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.unique_fqdn_network = True {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.use_chap_auth = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.volume_backend_name = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.volume_clear = zero {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.volume_clear_ionice = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.volume_clear_size = 0 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_reports.file_event_handler = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_reports.log_dir = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.backend_availability_zone = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.backend_host = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.chap_password = **** {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.chap_username = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.chiscsi_conf = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.disk_geometry = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.driver_client_cert = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.driver_data_namespace = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.driver_use_ssl = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.extra_capabilities = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.filter_function = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.goodness_function = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.iser_helper = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.iser_ip_address = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.iser_port = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.iser_target_prefix = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.nas_host = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.nas_login = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.nas_mount_options = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.nas_password = **** {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.nas_private_key = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.nas_share_path = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.nas_ssh_port = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.num_shell_tries = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.nvmet_port_id = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86415]: DEBUG oslo_concurrency.processutils [None req-44bd70b9-ce76-4ab0-ba71-52ec41fbba00 None None] CMD "mount.quobyte" returned: 1 in 0.114s {{(pid=86415) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:16:57 devstack cinder-volume[86415]: DEBUG oslo_concurrency.lockutils [None req-44bd70b9-ce76-4ab0-ba71-52ec41fbba00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86415) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86415]: DEBUG oslo_concurrency.lockutils [None req-44bd70b9-ce76-4ab0-ba71-52ec41fbba00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86415) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:16:57 devstack cinder-volume[86415]: DEBUG cinder.volume.drivers.quobyte [None req-44bd70b9-ce76-4ab0-ba71-52ec41fbba00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=86415) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.replication_device = **** {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.report_discard_supported = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.reserved_percentage = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86415]: INFO cinder.volume.drivers.quobyte [None req-44bd70b9-ce76-4ab0-ba71-52ec41fbba00 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 ... Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.scst_target_driver = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86415]: DEBUG oslo_concurrency.processutils [None req-44bd70b9-ce76-4ab0-ba71-52ec41fbba00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 -c /etc/quobyte/client-cinder.cfg {{(pid=86415) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.storage_protocol = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.target_helper = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.target_ip_address = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.target_port = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.target_prefix = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.target_protocol = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.trace_flags = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.use_chap_auth = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.volume_clear = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.volume_clear_size = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] QuobyteHD.volumes_dir = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_rabbit.ssl = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_notifications.driver = [] {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack sudo[86417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 -c /etc/quobyte/client-cinder.cfg Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_notifications.retry = -1 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack sudo[86417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] key_manager.fixed_key = **** {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] barbican.barbican_api_version = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] barbican.barbican_endpoint = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] barbican.barbican_endpoint_type = public {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] barbican.barbican_region_name = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] barbican.cafile = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] barbican.certfile = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] barbican.collect_timing = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] barbican.insecure = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] barbican.keyfile = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] barbican.number_of_retries = 60 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] barbican.retry_delay = 1 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] barbican.send_service_user_token = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] barbican.split_loggers = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] barbican.timeout = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] barbican.tls_ciphers = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] barbican.tls_min_version = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] barbican.verify_ssl = True {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] barbican.verify_ssl_path = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] barbican_service_user.auth_section = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] barbican_service_user.auth_type = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] barbican_service_user.cafile = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] barbican_service_user.certfile = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] barbican_service_user.collect_timing = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] barbican_service_user.insecure = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] barbican_service_user.keyfile = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] barbican_service_user.split_loggers = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] barbican_service_user.timeout = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] barbican_service_user.tls_ciphers = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] barbican_service_user.tls_min_version = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] vault.approle_role_id = **** {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] vault.approle_secret_id = **** {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] vault.auth_method = approle {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] vault.auth_path = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] vault.kv_mountpoint = secret {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] vault.kv_path = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] vault.kv_version = 2 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] vault.namespace = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] vault.root_token_id = **** {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] vault.ssl_ca_crt_file = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] vault.timeout = 60.0 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] vault.token_file = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] vault.token_role = None {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] vault.use_ssl = False {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:16:57 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] ******************************************************************************** {{(pid=86164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 03 14:16:57 devstack sudo[86417]: pam_unix(sudo:session): session closed for user root Sep 03 14:16:57 devstack cinder-volume[86415]: DEBUG oslo_concurrency.processutils [None req-44bd70b9-ce76-4ab0-ba71-52ec41fbba00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.419s {{(pid=86415) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:16:57 devstack cinder-volume[86415]: INFO cinder.volume.drivers.quobyte [None req-44bd70b9-ce76-4ab0-ba71-52ec41fbba00 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 succeeded Sep 03 14:16:57 devstack cinder-volume[86415]: DEBUG cinder.volume.drivers.quobyte [None req-44bd70b9-ce76-4ab0-ba71-52ec41fbba00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=86415) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:16:57 devstack cinder-volume[86415]: DEBUG oslo_concurrency.lockutils [None req-44bd70b9-ce76-4ab0-ba71-52ec41fbba00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.438s {{(pid=86415) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:16:57 devstack cinder-volume[86415]: DEBUG oslo_concurrency.processutils [None req-44bd70b9-ce76-4ab0-ba71-52ec41fbba00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=86415) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:16:57 devstack sudo[86490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:16:57 devstack sudo[86490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:16:57 devstack sudo[86490]: pam_unix(sudo:session): session closed for user root Sep 03 14:16:57 devstack cinder-volume[86415]: DEBUG oslo_concurrency.processutils [None req-44bd70b9-ce76-4ab0-ba71-52ec41fbba00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.236s {{(pid=86415) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:16:57 devstack cinder-volume[86415]: INFO cinder.volume.driver [None req-44bd70b9-ce76-4ab0-ba71-52ec41fbba00 None None] Driver hasn't implemented _init_vendor_properties() Sep 03 14:16:57 devstack cinder-volume[86415]: DEBUG cinder.volume.driver [None req-44bd70b9-ce76-4ab0-ba71-52ec41fbba00 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8406867980957, 'free_capacity_gb': 1773.8406867980957, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86415) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 03 14:16:57 devstack cinder-volume[86415]: DEBUG oslo_db.sqlalchemy.engines [None req-44bd70b9-ce76-4ab0-ba71-52ec41fbba00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86415) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 14:16:57 devstack cinder-volume[86415]: DEBUG dbcounter [-] [86415] Writer thread running {{(pid=86415) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 03 14:16:57 devstack cinder-volume[86415]: DEBUG cinder.db.api [None req-44bd70b9-ce76-4ab0-ba71-52ec41fbba00 None None] Building query based on filter {{(pid=86415) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 03 14:16:57 devstack cinder-volume[86415]: DEBUG cinder.image.image_utils [None req-44bd70b9-ce76-4ab0-ba71-52ec41fbba00 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86415) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 03 14:16:57 devstack cinder-volume[86415]: INFO cinder.keymgr.migration [None req-f0edd78d-f389-412c-a75b-04be91628724 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 03 14:16:58 devstack cinder-volume[86415]: DEBUG oslo_concurrency.lockutils [None req-44bd70b9-ce76-4ab0-ba71-52ec41fbba00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86415) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:16:58 devstack cinder-volume[86415]: DEBUG oslo_concurrency.lockutils [None req-44bd70b9-ce76-4ab0-ba71-52ec41fbba00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86415) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:16:58 devstack cinder-volume[86415]: DEBUG cinder.volume.drivers.quobyte [None req-44bd70b9-ce76-4ab0-ba71-52ec41fbba00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=86415) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:16:58 devstack cinder-volume[86415]: DEBUG cinder.volume.drivers.quobyte [None req-44bd70b9-ce76-4ab0-ba71-52ec41fbba00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=86415) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:16:58 devstack cinder-volume[86415]: DEBUG oslo_concurrency.lockutils [None req-44bd70b9-ce76-4ab0-ba71-52ec41fbba00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86415) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:16:58 devstack cinder-volume[86415]: DEBUG oslo_concurrency.processutils [None req-44bd70b9-ce76-4ab0-ba71-52ec41fbba00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=86415) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:16:58 devstack sudo[86493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:16:58 devstack sudo[86493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:16:58 devstack sudo[86493]: pam_unix(sudo:session): session closed for user root Sep 03 14:16:58 devstack cinder-volume[86415]: DEBUG oslo_concurrency.processutils [None req-44bd70b9-ce76-4ab0-ba71-52ec41fbba00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.255s {{(pid=86415) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:16:58 devstack cinder-volume[86415]: DEBUG cinder.manager [None req-44bd70b9-ce76-4ab0-ba71-52ec41fbba00 None None] Notifying Schedulers of capabilities ... {{(pid=86415) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:16:58 devstack cinder-volume[86415]: INFO cinder.volume.manager [None req-44bd70b9-ce76-4ab0-ba71-52ec41fbba00 None None] Driver initialization completed successfully. Sep 03 14:16:58 devstack cinder-volume[86415]: INFO cinder.manager [None req-44bd70b9-ce76-4ab0-ba71-52ec41fbba00 None None] Initiating service 3 cleanup Sep 03 14:16:58 devstack cinder-volume[86415]: INFO cinder.manager [None req-44bd70b9-ce76-4ab0-ba71-52ec41fbba00 None None] Service 3 cleanup completed. Sep 03 14:16:58 devstack cinder-volume[86415]: DEBUG cinder.service [None req-44bd70b9-ce76-4ab0-ba71-52ec41fbba00 None None] Creating RPC server for service cinder-volume {{(pid=86415) start /opt/stack/cinder/cinder/service.py:231}} Sep 03 14:16:58 devstack cinder-volume[86415]: DEBUG cinder.service [None req-44bd70b9-ce76-4ab0-ba71-52ec41fbba00 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86415) start /opt/stack/cinder/cinder/service.py:237}} Sep 03 14:16:58 devstack cinder-volume[86415]: INFO cinder.volume.manager [None req-44bd70b9-ce76-4ab0-ba71-52ec41fbba00 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 03 14:16:58 devstack cinder-volume[86415]: DEBUG oslo_concurrency.lockutils [None req-44bd70b9-ce76-4ab0-ba71-52ec41fbba00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86415) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:16:58 devstack cinder-volume[86415]: DEBUG oslo_concurrency.lockutils [None req-44bd70b9-ce76-4ab0-ba71-52ec41fbba00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86415) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:16:58 devstack cinder-volume[86415]: DEBUG cinder.volume.drivers.quobyte [None req-44bd70b9-ce76-4ab0-ba71-52ec41fbba00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=86415) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:16:58 devstack cinder-volume[86415]: DEBUG cinder.volume.drivers.quobyte [None req-44bd70b9-ce76-4ab0-ba71-52ec41fbba00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=86415) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:16:58 devstack cinder-volume[86415]: DEBUG oslo_concurrency.lockutils [None req-44bd70b9-ce76-4ab0-ba71-52ec41fbba00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86415) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:16:58 devstack cinder-volume[86415]: DEBUG oslo_concurrency.processutils [None req-44bd70b9-ce76-4ab0-ba71-52ec41fbba00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=86415) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:16:58 devstack sudo[86497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:16:58 devstack sudo[86497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:16:58 devstack sudo[86497]: pam_unix(sudo:session): session closed for user root Sep 03 14:16:58 devstack cinder-volume[86415]: DEBUG oslo_concurrency.processutils [None req-44bd70b9-ce76-4ab0-ba71-52ec41fbba00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.259s {{(pid=86415) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:16:58 devstack cinder-volume[86415]: INFO cinder.volume.manager [None req-44bd70b9-ce76-4ab0-ba71-52ec41fbba00 None None] Driver post RPC initialization completed successfully. Sep 03 14:17:03 devstack cinder-volume[86164]: INFO oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] Caught SIGTERM, stopping children Sep 03 14:17:03 devstack cinder-volume[86164]: DEBUG oslo_concurrency.lockutils [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] Acquiring lock "singleton_lock" {{(pid=86164) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 03 14:17:03 devstack cinder-volume[86164]: DEBUG oslo_concurrency.lockutils [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] Acquired lock "singleton_lock" {{(pid=86164) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 03 14:17:03 devstack cinder-volume[86164]: DEBUG oslo_concurrency.lockutils [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] Releasing lock "singleton_lock" {{(pid=86164) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 03 14:17:03 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] Stop services. {{(pid=86164) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 03 14:17:03 devstack cinder-volume[86164]: DEBUG oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] Killing children. {{(pid=86164) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 03 14:17:03 devstack cinder-volume[86164]: INFO oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] Waiting on 1 children to exit Sep 03 14:17:06 devstack cinder-volume[86415]: DEBUG oslo_concurrency.lockutils [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] Acquiring lock "singleton_lock" {{(pid=86415) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 03 14:17:06 devstack cinder-volume[86415]: DEBUG oslo_concurrency.lockutils [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] Acquired lock "singleton_lock" {{(pid=86415) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 03 14:17:06 devstack cinder-volume[86415]: DEBUG oslo_concurrency.lockutils [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] Releasing lock "singleton_lock" {{(pid=86415) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 03 14:17:06 devstack cinder-volume[86415]: WARNING amqp [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 03 14:17:06 devstack cinder-volume[86415]: WARNING amqp [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 03 14:17:06 devstack cinder-volume[86164]: INFO oslo_service.backend._eventlet.service [None req-b66f7861-8c3f-4403-80b1-a29a0d10f1b4 None None] Child 86415 exited with status 0 Sep 03 14:17:07 devstack cinder-volume[86703]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 03 14:17:07 devstack cinder-volume[86703]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 03 14:17:07 devstack cinder-volume[86703]: we strongly recommend against using it for new projects. Sep 03 14:17:07 devstack cinder-volume[86703]: If you are already using Eventlet, we recommend migrating to a different Sep 03 14:17:07 devstack cinder-volume[86703]: framework. For more detail see Sep 03 14:17:07 devstack cinder-volume[86703]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 03 14:17:07 devstack cinder-volume[86703]: import eventlet # noqa Sep 03 14:17:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86703) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 03 14:17:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86703) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 03 14:17:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86703) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 03 14:17:10 devstack cinder-volume[86703]: INFO dbcounter [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] Registered counter for database cinder Sep 03 14:17:10 devstack cinder-volume[86703]: DEBUG oslo_db.sqlalchemy.engines [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86703) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writer thread running {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 03 14:17:11 devstack cinder-volume[86703]: INFO cinder.rpc [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 03 14:17:11 devstack cinder-volume[86703]: INFO cinder.rpc [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_db.sqlalchemy.engines [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86703) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 14:17:11 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] Determined volume DB was empty at startup. Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86703) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 03 14:17:11 devstack cinder-volume[86703]: WARNING stevedore.named [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 03 14:17:11 devstack cinder-volume[86703]: WARNING castellan.key_manager [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 03 14:17:11 devstack cinder-volume[86703]: WARNING cinder.keymgr.conf_key_mgr [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 03 14:17:11 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_db.sqlalchemy.engines [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86703) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 14:17:11 devstack cinder-volume[86703]: INFO oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] Starting 1 workers Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] Started child 87007 {{(pid=86703) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] Full set of CONF: {{(pid=86703) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] ******************************************************************************** {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] Configuration options gathered from: {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] ================================================================================ {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] allow_availability_zone_fallback = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] allow_compression_on_image_upload = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] allowed_direct_url_schemes = [] {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] api_rate_limit = True {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] auth_strategy = keystone {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_availability_zone = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_host = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_name = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_stats_polling_interval = 60 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backup_api_class = cinder.backup.api.API {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backup_name_template = backup-%s {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backup_use_same_host = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backup_use_temp_snapshot = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] chap_password = **** {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] chap_username = {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] cinder_internal_tenant_project_id = db9df8027b6a4ddc9615818c15da3030 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] cinder_internal_tenant_user_id = c2adb37de5f24929a76e79d6b715dd69 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] cluster = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] compression_format = gzip {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[87007]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] compute_api_class = cinder.compute.nova.API {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] config_dir = [] {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] config_source = [] {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] control_exchange = openstack {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] debug = True {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] default_availability_zone = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] default_group_type = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] default_volume_type = QuobyteHD {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] disk_geometry = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] driver_client_cert = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] driver_client_cert_key = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] driver_data_namespace = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] driver_ssl_cert_path = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] driver_ssl_cert_verify = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] driver_use_ssl = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] enable_new_services = True {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] enable_unsupported_driver = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] enabled_backends = ['QuobyteHD'] {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] enforce_multipath_for_image_xfer = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] filter_function = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] glance_api_insecure = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] glance_api_servers = ['http://192.168.122.242/image'] {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] glance_api_ssl_compression = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] glance_ca_certificates_file = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] glance_catalog_info = image:glance:publicURL {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] glance_certfile = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] glance_keyfile = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] glance_num_retries = 3 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] glance_request_timeout = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] goodness_function = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] graceful_shutdown_timeout = 5 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] group_api_class = cinder.group.api.API {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] host = devstack {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] image_compress_on_upload = True {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] image_conversion_address_space_limit = 1 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] image_conversion_cpu_limit = 60 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] image_conversion_disable = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] image_upload_use_cinder_backend = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] image_upload_use_internal_tenant = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] image_volume_cache_enabled = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] image_volume_cache_max_count = 0 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] image_volume_cache_max_size_gb = 0 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] init_host_max_objects_retrieval = 0 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] instance_format = [instance: %(uuid)s] {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] iscsi_target_flags = {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] iscsi_write_cache = on {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] iser_helper = tgtadm {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] iser_ip_address = 192.168.122.242 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] iser_port = 3260 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] log_color = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] log_config_append = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] log_dir = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] log_file = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] log_options = True {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] log_rotate_interval = 1 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] log_rotate_interval_type = days {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] log_rotation_type = none {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] max_age = 0 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] max_logfile_count = 30 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] max_logfile_size_mb = 200 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] max_over_subscription_ratio = 20.0 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] message_reap_interval = 86400 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] message_ttl = 2592000 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] migration_create_volume_timeout_secs = 300 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] monkey_patch = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] monkey_patch_modules = [] {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] my_ip = 192.168.122.242 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] no_snapshot_gb_quota = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] num_iser_scan_tries = 3 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] num_shell_tries = 3 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] num_volume_device_scan_tries = 3 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] nvmeof_conn_info_version = 1 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] nvmet_ns_id = 10 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] nvmet_port_id = 1 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] osapi_max_limit = 1000 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] osapi_volume_ext_list = [] {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] osapi_volume_listen_port = 8776 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] osapi_volume_use_ssl = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] osapi_volume_workers = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] per_volume_size_limit = -1 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] periodic_fuzzy_delay = 60 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] periodic_interval = 60 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] public_endpoint = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] publish_errors = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] quota_backup_gigabytes = 1000 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] quota_backups = 10 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] quota_gigabytes = 1000 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] quota_groups = 10 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] quota_snapshots = 10 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] quota_volumes = 10 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] rate_limit_burst = 0 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] rate_limit_except_level = CRITICAL {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] rate_limit_interval = 0 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] reinit_driver_count = 3 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] replication_device = **** {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] report_discard_supported = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] report_interval = 120 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] reservation_clean_interval = 86400 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] reservation_expire = 86400 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] reserved_image_namespaces = [] {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] reserved_percentage = 0 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] rpc_response_timeout = 120 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] run_external_periodic_tasks = True {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] scst_target_driver = iscsi {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] scst_target_iqn_name = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] service_down_time = 720 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] shell_completion = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] snapshot_name_template = snapshot-%s {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] split_loggers = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] state_path = /opt/stack/data/cinder {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] storage_availability_zone = nova {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] storage_protocol = iSCSI {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] syslog_log_facility = LOG_USER {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] target_helper = lioadm {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] target_ip_address = 192.168.122.242 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] target_port = 3260 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] target_protocol = iscsi {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] target_secondary_ip_addresses = [] {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] trace_flags = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] transport_url = **** {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] until_refresh = 0 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] use_chap_auth = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] use_default_quota_class = True {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] use_journal = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] use_json = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] use_multipath_for_image_xfer = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] use_stderr = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] use_syslog = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] verify_glance_signatures = enabled {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] volume_api_class = cinder.volume.api.API {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] volume_backend_name = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] volume_clear = zero {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] volume_clear_ionice = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] volume_clear_size = 0 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] volume_copy_bps_limit = 0 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] volume_dd_blocksize = 1M {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] volume_name_template = volume-%s {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] volume_service_inithost_offload = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] volume_usage_audit_period = month {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] zoning_mode = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_concurrency.disable_process_locking = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-94ed91b5-5f4c-43dd-82a6-2eadec24dae7 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-94ed91b5-5f4c-43dd-82a6-2eadec24dae7 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87007) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] keystone_authtoken.auth_section = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] keystone_authtoken.auth_type = password {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] keystone_authtoken.auth_version = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] keystone_authtoken.cache = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] keystone_authtoken.certfile = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] keystone_authtoken.include_service_catalog = True {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] keystone_authtoken.insecure = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] keystone_authtoken.interface = public {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] keystone_authtoken.keyfile = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] keystone_authtoken.memcache_password = **** {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] keystone_authtoken.memcache_username = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] keystone_authtoken.region_name = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] keystone_authtoken.service_type = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.242/identity {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] cache.backend = dogpile.cache.null {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] cache.backend_argument = **** {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] cache.backend_expiration_time = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] cache.config_prefix = cache.oslo {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] cache.debug_cache_backend = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] cache.enable_retry_client = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] cache.enable_socket_keepalive = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] cache.enabled = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] cache.expiration_time = 600 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] cache.hashclient_retry_attempts = 2 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] cache.memcache_dead_retry = 300 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] cache.memcache_pool_maxsize = 10 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] cache.memcache_sasl_enabled = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] cache.password = **** {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] cache.proxies = [] {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] cache.redis_db = 0 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] cache.redis_server = localhost:6379 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] cache.retry_attempts = 2 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] cache.retry_delay = 0.0 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] cache.socket_keepalive_count = 1 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] cache.socket_keepalive_idle = 1 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] cache.socket_keepalive_interval = 1 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] cache.socket_timeout = 1.0 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] cache.tls_allowed_ciphers = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] cache.tls_cafile = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] cache.tls_certfile = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] cache.tls_enabled = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] cache.tls_keyfile = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] cache.username = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] coordination.backend_url = **** {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] database.asyncio_connection = **** {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] database.asyncio_slave_connection = **** {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] database.backend = sqlalchemy {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] database.connection = **** {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] database.connection_debug = 0 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] database.connection_parameters = {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] database.connection_recycle_time = 3600 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] database.connection_trace = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] database.db_inc_retry_interval = True {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] database.db_max_retries = 20 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] database.db_max_retry_interval = 10 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] database.db_retry_interval = 1 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] database.max_overflow = 50 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] database.max_pool_size = 5 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] database.max_retries = 10 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] database.mysql_wsrep_sync_wait = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] database.pool_timeout = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] database.retry_interval = 10 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] database.slave_connection = **** {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] database.sqlite_synchronous = True {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] database.synchronous_reader = True {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] database.use_db_reconnect = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_tracing.insecure = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] profiler.connection_string = messaging:// {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] profiler.enabled = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] profiler.es_doc_type = notification {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] profiler.es_scroll_size = 10000 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] profiler.es_scroll_time = 2m {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] profiler.filter_error_trace = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] profiler.hmac_keys = **** {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] profiler.sentinel_service_name = mymaster {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] profiler.socket_timeout = 0.1 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] profiler.trace_requests = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] profiler.trace_sqlalchemy = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] profiler_jaeger.process_tags = {} {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] profiler_jaeger.service_name_prefix = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] profiler_otlp.service_name_prefix = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_policy.enforce_new_defaults = True {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_policy.policy_default_rule = default {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_policy.policy_file = policy.yaml {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] privsep_osbrick.group = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] privsep_osbrick.helper_command = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] privsep_osbrick.user = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] cinder_sys_admin.group = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] cinder_sys_admin.helper_command = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] cinder_sys_admin.user = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] service_user.auth_section = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] service_user.auth_type = password {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] service_user.cafile = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] service_user.certfile = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] service_user.collect_timing = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] service_user.insecure = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] service_user.keyfile = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] service_user.send_service_user_token = True {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] service_user.split_loggers = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] service_user.timeout = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] service_user.tls_ciphers = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] service_user.tls_min_version = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] glance.auth_section = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] glance.auth_type = password {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] glance.certfile = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] glance.collect_timing = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] glance.insecure = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] glance.keyfile = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] glance.region_name = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] glance.split_loggers = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] glance.timeout = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] glance.tls_ciphers = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] glance.tls_min_version = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.backend_availability_zone = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.chap_password = **** {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.chap_username = {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.disk_geometry = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.driver_client_cert = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.driver_client_cert_key = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.driver_data_namespace = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.driver_use_ssl = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.extra_capabilities = {} {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.filter_function = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.goodness_function = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.iscsi_target_flags = {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.iscsi_write_cache = on {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.iser_helper = tgtadm {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.iser_ip_address = 192.168.122.242 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.iser_port = 3260 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-94ed91b5-5f4c-43dd-82a6-2eadec24dae7 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87007) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 03 14:17:11 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.quobyte [None req-94ed91b5-5f4c-43dd-82a6-2eadec24dae7 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.nas_host = {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.quobyte [None req-94ed91b5-5f4c-43dd-82a6-2eadec24dae7 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.nas_login = admin {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.nas_mount_options = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.nas_password = **** {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.nas_private_key = {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-94ed91b5-5f4c-43dd-82a6-2eadec24dae7 None None] Running cmd (subprocess): mount.quobyte {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.nas_share_path = {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.num_shell_tries = 3 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.quobyte_volume_url = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.replication_device = **** {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.report_discard_supported = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.reserved_percentage = 0 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.target_helper = tgtadm {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.target_ip_address = 192.168.122.242 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.target_port = 3260 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.target_protocol = iscsi {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.trace_flags = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.unique_fqdn_network = True {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.use_chap_auth = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.volume_backend_name = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.volume_clear = zero {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.volume_clear_ionice = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.volume_clear_size = 0 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_reports.file_event_handler = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_reports.log_dir = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.backend_availability_zone = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.backend_host = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.chap_password = **** {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.chap_username = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.chiscsi_conf = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.disk_geometry = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.driver_client_cert = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.driver_data_namespace = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.driver_use_ssl = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.extra_capabilities = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.filter_function = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.goodness_function = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.iser_helper = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.iser_ip_address = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.iser_port = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.iser_target_prefix = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.nas_host = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.nas_login = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.nas_mount_options = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.nas_password = **** {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.nas_private_key = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.nas_share_path = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.nas_ssh_port = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.num_shell_tries = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.nvmet_port_id = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.replication_device = **** {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.report_discard_supported = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.reserved_percentage = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.scst_target_driver = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.storage_protocol = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.target_helper = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.target_ip_address = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.target_port = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.target_prefix = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.target_protocol = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.trace_flags = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.use_chap_auth = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.volume_clear = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.volume_clear_size = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] QuobyteHD.volumes_dir = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack quobyte-client[87014]: Reading configuration file: /etc/quobyte/client.cfg Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack quobyte-client[87014]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-94ed91b5-5f4c-43dd-82a6-2eadec24dae7 None None] CMD "mount.quobyte" returned: 1 in 0.060s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-94ed91b5-5f4c-43dd-82a6-2eadec24dae7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-94ed91b5-5f4c-43dd-82a6-2eadec24dae7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-94ed91b5-5f4c-43dd-82a6-2eadec24dae7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_rabbit.ssl = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_notifications.driver = [] {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_notifications.retry = -1 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-94ed91b5-5f4c-43dd-82a6-2eadec24dae7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-94ed91b5-5f4c-43dd-82a6-2eadec24dae7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] key_manager.fixed_key = **** {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] barbican.barbican_api_version = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] barbican.barbican_endpoint = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] barbican.barbican_endpoint_type = public {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] barbican.barbican_region_name = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] barbican.cafile = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-94ed91b5-5f4c-43dd-82a6-2eadec24dae7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] barbican.certfile = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] barbican.collect_timing = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] barbican.insecure = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] barbican.keyfile = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] barbican.number_of_retries = 60 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] barbican.retry_delay = 1 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] barbican.send_service_user_token = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] barbican.split_loggers = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] barbican.timeout = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] barbican.tls_ciphers = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] barbican.tls_min_version = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] barbican.verify_ssl = True {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] barbican.verify_ssl_path = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] barbican_service_user.auth_section = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] barbican_service_user.auth_type = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] barbican_service_user.cafile = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] barbican_service_user.certfile = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] barbican_service_user.collect_timing = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] barbican_service_user.insecure = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] barbican_service_user.keyfile = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] barbican_service_user.split_loggers = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] barbican_service_user.timeout = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] barbican_service_user.tls_ciphers = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] barbican_service_user.tls_min_version = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] vault.approle_role_id = **** {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] vault.approle_secret_id = **** {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] vault.auth_method = approle {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] vault.auth_path = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] vault.kv_mountpoint = secret {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] vault.kv_path = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] vault.kv_version = 2 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] vault.namespace = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] vault.root_token_id = **** {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] vault.ssl_ca_crt_file = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] vault.timeout = 60.0 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] vault.token_file = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] vault.token_role = None {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] vault.use_ssl = False {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 14:17:11 devstack cinder-volume[86703]: DEBUG oslo_service.backend._eventlet.service [None req-a4644a8f-b6b7-4220-b3c7-21227b3f0fb1 None None] ******************************************************************************** {{(pid=86703) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 03 14:17:11 devstack sudo[87015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:17:11 devstack sudo[87015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:17:11 devstack sudo[87015]: pam_unix(sudo:session): session closed for user root Sep 03 14:17:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-94ed91b5-5f4c-43dd-82a6-2eadec24dae7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.242s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:17:11 devstack cinder-volume[87007]: INFO cinder.volume.driver [None req-94ed91b5-5f4c-43dd-82a6-2eadec24dae7 None None] Driver hasn't implemented _init_vendor_properties() Sep 03 14:17:11 devstack cinder-volume[87007]: DEBUG cinder.volume.driver [None req-94ed91b5-5f4c-43dd-82a6-2eadec24dae7 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8406867980957, 'free_capacity_gb': 1773.8406867980957, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87007) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 03 14:17:11 devstack cinder-volume[87007]: DEBUG oslo_db.sqlalchemy.engines [None req-94ed91b5-5f4c-43dd-82a6-2eadec24dae7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87007) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 14:17:11 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writer thread running {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 03 14:17:11 devstack cinder-volume[87007]: DEBUG cinder.db.api [None req-94ed91b5-5f4c-43dd-82a6-2eadec24dae7 None None] Building query based on filter {{(pid=87007) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 03 14:17:11 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-94ed91b5-5f4c-43dd-82a6-2eadec24dae7 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87007) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 03 14:17:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-94ed91b5-5f4c-43dd-82a6-2eadec24dae7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:17:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-94ed91b5-5f4c-43dd-82a6-2eadec24dae7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:17:11 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-94ed91b5-5f4c-43dd-82a6-2eadec24dae7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:17:11 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-94ed91b5-5f4c-43dd-82a6-2eadec24dae7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:17:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-94ed91b5-5f4c-43dd-82a6-2eadec24dae7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:17:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-94ed91b5-5f4c-43dd-82a6-2eadec24dae7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:17:11 devstack cinder-volume[87007]: INFO cinder.keymgr.migration [None req-fb557c7b-7779-426d-be3b-65ec33ab2bd0 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 03 14:17:11 devstack sudo[87026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:17:11 devstack sudo[87026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:17:12 devstack sudo[87026]: pam_unix(sudo:session): session closed for user root Sep 03 14:17:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-94ed91b5-5f4c-43dd-82a6-2eadec24dae7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.241s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:17:12 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-94ed91b5-5f4c-43dd-82a6-2eadec24dae7 None None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:17:12 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-94ed91b5-5f4c-43dd-82a6-2eadec24dae7 None None] Driver initialization completed successfully. Sep 03 14:17:12 devstack cinder-volume[87007]: INFO cinder.manager [None req-94ed91b5-5f4c-43dd-82a6-2eadec24dae7 None None] Initiating service 3 cleanup Sep 03 14:17:12 devstack cinder-volume[87007]: INFO cinder.manager [None req-94ed91b5-5f4c-43dd-82a6-2eadec24dae7 None None] Service 3 cleanup completed. Sep 03 14:17:12 devstack cinder-volume[87007]: DEBUG cinder.service [None req-94ed91b5-5f4c-43dd-82a6-2eadec24dae7 None None] Creating RPC server for service cinder-volume {{(pid=87007) start /opt/stack/cinder/cinder/service.py:231}} Sep 03 14:17:12 devstack cinder-volume[87007]: DEBUG cinder.service [None req-94ed91b5-5f4c-43dd-82a6-2eadec24dae7 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87007) start /opt/stack/cinder/cinder/service.py:237}} Sep 03 14:17:12 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-94ed91b5-5f4c-43dd-82a6-2eadec24dae7 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 03 14:17:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-94ed91b5-5f4c-43dd-82a6-2eadec24dae7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:17:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-94ed91b5-5f4c-43dd-82a6-2eadec24dae7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:17:12 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-94ed91b5-5f4c-43dd-82a6-2eadec24dae7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:17:12 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-94ed91b5-5f4c-43dd-82a6-2eadec24dae7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:17:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-94ed91b5-5f4c-43dd-82a6-2eadec24dae7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:17:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-94ed91b5-5f4c-43dd-82a6-2eadec24dae7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:17:12 devstack sudo[87039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:17:12 devstack sudo[87039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:17:12 devstack sudo[87039]: pam_unix(sudo:session): session closed for user root Sep 03 14:17:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-94ed91b5-5f4c-43dd-82a6-2eadec24dae7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.246s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:17:12 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-94ed91b5-5f4c-43dd-82a6-2eadec24dae7 None None] Driver post RPC initialization completed successfully. Sep 03 14:17:21 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:17:22 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:SELECT=3 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:17:22 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:17:51 devstack cinder-volume[87007]: DEBUG oslo_service.periodic_task [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running periodic task VolumeManager._thread_info {{(pid=87007) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 14:17:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] thread count: 6 {{(pid=87007) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 14:17:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] thread info: [<_MainThread(MainThread, started 123689171054720)>, , , , , ] {{(pid=87007) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 14:18:25 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e4d11e5-6dd0-454f-a9e1-5ac1c6f5cbec tempest-DeleteServersTestJSON-1435106593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:18:25 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6e4d11e5-6dd0-454f-a9e1-5ac1c6f5cbec tempest-DeleteServersTestJSON-1435106593 None] Flow 'volume_create_manager' (ee0cc7ab-9580-4b82-b233-0ff275c3ad17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:18:25 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6e4d11e5-6dd0-454f-a9e1-5ac1c6f5cbec tempest-DeleteServersTestJSON-1435106593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9936894e-da5d-43b3-8e47-64f87a9c802d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:18:26 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6e4d11e5-6dd0-454f-a9e1-5ac1c6f5cbec tempest-DeleteServersTestJSON-1435106593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9936894e-da5d-43b3-8e47-64f87a9c802d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-850492051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d018c61-de84-4199-9d7f-e1dee9b7f7ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ceafd3f53a4194b1be71815b9a06df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:18:26Z,use_quota=True,user_id='f7a3f4de72af42a6baaeb9202d8bddc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:18:26 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6e4d11e5-6dd0-454f-a9e1-5ac1c6f5cbec tempest-DeleteServersTestJSON-1435106593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f0baa9-1193-48ef-bd76-ef27ed944fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:18:26 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6e4d11e5-6dd0-454f-a9e1-5ac1c6f5cbec tempest-DeleteServersTestJSON-1435106593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f0baa9-1193-48ef-bd76-ef27ed944fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:18:26 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6e4d11e5-6dd0-454f-a9e1-5ac1c6f5cbec tempest-DeleteServersTestJSON-1435106593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f40a5a8d-9628-49eb-bb7a-bf93433872e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:18:26 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6e4d11e5-6dd0-454f-a9e1-5ac1c6f5cbec tempest-DeleteServersTestJSON-1435106593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f40a5a8d-9628-49eb-bb7a-bf93433872e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d018c61-de84-4199-9d7f-e1dee9b7f7ff', 'volume_name': 'volume-7d018c61-de84-4199-9d7f-e1dee9b7f7ff', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:18:26 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6e4d11e5-6dd0-454f-a9e1-5ac1c6f5cbec tempest-DeleteServersTestJSON-1435106593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c28a116-76b2-4526-94bf-f8f5ab493b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:18:26 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6e4d11e5-6dd0-454f-a9e1-5ac1c6f5cbec tempest-DeleteServersTestJSON-1435106593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c28a116-76b2-4526-94bf-f8f5ab493b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:18:26 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6e4d11e5-6dd0-454f-a9e1-5ac1c6f5cbec tempest-DeleteServersTestJSON-1435106593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1172fec6-43f6-426d-ad6b-deff875f378d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:18:26 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-6e4d11e5-6dd0-454f-a9e1-5ac1c6f5cbec tempest-DeleteServersTestJSON-1435106593 None] Volume 7d018c61-de84-4199-9d7f-e1dee9b7f7ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d018c61-de84-4199-9d7f-e1dee9b7f7ff', 'volume_size': 1} Sep 03 14:18:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6e4d11e5-6dd0-454f-a9e1-5ac1c6f5cbec tempest-DeleteServersTestJSON-1435106593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:18:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6e4d11e5-6dd0-454f-a9e1-5ac1c6f5cbec tempest-DeleteServersTestJSON-1435106593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:18:26 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-6e4d11e5-6dd0-454f-a9e1-5ac1c6f5cbec tempest-DeleteServersTestJSON-1435106593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-850492051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d018c61-de84-4199-9d7f-e1dee9b7f7ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ceafd3f53a4194b1be71815b9a06df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:18:26Z,use_quota=True,user_id='f7a3f4de72af42a6baaeb9202d8bddc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:18:26 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-6e4d11e5-6dd0-454f-a9e1-5ac1c6f5cbec tempest-DeleteServersTestJSON-1435106593 None] Creating volume 7d018c61-de84-4199-9d7f-e1dee9b7f7ff {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:18:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6e4d11e5-6dd0-454f-a9e1-5ac1c6f5cbec tempest-DeleteServersTestJSON-1435106593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:18:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6e4d11e5-6dd0-454f-a9e1-5ac1c6f5cbec tempest-DeleteServersTestJSON-1435106593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:18:26 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-6e4d11e5-6dd0-454f-a9e1-5ac1c6f5cbec tempest-DeleteServersTestJSON-1435106593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:18:26 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-6e4d11e5-6dd0-454f-a9e1-5ac1c6f5cbec tempest-DeleteServersTestJSON-1435106593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:18:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6e4d11e5-6dd0-454f-a9e1-5ac1c6f5cbec tempest-DeleteServersTestJSON-1435106593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:18:26 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-6e4d11e5-6dd0-454f-a9e1-5ac1c6f5cbec tempest-DeleteServersTestJSON-1435106593 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:18:26 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-6e4d11e5-6dd0-454f-a9e1-5ac1c6f5cbec tempest-DeleteServersTestJSON-1435106593 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:18:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6e4d11e5-6dd0-454f-a9e1-5ac1c6f5cbec tempest-DeleteServersTestJSON-1435106593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7d018c61-de84-4199-9d7f-e1dee9b7f7ff 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:18:26 devstack sudo[87723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7d018c61-de84-4199-9d7f-e1dee9b7f7ff 1073741824 Sep 03 14:18:26 devstack sudo[87723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:18:27 devstack sudo[87723]: pam_unix(sudo:session): session closed for user root Sep 03 14:18:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6e4d11e5-6dd0-454f-a9e1-5ac1c6f5cbec tempest-DeleteServersTestJSON-1435106593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7d018c61-de84-4199-9d7f-e1dee9b7f7ff 1073741824" returned: 0 in 0.873s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:18:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6e4d11e5-6dd0-454f-a9e1-5ac1c6f5cbec tempest-DeleteServersTestJSON-1435106593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7d018c61-de84-4199-9d7f-e1dee9b7f7ff {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:18:27 devstack sudo[88044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7d018c61-de84-4199-9d7f-e1dee9b7f7ff Sep 03 14:18:27 devstack sudo[88044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:18:27 devstack sudo[88044]: pam_unix(sudo:session): session closed for user root Sep 03 14:18:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6e4d11e5-6dd0-454f-a9e1-5ac1c6f5cbec tempest-DeleteServersTestJSON-1435106593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7d018c61-de84-4199-9d7f-e1dee9b7f7ff" returned: 0 in 0.595s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:18:27 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-6e4d11e5-6dd0-454f-a9e1-5ac1c6f5cbec tempest-DeleteServersTestJSON-1435106593 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:18:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6e4d11e5-6dd0-454f-a9e1-5ac1c6f5cbec tempest-DeleteServersTestJSON-1435106593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.616s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:18:27 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6e4d11e5-6dd0-454f-a9e1-5ac1c6f5cbec tempest-DeleteServersTestJSON-1435106593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1172fec6-43f6-426d-ad6b-deff875f378d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d018c61-de84-4199-9d7f-e1dee9b7f7ff', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:18:27 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6e4d11e5-6dd0-454f-a9e1-5ac1c6f5cbec tempest-DeleteServersTestJSON-1435106593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3455069f-b9e2-4cfa-a523-4f54a94e660a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:18:27 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-6e4d11e5-6dd0-454f-a9e1-5ac1c6f5cbec tempest-DeleteServersTestJSON-1435106593 None] Volume volume-7d018c61-de84-4199-9d7f-e1dee9b7f7ff (7d018c61-de84-4199-9d7f-e1dee9b7f7ff): created successfully Sep 03 14:18:27 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6e4d11e5-6dd0-454f-a9e1-5ac1c6f5cbec tempest-DeleteServersTestJSON-1435106593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3455069f-b9e2-4cfa-a523-4f54a94e660a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:18:27 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6e4d11e5-6dd0-454f-a9e1-5ac1c6f5cbec tempest-DeleteServersTestJSON-1435106593 None] Flow 'volume_create_manager' (ee0cc7ab-9580-4b82-b233-0ff275c3ad17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:18:27 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-6e4d11e5-6dd0-454f-a9e1-5ac1c6f5cbec tempest-DeleteServersTestJSON-1435106593 None] Created volume successfully. Sep 03 14:18:35 devstack cinder-volume[87007]: WARNING py.warnings [req-38a3fee6-6719-48cd-ae3b-6cbda7224736 req-33e717d9-7624-4a94-b09d-5cf548c50e0b tempest-DeleteServersTestJSON-1435106593 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Sep 03 14:18:35 devstack cinder-volume[87007]: .first() Sep 03 14:18:35 devstack cinder-volume[87007]: Sep 03 14:18:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-38a3fee6-6719-48cd-ae3b-6cbda7224736 req-33e717d9-7624-4a94-b09d-5cf548c50e0b tempest-DeleteServersTestJSON-1435106593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:18:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-38a3fee6-6719-48cd-ae3b-6cbda7224736 req-33e717d9-7624-4a94-b09d-5cf548c50e0b tempest-DeleteServersTestJSON-1435106593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:18:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-38a3fee6-6719-48cd-ae3b-6cbda7224736 req-33e717d9-7624-4a94-b09d-5cf548c50e0b tempest-DeleteServersTestJSON-1435106593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:18:35 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-38a3fee6-6719-48cd-ae3b-6cbda7224736 req-33e717d9-7624-4a94-b09d-5cf548c50e0b tempest-DeleteServersTestJSON-1435106593 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713', 'name': 'volume-7d018c61-de84-4199-9d7f-e1dee9b7f7ff', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a40e3ee9-3b4a-48d3-8b0a-f8aa8de17d6a', 'enforce_multipath': True} {{(pid=87007) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 14:18:36 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-38a3fee6-6719-48cd-ae3b-6cbda7224736 req-33e717d9-7624-4a94-b09d-5cf548c50e0b tempest-DeleteServersTestJSON-1435106593 None] attachment_update completed successfully. Sep 03 14:18:37 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-b99515dd-d524-4630-8821-ba4a8a79850c tempest-VolumesAdminNegativeTest-139432557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:18:37 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b99515dd-d524-4630-8821-ba4a8a79850c tempest-VolumesAdminNegativeTest-139432557 None] Flow 'volume_create_manager' (4c35226b-e399-4a76-9c69-976da1873367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:18:37 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b99515dd-d524-4630-8821-ba4a8a79850c tempest-VolumesAdminNegativeTest-139432557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b03127b3-854c-4e3a-8029-cdf61656b590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:18:37 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b99515dd-d524-4630-8821-ba4a8a79850c tempest-VolumesAdminNegativeTest-139432557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b03127b3-854c-4e3a-8029-cdf61656b590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-825338727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d00bb555-a43f-4e76-a7aa-df77183aaa80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f813b8c8b4dc4c2f97c914e6ec77d17c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:18:37Z,use_quota=True,user_id='0276793fd2254f12b114ab29c52f0dbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:18:37 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b99515dd-d524-4630-8821-ba4a8a79850c tempest-VolumesAdminNegativeTest-139432557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a867642f-4454-433a-8769-0dfe7c2fc895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:18:37 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b99515dd-d524-4630-8821-ba4a8a79850c tempest-VolumesAdminNegativeTest-139432557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a867642f-4454-433a-8769-0dfe7c2fc895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:18:37 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b99515dd-d524-4630-8821-ba4a8a79850c tempest-VolumesAdminNegativeTest-139432557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7e4635c-25c0-4d75-82b2-cbcc1a195e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:18:37 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b99515dd-d524-4630-8821-ba4a8a79850c tempest-VolumesAdminNegativeTest-139432557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7e4635c-25c0-4d75-82b2-cbcc1a195e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd00bb555-a43f-4e76-a7aa-df77183aaa80', 'volume_name': 'volume-d00bb555-a43f-4e76-a7aa-df77183aaa80', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:18:37 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b99515dd-d524-4630-8821-ba4a8a79850c tempest-VolumesAdminNegativeTest-139432557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e6b39f2-d8c4-49c4-a10e-7a7e96b1208c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:18:37 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b99515dd-d524-4630-8821-ba4a8a79850c tempest-VolumesAdminNegativeTest-139432557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e6b39f2-d8c4-49c4-a10e-7a7e96b1208c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:18:37 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b99515dd-d524-4630-8821-ba4a8a79850c tempest-VolumesAdminNegativeTest-139432557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b9ec2ce-b087-4578-b93b-162a316f2314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:18:37 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-b99515dd-d524-4630-8821-ba4a8a79850c tempest-VolumesAdminNegativeTest-139432557 None] Volume d00bb555-a43f-4e76-a7aa-df77183aaa80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d00bb555-a43f-4e76-a7aa-df77183aaa80', 'volume_size': 1} Sep 03 14:18:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b99515dd-d524-4630-8821-ba4a8a79850c tempest-VolumesAdminNegativeTest-139432557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:18:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b99515dd-d524-4630-8821-ba4a8a79850c tempest-VolumesAdminNegativeTest-139432557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:18:37 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b99515dd-d524-4630-8821-ba4a8a79850c tempest-VolumesAdminNegativeTest-139432557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-825338727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d00bb555-a43f-4e76-a7aa-df77183aaa80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f813b8c8b4dc4c2f97c914e6ec77d17c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:18:37Z,use_quota=True,user_id='0276793fd2254f12b114ab29c52f0dbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:18:37 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-b99515dd-d524-4630-8821-ba4a8a79850c tempest-VolumesAdminNegativeTest-139432557 None] Creating volume d00bb555-a43f-4e76-a7aa-df77183aaa80 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:18:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b99515dd-d524-4630-8821-ba4a8a79850c tempest-VolumesAdminNegativeTest-139432557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:18:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b99515dd-d524-4630-8821-ba4a8a79850c tempest-VolumesAdminNegativeTest-139432557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:18:37 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b99515dd-d524-4630-8821-ba4a8a79850c tempest-VolumesAdminNegativeTest-139432557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:18:37 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b99515dd-d524-4630-8821-ba4a8a79850c tempest-VolumesAdminNegativeTest-139432557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:18:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b99515dd-d524-4630-8821-ba4a8a79850c tempest-VolumesAdminNegativeTest-139432557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:18:37 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b99515dd-d524-4630-8821-ba4a8a79850c tempest-VolumesAdminNegativeTest-139432557 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:18:37 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-b99515dd-d524-4630-8821-ba4a8a79850c tempest-VolumesAdminNegativeTest-139432557 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:18:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b99515dd-d524-4630-8821-ba4a8a79850c tempest-VolumesAdminNegativeTest-139432557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d00bb555-a43f-4e76-a7aa-df77183aaa80 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:18:37 devstack sudo[88561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d00bb555-a43f-4e76-a7aa-df77183aaa80 1073741824 Sep 03 14:18:37 devstack sudo[88561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:18:38 devstack sudo[88561]: pam_unix(sudo:session): session closed for user root Sep 03 14:18:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b99515dd-d524-4630-8821-ba4a8a79850c tempest-VolumesAdminNegativeTest-139432557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d00bb555-a43f-4e76-a7aa-df77183aaa80 1073741824" returned: 0 in 1.101s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:18:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b99515dd-d524-4630-8821-ba4a8a79850c tempest-VolumesAdminNegativeTest-139432557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d00bb555-a43f-4e76-a7aa-df77183aaa80 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:18:38 devstack sudo[88595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d00bb555-a43f-4e76-a7aa-df77183aaa80 Sep 03 14:18:38 devstack sudo[88595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:18:39 devstack sudo[88595]: pam_unix(sudo:session): session closed for user root Sep 03 14:18:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b99515dd-d524-4630-8821-ba4a8a79850c tempest-VolumesAdminNegativeTest-139432557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d00bb555-a43f-4e76-a7aa-df77183aaa80" returned: 0 in 0.343s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:18:39 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b99515dd-d524-4630-8821-ba4a8a79850c tempest-VolumesAdminNegativeTest-139432557 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:18:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b99515dd-d524-4630-8821-ba4a8a79850c tempest-VolumesAdminNegativeTest-139432557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:18:39 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b99515dd-d524-4630-8821-ba4a8a79850c tempest-VolumesAdminNegativeTest-139432557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b9ec2ce-b087-4578-b93b-162a316f2314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d00bb555-a43f-4e76-a7aa-df77183aaa80', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:18:39 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b99515dd-d524-4630-8821-ba4a8a79850c tempest-VolumesAdminNegativeTest-139432557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a57ac8ea-f32a-4cf0-8cb2-611ded3fc085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:18:39 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-b99515dd-d524-4630-8821-ba4a8a79850c tempest-VolumesAdminNegativeTest-139432557 None] Volume volume-d00bb555-a43f-4e76-a7aa-df77183aaa80 (d00bb555-a43f-4e76-a7aa-df77183aaa80): created successfully Sep 03 14:18:39 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b99515dd-d524-4630-8821-ba4a8a79850c tempest-VolumesAdminNegativeTest-139432557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a57ac8ea-f32a-4cf0-8cb2-611ded3fc085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:18:39 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b99515dd-d524-4630-8821-ba4a8a79850c tempest-VolumesAdminNegativeTest-139432557 None] Flow 'volume_create_manager' (4c35226b-e399-4a76-9c69-976da1873367) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:18:39 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-b99515dd-d524-4630-8821-ba4a8a79850c tempest-VolumesAdminNegativeTest-139432557 None] Created volume successfully. Sep 03 14:18:40 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c9db6f0e-1532-4fb3-9ca1-e5c98795c9fa tempest-VolumesAdminNegativeTest-139432557 None] Acquiring lock "cinder-d00bb555-a43f-4e76-a7aa-df77183aaa80-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:18:40 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c9db6f0e-1532-4fb3-9ca1-e5c98795c9fa tempest-VolumesAdminNegativeTest-139432557 None] Lock "cinder-d00bb555-a43f-4e76-a7aa-df77183aaa80-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:18:40 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c9db6f0e-1532-4fb3-9ca1-e5c98795c9fa tempest-VolumesAdminNegativeTest-139432557 None] Acquiring lock "cinder-quobyte-d00bb555-a43f-4e76-a7aa-df77183aaa80" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:18:40 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c9db6f0e-1532-4fb3-9ca1-e5c98795c9fa tempest-VolumesAdminNegativeTest-139432557 None] Lock "cinder-quobyte-d00bb555-a43f-4e76-a7aa-df77183aaa80" acquired by "delete_volume" :: waited 0.019s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:18:40 devstack cinder-volume[87007]: INFO oslo.privsep.daemon [None req-c9db6f0e-1532-4fb3-9ca1-e5c98795c9fa tempest-VolumesAdminNegativeTest-139432557 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpkzpuw23w/privsep.sock'] Sep 03 14:18:40 devstack sudo[88647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpkzpuw23w/privsep.sock Sep 03 14:18:40 devstack sudo[88647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:18:42 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-00584ecb-b8e2-45ea-a1df-9f2310f44853 req-2a80ccaf-69b6-4e3c-b555-27fa2b6dafc5 tempest-DeleteServersTestJSON-1435106593 None] Terminate volume connection completed successfully. Sep 03 14:18:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-00584ecb-b8e2-45ea-a1df-9f2310f44853 req-2a80ccaf-69b6-4e3c-b555-27fa2b6dafc5 tempest-DeleteServersTestJSON-1435106593 None] Deleting attachment a40e3ee9-3b4a-48d3-8b0a-f8aa8de17d6a. {{(pid=87007) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 14:18:42 devstack cinder-volume[87007]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 03 14:18:42 devstack cinder-volume[87007]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 03 14:18:42 devstack cinder-volume[87007]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 03 14:18:42 devstack cinder-volume[87007]: WARNING oslo.privsep.daemon [-] privsep log: Sep 03 14:18:42 devstack cinder-volume[87007]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 03 14:18:42 devstack cinder-volume[87007]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 03 14:18:42 devstack cinder-volume[87007]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 03 14:18:42 devstack cinder-volume[87007]: WARNING oslo.privsep.daemon [-] privsep log: Sep 03 14:18:42 devstack cinder-volume[87007]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 03 14:18:42 devstack sudo[88647]: pam_unix(sudo:session): session closed for user root Sep 03 14:18:42 devstack cinder-volume[87007]: INFO oslo.privsep.daemon [None req-c9db6f0e-1532-4fb3-9ca1-e5c98795c9fa tempest-VolumesAdminNegativeTest-139432557 None] Spawned new privsep daemon via rootwrap Sep 03 14:18:42 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [None req-c9db6f0e-1532-4fb3-9ca1-e5c98795c9fa tempest-VolumesAdminNegativeTest-139432557 None] Accepted privsep connection to /tmp/tmpkzpuw23w/privsep.sock {{(pid=87007) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 03 14:18:42 devstack cinder-volume[87007]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 03 14:18:42 devstack cinder-volume[87007]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 03 14:18:42 devstack cinder-volume[87007]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 03 14:18:42 devstack cinder-volume[87007]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88654 Sep 03 14:18:42 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7b7119-6736-4f90-b9a8-74ad1c39340c]: (2,) {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:18:42 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e20d5d7-d214-4449-b783-558159883d99]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:18:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c9db6f0e-1532-4fb3-9ca1-e5c98795c9fa tempest-VolumesAdminNegativeTest-139432557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d00bb555-a43f-4e76-a7aa-df77183aaa80 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:18:42 devstack sudo[88656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d00bb555-a43f-4e76-a7aa-df77183aaa80 Sep 03 14:18:42 devstack sudo[88656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:18:43 devstack sudo[88656]: pam_unix(sudo:session): session closed for user root Sep 03 14:18:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c9db6f0e-1532-4fb3-9ca1-e5c98795c9fa tempest-VolumesAdminNegativeTest-139432557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d00bb555-a43f-4e76-a7aa-df77183aaa80" returned: 0 in 0.506s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:18:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c9db6f0e-1532-4fb3-9ca1-e5c98795c9fa tempest-VolumesAdminNegativeTest-139432557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d00bb555-a43f-4e76-a7aa-df77183aaa80 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:18:43 devstack sudo[88662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d00bb555-a43f-4e76-a7aa-df77183aaa80 Sep 03 14:18:43 devstack sudo[88662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:18:43 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-0295f0be-e036-4338-9e1e-4ad041725c4d tempest-DeleteServersTestJSON-1435106593 None] Acquiring lock "cinder-7d018c61-de84-4199-9d7f-e1dee9b7f7ff-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:18:43 devstack sudo[88662]: pam_unix(sudo:session): session closed for user root Sep 03 14:18:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c9db6f0e-1532-4fb3-9ca1-e5c98795c9fa tempest-VolumesAdminNegativeTest-139432557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d00bb555-a43f-4e76-a7aa-df77183aaa80" returned: 0 in 0.346s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:18:43 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-0295f0be-e036-4338-9e1e-4ad041725c4d tempest-DeleteServersTestJSON-1435106593 None] Lock "cinder-7d018c61-de84-4199-9d7f-e1dee9b7f7ff-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:18:43 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c9db6f0e-1532-4fb3-9ca1-e5c98795c9fa tempest-VolumesAdminNegativeTest-139432557 None] Lock "cinder-quobyte-d00bb555-a43f-4e76-a7aa-df77183aaa80" released by "delete_volume" :: held 2.776s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:18:43 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-0295f0be-e036-4338-9e1e-4ad041725c4d tempest-DeleteServersTestJSON-1435106593 None] Acquiring lock "cinder-quobyte-7d018c61-de84-4199-9d7f-e1dee9b7f7ff" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:18:43 devstack cinder-volume[87007]: WARNING cinder.quota [None req-c9db6f0e-1532-4fb3-9ca1-e5c98795c9fa tempest-VolumesAdminNegativeTest-139432557 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 03 14:18:43 devstack cinder-volume[87007]: WARNING cinder.quota [None req-c9db6f0e-1532-4fb3-9ca1-e5c98795c9fa tempest-VolumesAdminNegativeTest-139432557 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 03 14:18:43 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-0295f0be-e036-4338-9e1e-4ad041725c4d tempest-DeleteServersTestJSON-1435106593 None] Lock "cinder-quobyte-7d018c61-de84-4199-9d7f-e1dee9b7f7ff" acquired by "delete_volume" :: waited 0.025s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:18:43 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee1c089-3dc8-4182-9595-da4a8912f2b5]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:18:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0295f0be-e036-4338-9e1e-4ad041725c4d tempest-DeleteServersTestJSON-1435106593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7d018c61-de84-4199-9d7f-e1dee9b7f7ff {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:18:43 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-c9db6f0e-1532-4fb3-9ca1-e5c98795c9fa tempest-VolumesAdminNegativeTest-139432557 None] Created reservations ['daa30944-c516-497d-818d-249daa2d8669', '3be21205-5271-4a9c-b990-7f0eddbd4f1f', 'f76621b5-2257-42dc-8cd7-f12b236f8966', 'ac7c73af-8d21-4efd-95d0-eeaade9f702e'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:18:43 devstack sudo[88666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7d018c61-de84-4199-9d7f-e1dee9b7f7ff Sep 03 14:18:43 devstack sudo[88666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:18:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c9db6f0e-1532-4fb3-9ca1-e5c98795c9fa tempest-VolumesAdminNegativeTest-139432557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:18:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c9db6f0e-1532-4fb3-9ca1-e5c98795c9fa tempest-VolumesAdminNegativeTest-139432557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:18:43 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-c9db6f0e-1532-4fb3-9ca1-e5c98795c9fa tempest-VolumesAdminNegativeTest-139432557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:18:43 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-c9db6f0e-1532-4fb3-9ca1-e5c98795c9fa tempest-VolumesAdminNegativeTest-139432557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:18:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c9db6f0e-1532-4fb3-9ca1-e5c98795c9fa tempest-VolumesAdminNegativeTest-139432557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:18:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c9db6f0e-1532-4fb3-9ca1-e5c98795c9fa tempest-VolumesAdminNegativeTest-139432557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:18:44 devstack sudo[88668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:18:44 devstack sudo[88668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:18:44 devstack sudo[88666]: pam_unix(sudo:session): session closed for user root Sep 03 14:18:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0295f0be-e036-4338-9e1e-4ad041725c4d tempest-DeleteServersTestJSON-1435106593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7d018c61-de84-4199-9d7f-e1dee9b7f7ff" returned: 0 in 0.489s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:18:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0295f0be-e036-4338-9e1e-4ad041725c4d tempest-DeleteServersTestJSON-1435106593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7d018c61-de84-4199-9d7f-e1dee9b7f7ff {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:18:44 devstack sudo[88668]: pam_unix(sudo:session): session closed for user root Sep 03 14:18:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c9db6f0e-1532-4fb3-9ca1-e5c98795c9fa tempest-VolumesAdminNegativeTest-139432557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.329s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:18:44 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-c9db6f0e-1532-4fb3-9ca1-e5c98795c9fa tempest-VolumesAdminNegativeTest-139432557 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:18:44 devstack sudo[88674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7d018c61-de84-4199-9d7f-e1dee9b7f7ff Sep 03 14:18:44 devstack sudo[88674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:18:44 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-c9db6f0e-1532-4fb3-9ca1-e5c98795c9fa tempest-VolumesAdminNegativeTest-139432557 None] Deleted volume successfully. Sep 03 14:18:44 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c9db6f0e-1532-4fb3-9ca1-e5c98795c9fa tempest-VolumesAdminNegativeTest-139432557 None] Lock "cinder-d00bb555-a43f-4e76-a7aa-df77183aaa80-delete_volume" released by "delete_volume" :: held 3.620s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:18:44 devstack sudo[88674]: pam_unix(sudo:session): session closed for user root Sep 03 14:18:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0295f0be-e036-4338-9e1e-4ad041725c4d tempest-DeleteServersTestJSON-1435106593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7d018c61-de84-4199-9d7f-e1dee9b7f7ff" returned: 0 in 0.457s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:18:44 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-0295f0be-e036-4338-9e1e-4ad041725c4d tempest-DeleteServersTestJSON-1435106593 None] Lock "cinder-quobyte-7d018c61-de84-4199-9d7f-e1dee9b7f7ff" released by "delete_volume" :: held 1.014s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:18:44 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-0295f0be-e036-4338-9e1e-4ad041725c4d tempest-DeleteServersTestJSON-1435106593 None] Created reservations ['e903431d-58aa-41f7-8b0d-636892625644', '0170f8f7-531b-4d37-9122-794e619fb8b7', 'a03c2fac-1350-40e9-9dd1-66bde12d061d', 'e1c137e9-c5a7-4013-8803-6eb5d25149bd'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:18:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-0295f0be-e036-4338-9e1e-4ad041725c4d tempest-DeleteServersTestJSON-1435106593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:18:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-0295f0be-e036-4338-9e1e-4ad041725c4d tempest-DeleteServersTestJSON-1435106593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:18:45 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-0295f0be-e036-4338-9e1e-4ad041725c4d tempest-DeleteServersTestJSON-1435106593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:18:45 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-0295f0be-e036-4338-9e1e-4ad041725c4d tempest-DeleteServersTestJSON-1435106593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:18:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-0295f0be-e036-4338-9e1e-4ad041725c4d tempest-DeleteServersTestJSON-1435106593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:18:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0295f0be-e036-4338-9e1e-4ad041725c4d tempest-DeleteServersTestJSON-1435106593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:18:45 devstack sudo[88693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:18:45 devstack sudo[88693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:18:45 devstack sudo[88693]: pam_unix(sudo:session): session closed for user root Sep 03 14:18:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0295f0be-e036-4338-9e1e-4ad041725c4d tempest-DeleteServersTestJSON-1435106593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.413s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:18:45 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-0295f0be-e036-4338-9e1e-4ad041725c4d tempest-DeleteServersTestJSON-1435106593 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:18:45 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-0295f0be-e036-4338-9e1e-4ad041725c4d tempest-DeleteServersTestJSON-1435106593 None] Deleted volume successfully. Sep 03 14:18:45 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-0295f0be-e036-4338-9e1e-4ad041725c4d tempest-DeleteServersTestJSON-1435106593 None] Lock "cinder-7d018c61-de84-4199-9d7f-e1dee9b7f7ff-delete_volume" released by "delete_volume" :: held 1.945s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:18:51 devstack cinder-volume[87007]: DEBUG oslo_service.periodic_task [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87007) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 14:18:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:18:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:18:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:18:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:18:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:18:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:18:51 devstack sudo[88714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:18:51 devstack sudo[88714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:18:51 devstack sudo[88714]: pam_unix(sudo:session): session closed for user root Sep 03 14:18:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.248s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:18:51 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:18:51 devstack cinder-volume[87007]: DEBUG oslo_service.periodic_task [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running periodic task VolumeManager._thread_info {{(pid=87007) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 14:18:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] thread count: 8 {{(pid=87007) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 14:18:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] thread info: [<_MainThread(MainThread, started 123689171054720)>, , , , , , , ] {{(pid=87007) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 14:18:53 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7e89fb1-4dbc-4fab-8a88-357e5d332c8d tempest-ServerActionsTestOtherA-1572917712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:18:53 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d7e89fb1-4dbc-4fab-8a88-357e5d332c8d tempest-ServerActionsTestOtherA-1572917712 None] Flow 'volume_create_manager' (6d00787e-5e5e-4d86-a8cd-2d8338927319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:18:53 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d7e89fb1-4dbc-4fab-8a88-357e5d332c8d tempest-ServerActionsTestOtherA-1572917712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec8f65ac-d2fb-4821-9585-f904276fc460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:18:53 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d7e89fb1-4dbc-4fab-8a88-357e5d332c8d tempest-ServerActionsTestOtherA-1572917712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec8f65ac-d2fb-4821-9585-f904276fc460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1440916827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de201545-b003-4b67-bd29-0b205e1c6674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41fcda5231044468a18b62045e29db81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:18:54Z,use_quota=True,user_id='9fd43a50f1fe465ea9d3c9cce7ae5821',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:18:53 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d7e89fb1-4dbc-4fab-8a88-357e5d332c8d tempest-ServerActionsTestOtherA-1572917712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fd9ada5-f2b6-4b27-907d-d07f853783f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:18:53 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d7e89fb1-4dbc-4fab-8a88-357e5d332c8d tempest-ServerActionsTestOtherA-1572917712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fd9ada5-f2b6-4b27-907d-d07f853783f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:18:53 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d7e89fb1-4dbc-4fab-8a88-357e5d332c8d tempest-ServerActionsTestOtherA-1572917712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (708676ba-8d8f-4716-bb15-306e1e3224f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:18:53 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d7e89fb1-4dbc-4fab-8a88-357e5d332c8d tempest-ServerActionsTestOtherA-1572917712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (708676ba-8d8f-4716-bb15-306e1e3224f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de201545-b003-4b67-bd29-0b205e1c6674', 'volume_name': 'volume-de201545-b003-4b67-bd29-0b205e1c6674', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:18:53 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d7e89fb1-4dbc-4fab-8a88-357e5d332c8d tempest-ServerActionsTestOtherA-1572917712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd2ad07c-7f08-424e-a713-b4a763bb6016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:18:53 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d7e89fb1-4dbc-4fab-8a88-357e5d332c8d tempest-ServerActionsTestOtherA-1572917712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd2ad07c-7f08-424e-a713-b4a763bb6016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:18:53 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d7e89fb1-4dbc-4fab-8a88-357e5d332c8d tempest-ServerActionsTestOtherA-1572917712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e29bd361-9fb2-4754-99e8-e89ddcfcae73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:18:53 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-d7e89fb1-4dbc-4fab-8a88-357e5d332c8d tempest-ServerActionsTestOtherA-1572917712 None] Volume de201545-b003-4b67-bd29-0b205e1c6674: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de201545-b003-4b67-bd29-0b205e1c6674', 'volume_size': 1} Sep 03 14:18:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d7e89fb1-4dbc-4fab-8a88-357e5d332c8d tempest-ServerActionsTestOtherA-1572917712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:18:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d7e89fb1-4dbc-4fab-8a88-357e5d332c8d tempest-ServerActionsTestOtherA-1572917712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:18:53 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d7e89fb1-4dbc-4fab-8a88-357e5d332c8d tempest-ServerActionsTestOtherA-1572917712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1440916827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de201545-b003-4b67-bd29-0b205e1c6674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41fcda5231044468a18b62045e29db81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:18:54Z,use_quota=True,user_id='9fd43a50f1fe465ea9d3c9cce7ae5821',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:18:53 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-d7e89fb1-4dbc-4fab-8a88-357e5d332c8d tempest-ServerActionsTestOtherA-1572917712 None] Creating volume de201545-b003-4b67-bd29-0b205e1c6674 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:18:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d7e89fb1-4dbc-4fab-8a88-357e5d332c8d tempest-ServerActionsTestOtherA-1572917712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:18:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d7e89fb1-4dbc-4fab-8a88-357e5d332c8d tempest-ServerActionsTestOtherA-1572917712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:18:53 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d7e89fb1-4dbc-4fab-8a88-357e5d332c8d tempest-ServerActionsTestOtherA-1572917712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:18:53 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d7e89fb1-4dbc-4fab-8a88-357e5d332c8d tempest-ServerActionsTestOtherA-1572917712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:18:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d7e89fb1-4dbc-4fab-8a88-357e5d332c8d tempest-ServerActionsTestOtherA-1572917712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:18:53 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d7e89fb1-4dbc-4fab-8a88-357e5d332c8d tempest-ServerActionsTestOtherA-1572917712 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:18:53 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-d7e89fb1-4dbc-4fab-8a88-357e5d332c8d tempest-ServerActionsTestOtherA-1572917712 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:18:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d7e89fb1-4dbc-4fab-8a88-357e5d332c8d tempest-ServerActionsTestOtherA-1572917712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-de201545-b003-4b67-bd29-0b205e1c6674 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:18:54 devstack sudo[88719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-de201545-b003-4b67-bd29-0b205e1c6674 1073741824 Sep 03 14:18:54 devstack sudo[88719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:18:54 devstack sudo[88719]: pam_unix(sudo:session): session closed for user root Sep 03 14:18:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d7e89fb1-4dbc-4fab-8a88-357e5d332c8d tempest-ServerActionsTestOtherA-1572917712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-de201545-b003-4b67-bd29-0b205e1c6674 1073741824" returned: 0 in 0.597s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:18:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d7e89fb1-4dbc-4fab-8a88-357e5d332c8d tempest-ServerActionsTestOtherA-1572917712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-de201545-b003-4b67-bd29-0b205e1c6674 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:18:54 devstack sudo[88725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-de201545-b003-4b67-bd29-0b205e1c6674 Sep 03 14:18:54 devstack sudo[88725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:18:54 devstack sudo[88725]: pam_unix(sudo:session): session closed for user root Sep 03 14:18:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d7e89fb1-4dbc-4fab-8a88-357e5d332c8d tempest-ServerActionsTestOtherA-1572917712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-de201545-b003-4b67-bd29-0b205e1c6674" returned: 0 in 0.269s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:18:54 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d7e89fb1-4dbc-4fab-8a88-357e5d332c8d tempest-ServerActionsTestOtherA-1572917712 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:18:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d7e89fb1-4dbc-4fab-8a88-357e5d332c8d tempest-ServerActionsTestOtherA-1572917712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:18:54 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d7e89fb1-4dbc-4fab-8a88-357e5d332c8d tempest-ServerActionsTestOtherA-1572917712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e29bd361-9fb2-4754-99e8-e89ddcfcae73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de201545-b003-4b67-bd29-0b205e1c6674', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:18:54 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d7e89fb1-4dbc-4fab-8a88-357e5d332c8d tempest-ServerActionsTestOtherA-1572917712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (481a6fb3-f076-46a6-a14b-5a21638b972c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:18:54 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-d7e89fb1-4dbc-4fab-8a88-357e5d332c8d tempest-ServerActionsTestOtherA-1572917712 None] Volume volume-de201545-b003-4b67-bd29-0b205e1c6674 (de201545-b003-4b67-bd29-0b205e1c6674): created successfully Sep 03 14:18:54 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d7e89fb1-4dbc-4fab-8a88-357e5d332c8d tempest-ServerActionsTestOtherA-1572917712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (481a6fb3-f076-46a6-a14b-5a21638b972c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:18:54 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d7e89fb1-4dbc-4fab-8a88-357e5d332c8d tempest-ServerActionsTestOtherA-1572917712 None] Flow 'volume_create_manager' (6d00787e-5e5e-4d86-a8cd-2d8338927319) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:18:54 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-d7e89fb1-4dbc-4fab-8a88-357e5d332c8d tempest-ServerActionsTestOtherA-1572917712 None] Created volume successfully. Sep 03 14:19:04 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:SELECT=22,cinder:INSERT=6,cinder:UPDATE=29,cinder:DELETE=3 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:19:04 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:UPDATE=24,cinder:SELECT=25,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:19:17 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-96366631-3066-48d6-83b6-b2ea16b23923 tempest-TaggedAttachmentsTest-221873996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:19:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-96366631-3066-48d6-83b6-b2ea16b23923 tempest-TaggedAttachmentsTest-221873996 None] Flow 'volume_create_manager' (39e51c35-6a88-4ec7-9223-a249c0dec130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:19:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-96366631-3066-48d6-83b6-b2ea16b23923 tempest-TaggedAttachmentsTest-221873996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d96ccb21-2f65-4528-8f53-f0a720f0a3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:19:18 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-96366631-3066-48d6-83b6-b2ea16b23923 tempest-TaggedAttachmentsTest-221873996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d96ccb21-2f65-4528-8f53-f0a720f0a3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1614492002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=181a2f70-0092-4060-855a-5318e16d35b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4f9b4d086a44fa495f1e16bc51404df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:19:18Z,use_quota=True,user_id='41f7bfecee1c4d738e714a7e9a8ea874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:19:18 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-96366631-3066-48d6-83b6-b2ea16b23923 tempest-TaggedAttachmentsTest-221873996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (027c2650-6e4e-4d56-a106-ed8f13a8eddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:19:18 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-96366631-3066-48d6-83b6-b2ea16b23923 tempest-TaggedAttachmentsTest-221873996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (027c2650-6e4e-4d56-a106-ed8f13a8eddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:19:18 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-96366631-3066-48d6-83b6-b2ea16b23923 tempest-TaggedAttachmentsTest-221873996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46061b59-3652-4ff5-8a52-5f3037c95657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:19:18 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-96366631-3066-48d6-83b6-b2ea16b23923 tempest-TaggedAttachmentsTest-221873996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46061b59-3652-4ff5-8a52-5f3037c95657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '181a2f70-0092-4060-855a-5318e16d35b4', 'volume_name': 'volume-181a2f70-0092-4060-855a-5318e16d35b4', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:19:18 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-96366631-3066-48d6-83b6-b2ea16b23923 tempest-TaggedAttachmentsTest-221873996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01508f2c-069e-4f62-b236-89fdd5911771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:19:18 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-96366631-3066-48d6-83b6-b2ea16b23923 tempest-TaggedAttachmentsTest-221873996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01508f2c-069e-4f62-b236-89fdd5911771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:19:18 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-96366631-3066-48d6-83b6-b2ea16b23923 tempest-TaggedAttachmentsTest-221873996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5277c8a5-a0ec-435e-8150-a134fbbecd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:19:18 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-96366631-3066-48d6-83b6-b2ea16b23923 tempest-TaggedAttachmentsTest-221873996 None] Volume 181a2f70-0092-4060-855a-5318e16d35b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-181a2f70-0092-4060-855a-5318e16d35b4', 'volume_size': 1} Sep 03 14:19:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-96366631-3066-48d6-83b6-b2ea16b23923 tempest-TaggedAttachmentsTest-221873996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:19:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-96366631-3066-48d6-83b6-b2ea16b23923 tempest-TaggedAttachmentsTest-221873996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:19:18 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-96366631-3066-48d6-83b6-b2ea16b23923 tempest-TaggedAttachmentsTest-221873996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1614492002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=181a2f70-0092-4060-855a-5318e16d35b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4f9b4d086a44fa495f1e16bc51404df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:19:18Z,use_quota=True,user_id='41f7bfecee1c4d738e714a7e9a8ea874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:19:18 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-96366631-3066-48d6-83b6-b2ea16b23923 tempest-TaggedAttachmentsTest-221873996 None] Creating volume 181a2f70-0092-4060-855a-5318e16d35b4 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:19:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-96366631-3066-48d6-83b6-b2ea16b23923 tempest-TaggedAttachmentsTest-221873996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:19:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-96366631-3066-48d6-83b6-b2ea16b23923 tempest-TaggedAttachmentsTest-221873996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:19:18 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-96366631-3066-48d6-83b6-b2ea16b23923 tempest-TaggedAttachmentsTest-221873996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:19:18 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-96366631-3066-48d6-83b6-b2ea16b23923 tempest-TaggedAttachmentsTest-221873996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:19:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-96366631-3066-48d6-83b6-b2ea16b23923 tempest-TaggedAttachmentsTest-221873996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:19:18 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-96366631-3066-48d6-83b6-b2ea16b23923 tempest-TaggedAttachmentsTest-221873996 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:19:18 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-96366631-3066-48d6-83b6-b2ea16b23923 tempest-TaggedAttachmentsTest-221873996 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:19:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-96366631-3066-48d6-83b6-b2ea16b23923 tempest-TaggedAttachmentsTest-221873996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-181a2f70-0092-4060-855a-5318e16d35b4 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:19:18 devstack sudo[88811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-181a2f70-0092-4060-855a-5318e16d35b4 1073741824 Sep 03 14:19:18 devstack sudo[88811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:19:18 devstack sudo[88811]: pam_unix(sudo:session): session closed for user root Sep 03 14:19:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-96366631-3066-48d6-83b6-b2ea16b23923 tempest-TaggedAttachmentsTest-221873996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-181a2f70-0092-4060-855a-5318e16d35b4 1073741824" returned: 0 in 0.625s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:19:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-96366631-3066-48d6-83b6-b2ea16b23923 tempest-TaggedAttachmentsTest-221873996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-181a2f70-0092-4060-855a-5318e16d35b4 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:19:18 devstack sudo[88820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-181a2f70-0092-4060-855a-5318e16d35b4 Sep 03 14:19:18 devstack sudo[88820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:19:19 devstack sudo[88820]: pam_unix(sudo:session): session closed for user root Sep 03 14:19:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-96366631-3066-48d6-83b6-b2ea16b23923 tempest-TaggedAttachmentsTest-221873996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-181a2f70-0092-4060-855a-5318e16d35b4" returned: 0 in 0.320s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:19:19 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-96366631-3066-48d6-83b6-b2ea16b23923 tempest-TaggedAttachmentsTest-221873996 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:19:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-96366631-3066-48d6-83b6-b2ea16b23923 tempest-TaggedAttachmentsTest-221873996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:19:19 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-96366631-3066-48d6-83b6-b2ea16b23923 tempest-TaggedAttachmentsTest-221873996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5277c8a5-a0ec-435e-8150-a134fbbecd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-181a2f70-0092-4060-855a-5318e16d35b4', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:19:19 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-96366631-3066-48d6-83b6-b2ea16b23923 tempest-TaggedAttachmentsTest-221873996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fada56c-d8bb-4111-a215-c90a48de15ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:19:19 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-96366631-3066-48d6-83b6-b2ea16b23923 tempest-TaggedAttachmentsTest-221873996 None] Volume volume-181a2f70-0092-4060-855a-5318e16d35b4 (181a2f70-0092-4060-855a-5318e16d35b4): created successfully Sep 03 14:19:19 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-96366631-3066-48d6-83b6-b2ea16b23923 tempest-TaggedAttachmentsTest-221873996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fada56c-d8bb-4111-a215-c90a48de15ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:19:19 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-96366631-3066-48d6-83b6-b2ea16b23923 tempest-TaggedAttachmentsTest-221873996 None] Flow 'volume_create_manager' (39e51c35-6a88-4ec7-9223-a249c0dec130) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:19:19 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-96366631-3066-48d6-83b6-b2ea16b23923 tempest-TaggedAttachmentsTest-221873996 None] Created volume successfully. Sep 03 14:19:29 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:INSERT=1 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:19:29 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:19:51 devstack cinder-volume[87007]: DEBUG oslo_service.periodic_task [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87007) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 14:19:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:19:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:19:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:19:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:19:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:19:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:19:51 devstack sudo[89231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:19:51 devstack sudo[89231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:19:52 devstack sudo[89231]: pam_unix(sudo:session): session closed for user root Sep 03 14:19:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.904s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:19:52 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:19:52 devstack cinder-volume[87007]: DEBUG oslo_service.periodic_task [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running periodic task VolumeManager._thread_info {{(pid=87007) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 14:19:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] thread count: 8 {{(pid=87007) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 14:19:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] thread info: [<_MainThread(MainThread, started 123689171054720)>, , , , , , , ] {{(pid=87007) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 14:19:52 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-2068e440-22a7-4de0-aa57-d293f88db92f tempest-ServerRescueNegativeTestJSON-230867680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:19:53 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2068e440-22a7-4de0-aa57-d293f88db92f tempest-ServerRescueNegativeTestJSON-230867680 None] Flow 'volume_create_manager' (963ceaa9-157b-40ec-951a-dbac6cd7a761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:19:53 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2068e440-22a7-4de0-aa57-d293f88db92f tempest-ServerRescueNegativeTestJSON-230867680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e481283b-8a30-4c08-be74-711cc42cdd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:19:53 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2068e440-22a7-4de0-aa57-d293f88db92f tempest-ServerRescueNegativeTestJSON-230867680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e481283b-8a30-4c08-be74-711cc42cdd83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-641872494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7386bc7d-3650-4817-b63c-7fb4cb07908b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='508e909f0deb43e18e3ca014a7aff174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:19:53Z,use_quota=True,user_id='c7e48a332cc348b58a1104adf6725112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:19:53 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2068e440-22a7-4de0-aa57-d293f88db92f tempest-ServerRescueNegativeTestJSON-230867680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0164f991-b2ea-4003-9092-883b09d07ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:19:53 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2068e440-22a7-4de0-aa57-d293f88db92f tempest-ServerRescueNegativeTestJSON-230867680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0164f991-b2ea-4003-9092-883b09d07ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:19:53 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2068e440-22a7-4de0-aa57-d293f88db92f tempest-ServerRescueNegativeTestJSON-230867680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1cdadac-2182-4b6c-a9a4-665202147433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:19:53 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2068e440-22a7-4de0-aa57-d293f88db92f tempest-ServerRescueNegativeTestJSON-230867680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1cdadac-2182-4b6c-a9a4-665202147433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7386bc7d-3650-4817-b63c-7fb4cb07908b', 'volume_name': 'volume-7386bc7d-3650-4817-b63c-7fb4cb07908b', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:19:53 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2068e440-22a7-4de0-aa57-d293f88db92f tempest-ServerRescueNegativeTestJSON-230867680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe23b3c1-c1cb-4380-ab61-affc206cc982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:19:53 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2068e440-22a7-4de0-aa57-d293f88db92f tempest-ServerRescueNegativeTestJSON-230867680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe23b3c1-c1cb-4380-ab61-affc206cc982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:19:53 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2068e440-22a7-4de0-aa57-d293f88db92f tempest-ServerRescueNegativeTestJSON-230867680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b96711-5538-4683-9ad2-a7ebdee28a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:19:53 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-2068e440-22a7-4de0-aa57-d293f88db92f tempest-ServerRescueNegativeTestJSON-230867680 None] Volume 7386bc7d-3650-4817-b63c-7fb4cb07908b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7386bc7d-3650-4817-b63c-7fb4cb07908b', 'volume_size': 1} Sep 03 14:19:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2068e440-22a7-4de0-aa57-d293f88db92f tempest-ServerRescueNegativeTestJSON-230867680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:19:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2068e440-22a7-4de0-aa57-d293f88db92f tempest-ServerRescueNegativeTestJSON-230867680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:19:53 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2068e440-22a7-4de0-aa57-d293f88db92f tempest-ServerRescueNegativeTestJSON-230867680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-641872494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7386bc7d-3650-4817-b63c-7fb4cb07908b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='508e909f0deb43e18e3ca014a7aff174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:19:53Z,use_quota=True,user_id='c7e48a332cc348b58a1104adf6725112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:19:53 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-2068e440-22a7-4de0-aa57-d293f88db92f tempest-ServerRescueNegativeTestJSON-230867680 None] Creating volume 7386bc7d-3650-4817-b63c-7fb4cb07908b {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:19:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2068e440-22a7-4de0-aa57-d293f88db92f tempest-ServerRescueNegativeTestJSON-230867680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:19:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2068e440-22a7-4de0-aa57-d293f88db92f tempest-ServerRescueNegativeTestJSON-230867680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:19:53 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2068e440-22a7-4de0-aa57-d293f88db92f tempest-ServerRescueNegativeTestJSON-230867680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:19:53 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2068e440-22a7-4de0-aa57-d293f88db92f tempest-ServerRescueNegativeTestJSON-230867680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:19:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2068e440-22a7-4de0-aa57-d293f88db92f tempest-ServerRescueNegativeTestJSON-230867680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:19:53 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2068e440-22a7-4de0-aa57-d293f88db92f tempest-ServerRescueNegativeTestJSON-230867680 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:19:53 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-2068e440-22a7-4de0-aa57-d293f88db92f tempest-ServerRescueNegativeTestJSON-230867680 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:19:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2068e440-22a7-4de0-aa57-d293f88db92f tempest-ServerRescueNegativeTestJSON-230867680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7386bc7d-3650-4817-b63c-7fb4cb07908b 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:19:53 devstack sudo[89272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7386bc7d-3650-4817-b63c-7fb4cb07908b 1073741824 Sep 03 14:19:53 devstack sudo[89272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:19:54 devstack sudo[89272]: pam_unix(sudo:session): session closed for user root Sep 03 14:19:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2068e440-22a7-4de0-aa57-d293f88db92f tempest-ServerRescueNegativeTestJSON-230867680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7386bc7d-3650-4817-b63c-7fb4cb07908b 1073741824" returned: 0 in 0.875s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:19:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2068e440-22a7-4de0-aa57-d293f88db92f tempest-ServerRescueNegativeTestJSON-230867680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7386bc7d-3650-4817-b63c-7fb4cb07908b {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:19:54 devstack sudo[89280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7386bc7d-3650-4817-b63c-7fb4cb07908b Sep 03 14:19:54 devstack sudo[89280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:19:54 devstack sudo[89280]: pam_unix(sudo:session): session closed for user root Sep 03 14:19:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2068e440-22a7-4de0-aa57-d293f88db92f tempest-ServerRescueNegativeTestJSON-230867680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7386bc7d-3650-4817-b63c-7fb4cb07908b" returned: 0 in 0.599s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:19:54 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2068e440-22a7-4de0-aa57-d293f88db92f tempest-ServerRescueNegativeTestJSON-230867680 None] <== create_volume: return (1584ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:19:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2068e440-22a7-4de0-aa57-d293f88db92f tempest-ServerRescueNegativeTestJSON-230867680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:19:54 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2068e440-22a7-4de0-aa57-d293f88db92f tempest-ServerRescueNegativeTestJSON-230867680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b96711-5538-4683-9ad2-a7ebdee28a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7386bc7d-3650-4817-b63c-7fb4cb07908b', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:19:54 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2068e440-22a7-4de0-aa57-d293f88db92f tempest-ServerRescueNegativeTestJSON-230867680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (615ad8c2-1e1a-4a28-8c91-c76eb3ba30dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:19:54 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-2068e440-22a7-4de0-aa57-d293f88db92f tempest-ServerRescueNegativeTestJSON-230867680 None] Volume volume-7386bc7d-3650-4817-b63c-7fb4cb07908b (7386bc7d-3650-4817-b63c-7fb4cb07908b): created successfully Sep 03 14:19:54 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2068e440-22a7-4de0-aa57-d293f88db92f tempest-ServerRescueNegativeTestJSON-230867680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (615ad8c2-1e1a-4a28-8c91-c76eb3ba30dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:19:54 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2068e440-22a7-4de0-aa57-d293f88db92f tempest-ServerRescueNegativeTestJSON-230867680 None] Flow 'volume_create_manager' (963ceaa9-157b-40ec-951a-dbac6cd7a761) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:19:54 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-2068e440-22a7-4de0-aa57-d293f88db92f tempest-ServerRescueNegativeTestJSON-230867680 None] Created volume successfully. Sep 03 14:19:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-01543a7d-4c1a-430a-ada4-46bb6520dc8c req-5f8228b3-a91e-4507-8a7e-cab519a4d9df tempest-ServerActionsTestOtherA-1572917712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:19:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-01543a7d-4c1a-430a-ada4-46bb6520dc8c req-5f8228b3-a91e-4507-8a7e-cab519a4d9df tempest-ServerActionsTestOtherA-1572917712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:19:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-01543a7d-4c1a-430a-ada4-46bb6520dc8c req-5f8228b3-a91e-4507-8a7e-cab519a4d9df tempest-ServerActionsTestOtherA-1572917712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:19:55 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-01543a7d-4c1a-430a-ada4-46bb6520dc8c req-5f8228b3-a91e-4507-8a7e-cab519a4d9df tempest-ServerActionsTestOtherA-1572917712 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713', 'name': 'volume-de201545-b003-4b67-bd29-0b205e1c6674', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a2e3eff6-2604-4af1-9a27-ddc85e482927', 'enforce_multipath': True} {{(pid=87007) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 14:19:55 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-01543a7d-4c1a-430a-ada4-46bb6520dc8c req-5f8228b3-a91e-4507-8a7e-cab519a4d9df tempest-ServerActionsTestOtherA-1572917712 None] attachment_update completed successfully. Sep 03 14:20:02 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-e3eed6c3-499e-4ce2-bbd6-845e339ba87f req-f9f434ef-1738-44f7-bdcf-272c554cb6e4 tempest-ServerActionsTestOtherA-1572917712 None] Terminate volume connection completed successfully. Sep 03 14:20:02 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-e3eed6c3-499e-4ce2-bbd6-845e339ba87f req-f9f434ef-1738-44f7-bdcf-272c554cb6e4 tempest-ServerActionsTestOtherA-1572917712 None] Deleting attachment a2e3eff6-2604-4af1-9a27-ddc85e482927. {{(pid=87007) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 14:20:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-e3eed6c3-499e-4ce2-bbd6-845e339ba87f req-9f911c98-e7c8-4562-a431-ee13320f104a tempest-ServerActionsTestOtherA-1572917712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:20:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-e3eed6c3-499e-4ce2-bbd6-845e339ba87f req-9f911c98-e7c8-4562-a431-ee13320f104a tempest-ServerActionsTestOtherA-1572917712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:20:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-e3eed6c3-499e-4ce2-bbd6-845e339ba87f req-9f911c98-e7c8-4562-a431-ee13320f104a tempest-ServerActionsTestOtherA-1572917712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.048s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:20:04 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-e3eed6c3-499e-4ce2-bbd6-845e339ba87f req-9f911c98-e7c8-4562-a431-ee13320f104a tempest-ServerActionsTestOtherA-1572917712 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713', 'name': 'volume-de201545-b003-4b67-bd29-0b205e1c6674', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '53f26654-8ec6-478e-b7f5-759f01839564', 'enforce_multipath': True} {{(pid=87007) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 14:20:04 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-e3eed6c3-499e-4ce2-bbd6-845e339ba87f req-9f911c98-e7c8-4562-a431-ee13320f104a tempest-ServerActionsTestOtherA-1572917712 None] attachment_update completed successfully. Sep 03 14:20:11 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-62ca0d97-0ff2-4bc8-8e27-5eee014b2fb7 tempest-ServerRescueNegativeTestJSON-230867680 None] Acquiring lock "cinder-7386bc7d-3650-4817-b63c-7fb4cb07908b-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:20:12 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-62ca0d97-0ff2-4bc8-8e27-5eee014b2fb7 tempest-ServerRescueNegativeTestJSON-230867680 None] Lock "cinder-7386bc7d-3650-4817-b63c-7fb4cb07908b-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:20:12 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-62ca0d97-0ff2-4bc8-8e27-5eee014b2fb7 tempest-ServerRescueNegativeTestJSON-230867680 None] Acquiring lock "cinder-quobyte-7386bc7d-3650-4817-b63c-7fb4cb07908b" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:20:12 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-62ca0d97-0ff2-4bc8-8e27-5eee014b2fb7 tempest-ServerRescueNegativeTestJSON-230867680 None] Lock "cinder-quobyte-7386bc7d-3650-4817-b63c-7fb4cb07908b" acquired by "delete_volume" :: waited 0.022s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:20:12 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b8a182-40fe-4d3d-bc9a-47a47c75b63f]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:20:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-62ca0d97-0ff2-4bc8-8e27-5eee014b2fb7 tempest-ServerRescueNegativeTestJSON-230867680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7386bc7d-3650-4817-b63c-7fb4cb07908b {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:20:12 devstack sudo[90423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7386bc7d-3650-4817-b63c-7fb4cb07908b Sep 03 14:20:12 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:20:13 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root Sep 03 14:20:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-62ca0d97-0ff2-4bc8-8e27-5eee014b2fb7 tempest-ServerRescueNegativeTestJSON-230867680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7386bc7d-3650-4817-b63c-7fb4cb07908b" returned: 0 in 0.853s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:20:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-62ca0d97-0ff2-4bc8-8e27-5eee014b2fb7 tempest-ServerRescueNegativeTestJSON-230867680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7386bc7d-3650-4817-b63c-7fb4cb07908b {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:20:13 devstack sudo[90446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7386bc7d-3650-4817-b63c-7fb4cb07908b Sep 03 14:20:13 devstack sudo[90446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:20:13 devstack sudo[90446]: pam_unix(sudo:session): session closed for user root Sep 03 14:20:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-62ca0d97-0ff2-4bc8-8e27-5eee014b2fb7 tempest-ServerRescueNegativeTestJSON-230867680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7386bc7d-3650-4817-b63c-7fb4cb07908b" returned: 0 in 0.659s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:20:13 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-62ca0d97-0ff2-4bc8-8e27-5eee014b2fb7 tempest-ServerRescueNegativeTestJSON-230867680 None] Lock "cinder-quobyte-7386bc7d-3650-4817-b63c-7fb4cb07908b" released by "delete_volume" :: held 1.622s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:20:13 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-62ca0d97-0ff2-4bc8-8e27-5eee014b2fb7 tempest-ServerRescueNegativeTestJSON-230867680 None] Created reservations ['01ad057d-ca1d-4866-b1dd-68bcd1348002', 'd7a07183-d93c-4b3b-8c8d-22e5ce614163', 'd2924c9a-4a68-4cc6-806a-b8ca18950e1b', '509d7d09-d55d-4c5b-b6dd-ccb01b69d60d'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:20:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-62ca0d97-0ff2-4bc8-8e27-5eee014b2fb7 tempest-ServerRescueNegativeTestJSON-230867680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:20:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-62ca0d97-0ff2-4bc8-8e27-5eee014b2fb7 tempest-ServerRescueNegativeTestJSON-230867680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:20:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-62ca0d97-0ff2-4bc8-8e27-5eee014b2fb7 tempest-ServerRescueNegativeTestJSON-230867680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:20:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-62ca0d97-0ff2-4bc8-8e27-5eee014b2fb7 tempest-ServerRescueNegativeTestJSON-230867680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:20:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-62ca0d97-0ff2-4bc8-8e27-5eee014b2fb7 tempest-ServerRescueNegativeTestJSON-230867680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:20:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-62ca0d97-0ff2-4bc8-8e27-5eee014b2fb7 tempest-ServerRescueNegativeTestJSON-230867680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:20:14 devstack sudo[90456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:20:14 devstack sudo[90456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:20:14 devstack sudo[90456]: pam_unix(sudo:session): session closed for user root Sep 03 14:20:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-62ca0d97-0ff2-4bc8-8e27-5eee014b2fb7 tempest-ServerRescueNegativeTestJSON-230867680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.654s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:20:14 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-62ca0d97-0ff2-4bc8-8e27-5eee014b2fb7 tempest-ServerRescueNegativeTestJSON-230867680 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:20:14 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-62ca0d97-0ff2-4bc8-8e27-5eee014b2fb7 tempest-ServerRescueNegativeTestJSON-230867680 None] Deleted volume successfully. Sep 03 14:20:14 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-62ca0d97-0ff2-4bc8-8e27-5eee014b2fb7 tempest-ServerRescueNegativeTestJSON-230867680 None] Lock "cinder-7386bc7d-3650-4817-b63c-7fb4cb07908b-delete_volume" released by "delete_volume" :: held 2.849s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:20:24 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:UPDATE=15,cinder:SELECT=20,cinder:INSERT=3 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:20:24 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:SELECT=22,cinder:UPDATE=13,cinder:INSERT=2,cinder:DELETE=2 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:20:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-903bb5fe-2d77-4781-aa37-a0e92265bdf6 req-49947b1b-635c-4b86-a0b0-26fe4bc8e7e0 tempest-TaggedAttachmentsTest-221873996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:20:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-903bb5fe-2d77-4781-aa37-a0e92265bdf6 req-49947b1b-635c-4b86-a0b0-26fe4bc8e7e0 tempest-TaggedAttachmentsTest-221873996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:20:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-903bb5fe-2d77-4781-aa37-a0e92265bdf6 req-49947b1b-635c-4b86-a0b0-26fe4bc8e7e0 tempest-TaggedAttachmentsTest-221873996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:20:25 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-903bb5fe-2d77-4781-aa37-a0e92265bdf6 req-49947b1b-635c-4b86-a0b0-26fe4bc8e7e0 tempest-TaggedAttachmentsTest-221873996 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713', 'name': 'volume-181a2f70-0092-4060-855a-5318e16d35b4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '458179fb-9c90-4e2d-9406-2f1c61e1f8b9', 'enforce_multipath': True} {{(pid=87007) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 14:20:25 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-903bb5fe-2d77-4781-aa37-a0e92265bdf6 req-49947b1b-635c-4b86-a0b0-26fe4bc8e7e0 tempest-TaggedAttachmentsTest-221873996 None] attachment_update completed successfully. Sep 03 14:20:28 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-48ecc141-828a-46fe-b8b6-97cf5e3671bb req-9844bcec-0725-49af-8d1a-cc987def94e2 tempest-TaggedAttachmentsTest-221873996 None] Terminate volume connection completed successfully. Sep 03 14:20:28 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-48ecc141-828a-46fe-b8b6-97cf5e3671bb req-9844bcec-0725-49af-8d1a-cc987def94e2 tempest-TaggedAttachmentsTest-221873996 None] Deleting attachment 458179fb-9c90-4e2d-9406-2f1c61e1f8b9. {{(pid=87007) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 14:20:38 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:SELECT=8 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:20:38 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:20:39 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-399fbb22-ade9-49dd-b42f-fdcf15ae4582 tempest-TaggedAttachmentsTest-221873996 None] Acquiring lock "cinder-181a2f70-0092-4060-855a-5318e16d35b4-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:20:39 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-399fbb22-ade9-49dd-b42f-fdcf15ae4582 tempest-TaggedAttachmentsTest-221873996 None] Lock "cinder-181a2f70-0092-4060-855a-5318e16d35b4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:20:39 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-399fbb22-ade9-49dd-b42f-fdcf15ae4582 tempest-TaggedAttachmentsTest-221873996 None] Acquiring lock "cinder-quobyte-181a2f70-0092-4060-855a-5318e16d35b4" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:20:39 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-399fbb22-ade9-49dd-b42f-fdcf15ae4582 tempest-TaggedAttachmentsTest-221873996 None] Lock "cinder-quobyte-181a2f70-0092-4060-855a-5318e16d35b4" acquired by "delete_volume" :: waited 0.018s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:20:39 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a840101-a28f-4fb5-b880-c5d8285f1d5c]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:20:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-399fbb22-ade9-49dd-b42f-fdcf15ae4582 tempest-TaggedAttachmentsTest-221873996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-181a2f70-0092-4060-855a-5318e16d35b4 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:20:40 devstack sudo[90762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-181a2f70-0092-4060-855a-5318e16d35b4 Sep 03 14:20:40 devstack sudo[90762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:20:40 devstack sudo[90762]: pam_unix(sudo:session): session closed for user root Sep 03 14:20:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-399fbb22-ade9-49dd-b42f-fdcf15ae4582 tempest-TaggedAttachmentsTest-221873996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-181a2f70-0092-4060-855a-5318e16d35b4" returned: 0 in 0.408s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:20:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-399fbb22-ade9-49dd-b42f-fdcf15ae4582 tempest-TaggedAttachmentsTest-221873996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-181a2f70-0092-4060-855a-5318e16d35b4 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:20:40 devstack sudo[90767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-181a2f70-0092-4060-855a-5318e16d35b4 Sep 03 14:20:40 devstack sudo[90767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:20:40 devstack sudo[90767]: pam_unix(sudo:session): session closed for user root Sep 03 14:20:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-399fbb22-ade9-49dd-b42f-fdcf15ae4582 tempest-TaggedAttachmentsTest-221873996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-181a2f70-0092-4060-855a-5318e16d35b4" returned: 0 in 0.265s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:20:40 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-399fbb22-ade9-49dd-b42f-fdcf15ae4582 tempest-TaggedAttachmentsTest-221873996 None] Lock "cinder-quobyte-181a2f70-0092-4060-855a-5318e16d35b4" released by "delete_volume" :: held 0.723s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:20:40 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-399fbb22-ade9-49dd-b42f-fdcf15ae4582 tempest-TaggedAttachmentsTest-221873996 None] Created reservations ['c038eb31-649b-4345-8a61-73512fce4fc9', '27e757fc-d8a1-42f8-9a56-537310afacac', 'e93e1e62-163d-4169-9c33-949d3c9a1aec', 'bde7c504-72f2-400e-8bcb-7df13f4a8278'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:20:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-399fbb22-ade9-49dd-b42f-fdcf15ae4582 tempest-TaggedAttachmentsTest-221873996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:20:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-399fbb22-ade9-49dd-b42f-fdcf15ae4582 tempest-TaggedAttachmentsTest-221873996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:20:40 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-399fbb22-ade9-49dd-b42f-fdcf15ae4582 tempest-TaggedAttachmentsTest-221873996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:20:40 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-399fbb22-ade9-49dd-b42f-fdcf15ae4582 tempest-TaggedAttachmentsTest-221873996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:20:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-399fbb22-ade9-49dd-b42f-fdcf15ae4582 tempest-TaggedAttachmentsTest-221873996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:20:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-399fbb22-ade9-49dd-b42f-fdcf15ae4582 tempest-TaggedAttachmentsTest-221873996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:20:40 devstack sudo[90772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:20:40 devstack sudo[90772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:20:41 devstack sudo[90772]: pam_unix(sudo:session): session closed for user root Sep 03 14:20:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-399fbb22-ade9-49dd-b42f-fdcf15ae4582 tempest-TaggedAttachmentsTest-221873996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.334s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:20:41 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-399fbb22-ade9-49dd-b42f-fdcf15ae4582 tempest-TaggedAttachmentsTest-221873996 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:20:41 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-399fbb22-ade9-49dd-b42f-fdcf15ae4582 tempest-TaggedAttachmentsTest-221873996 None] Deleted volume successfully. Sep 03 14:20:41 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-399fbb22-ade9-49dd-b42f-fdcf15ae4582 tempest-TaggedAttachmentsTest-221873996 None] Lock "cinder-181a2f70-0092-4060-855a-5318e16d35b4-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:20:41 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-673ca67c-1d80-4b01-969a-a7719f849077 tempest-AttachVolumeShelveTestJSON-245678517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:20:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-673ca67c-1d80-4b01-969a-a7719f849077 tempest-AttachVolumeShelveTestJSON-245678517 None] Flow 'volume_create_manager' (56323f50-bbe1-4234-94b0-b5a5d9799ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:20:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-673ca67c-1d80-4b01-969a-a7719f849077 tempest-AttachVolumeShelveTestJSON-245678517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (620bef3a-09be-472f-91a8-2a92b717b157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:20:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-673ca67c-1d80-4b01-969a-a7719f849077 tempest-AttachVolumeShelveTestJSON-245678517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (620bef3a-09be-472f-91a8-2a92b717b157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-64796842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbe5c213-ef35-4f88-95da-11356ec91d49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='964acaa549d1408791b95a94e1e6b3da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:20:41Z,use_quota=True,user_id='86cb89e5fb8d4f2ebabc76613fc156ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:20:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-673ca67c-1d80-4b01-969a-a7719f849077 tempest-AttachVolumeShelveTestJSON-245678517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e01789-d2d9-44f2-b83a-c3a1ecb8e28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:20:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-673ca67c-1d80-4b01-969a-a7719f849077 tempest-AttachVolumeShelveTestJSON-245678517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e01789-d2d9-44f2-b83a-c3a1ecb8e28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:20:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-673ca67c-1d80-4b01-969a-a7719f849077 tempest-AttachVolumeShelveTestJSON-245678517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95255717-95a9-4b81-92ba-0da16676bf71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:20:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-673ca67c-1d80-4b01-969a-a7719f849077 tempest-AttachVolumeShelveTestJSON-245678517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95255717-95a9-4b81-92ba-0da16676bf71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbe5c213-ef35-4f88-95da-11356ec91d49', 'volume_name': 'volume-bbe5c213-ef35-4f88-95da-11356ec91d49', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:20:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-673ca67c-1d80-4b01-969a-a7719f849077 tempest-AttachVolumeShelveTestJSON-245678517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47861349-c86f-43c6-adb7-c18fa184d11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:20:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-673ca67c-1d80-4b01-969a-a7719f849077 tempest-AttachVolumeShelveTestJSON-245678517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47861349-c86f-43c6-adb7-c18fa184d11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:20:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-673ca67c-1d80-4b01-969a-a7719f849077 tempest-AttachVolumeShelveTestJSON-245678517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f2e7768-60a5-46b2-8d28-1806834fe853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:20:41 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-673ca67c-1d80-4b01-969a-a7719f849077 tempest-AttachVolumeShelveTestJSON-245678517 None] Volume bbe5c213-ef35-4f88-95da-11356ec91d49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbe5c213-ef35-4f88-95da-11356ec91d49', 'volume_size': 1} Sep 03 14:20:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-673ca67c-1d80-4b01-969a-a7719f849077 tempest-AttachVolumeShelveTestJSON-245678517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:20:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-673ca67c-1d80-4b01-969a-a7719f849077 tempest-AttachVolumeShelveTestJSON-245678517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:20:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-673ca67c-1d80-4b01-969a-a7719f849077 tempest-AttachVolumeShelveTestJSON-245678517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-64796842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbe5c213-ef35-4f88-95da-11356ec91d49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='964acaa549d1408791b95a94e1e6b3da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:20:41Z,use_quota=True,user_id='86cb89e5fb8d4f2ebabc76613fc156ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:20:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-673ca67c-1d80-4b01-969a-a7719f849077 tempest-AttachVolumeShelveTestJSON-245678517 None] Creating volume bbe5c213-ef35-4f88-95da-11356ec91d49 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:20:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-673ca67c-1d80-4b01-969a-a7719f849077 tempest-AttachVolumeShelveTestJSON-245678517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:20:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-673ca67c-1d80-4b01-969a-a7719f849077 tempest-AttachVolumeShelveTestJSON-245678517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:20:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-673ca67c-1d80-4b01-969a-a7719f849077 tempest-AttachVolumeShelveTestJSON-245678517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:20:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-673ca67c-1d80-4b01-969a-a7719f849077 tempest-AttachVolumeShelveTestJSON-245678517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:20:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-673ca67c-1d80-4b01-969a-a7719f849077 tempest-AttachVolumeShelveTestJSON-245678517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:20:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-673ca67c-1d80-4b01-969a-a7719f849077 tempest-AttachVolumeShelveTestJSON-245678517 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:20:41 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-673ca67c-1d80-4b01-969a-a7719f849077 tempest-AttachVolumeShelveTestJSON-245678517 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:20:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-673ca67c-1d80-4b01-969a-a7719f849077 tempest-AttachVolumeShelveTestJSON-245678517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bbe5c213-ef35-4f88-95da-11356ec91d49 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:20:41 devstack sudo[90775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bbe5c213-ef35-4f88-95da-11356ec91d49 1073741824 Sep 03 14:20:41 devstack sudo[90775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:20:42 devstack sudo[90775]: pam_unix(sudo:session): session closed for user root Sep 03 14:20:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-673ca67c-1d80-4b01-969a-a7719f849077 tempest-AttachVolumeShelveTestJSON-245678517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bbe5c213-ef35-4f88-95da-11356ec91d49 1073741824" returned: 0 in 0.533s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:20:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-673ca67c-1d80-4b01-969a-a7719f849077 tempest-AttachVolumeShelveTestJSON-245678517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bbe5c213-ef35-4f88-95da-11356ec91d49 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:20:42 devstack sudo[90781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bbe5c213-ef35-4f88-95da-11356ec91d49 Sep 03 14:20:42 devstack sudo[90781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:20:42 devstack sudo[90781]: pam_unix(sudo:session): session closed for user root Sep 03 14:20:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-673ca67c-1d80-4b01-969a-a7719f849077 tempest-AttachVolumeShelveTestJSON-245678517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bbe5c213-ef35-4f88-95da-11356ec91d49" returned: 0 in 0.335s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:20:42 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-673ca67c-1d80-4b01-969a-a7719f849077 tempest-AttachVolumeShelveTestJSON-245678517 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:20:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-673ca67c-1d80-4b01-969a-a7719f849077 tempest-AttachVolumeShelveTestJSON-245678517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:20:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-673ca67c-1d80-4b01-969a-a7719f849077 tempest-AttachVolumeShelveTestJSON-245678517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f2e7768-60a5-46b2-8d28-1806834fe853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbe5c213-ef35-4f88-95da-11356ec91d49', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:20:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-673ca67c-1d80-4b01-969a-a7719f849077 tempest-AttachVolumeShelveTestJSON-245678517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82451874-42e5-456e-9933-71a0a66e899f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:20:42 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-673ca67c-1d80-4b01-969a-a7719f849077 tempest-AttachVolumeShelveTestJSON-245678517 None] Volume volume-bbe5c213-ef35-4f88-95da-11356ec91d49 (bbe5c213-ef35-4f88-95da-11356ec91d49): created successfully Sep 03 14:20:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-673ca67c-1d80-4b01-969a-a7719f849077 tempest-AttachVolumeShelveTestJSON-245678517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82451874-42e5-456e-9933-71a0a66e899f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:20:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-673ca67c-1d80-4b01-969a-a7719f849077 tempest-AttachVolumeShelveTestJSON-245678517 None] Flow 'volume_create_manager' (56323f50-bbe1-4234-94b0-b5a5d9799ff8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:20:42 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-673ca67c-1d80-4b01-969a-a7719f849077 tempest-AttachVolumeShelveTestJSON-245678517 None] Created volume successfully. Sep 03 14:20:50 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-7539ee59-3e51-4cd6-a712-cdac569745e6 req-2e3c4bf3-9436-47ca-9776-0e8267ee5641 tempest-ServerActionsTestOtherA-1572917712 None] Terminate volume connection completed successfully. Sep 03 14:20:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-7539ee59-3e51-4cd6-a712-cdac569745e6 req-2e3c4bf3-9436-47ca-9776-0e8267ee5641 tempest-ServerActionsTestOtherA-1572917712 None] Deleting attachment 53f26654-8ec6-478e-b7f5-759f01839564. {{(pid=87007) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 14:20:51 devstack cinder-volume[87007]: DEBUG oslo_service.periodic_task [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87007) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 14:20:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:20:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:20:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:20:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:20:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:20:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:20:51 devstack sudo[90825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:20:51 devstack sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:20:52 devstack sudo[90825]: pam_unix(sudo:session): session closed for user root Sep 03 14:20:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.484s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:20:52 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:20:52 devstack cinder-volume[87007]: DEBUG oslo_service.periodic_task [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running periodic task VolumeManager._thread_info {{(pid=87007) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 14:20:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] thread count: 8 {{(pid=87007) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 14:20:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] thread info: [<_MainThread(MainThread, started 123689171054720)>, , , , , , , ] {{(pid=87007) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 14:20:58 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-e425cd24-46f9-4ef3-a345-2c10293ef21e req-0c03bd53-a70b-43b5-9822-f8ba1e31a45d tempest-AttachVolumeShelveTestJSON-245678517 None] No connector for attachment 5110f560-468e-4314-8f98-dd34839a8335; skipping storage backend terminate_connection call. {{(pid=87007) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 03 14:20:58 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-e425cd24-46f9-4ef3-a345-2c10293ef21e req-0c03bd53-a70b-43b5-9822-f8ba1e31a45d tempest-AttachVolumeShelveTestJSON-245678517 None] Deleting attachment 5110f560-468e-4314-8f98-dd34839a8335. {{(pid=87007) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 14:21:01 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:21:01 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Flow 'volume_create_manager' (5a2b1aee-dac5-4937-8c8d-4b98c07ddd42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:21:01 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08f1e87a-8f77-47b6-aeb6-a17d3e8fa744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:21:01 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08f1e87a-8f77-47b6-aeb6-a17d3e8fa744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-134622690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98c331ab-eddc-45df-93b6-c5dbf0bc3fa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41fcda5231044468a18b62045e29db81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:21:01Z,use_quota=True,user_id='9fd43a50f1fe465ea9d3c9cce7ae5821',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:21:01 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b1ddc01-5997-442f-9eb7-078ac63c29e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:21:01 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b1ddc01-5997-442f-9eb7-078ac63c29e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:21:01 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (006d97fd-ac38-40f7-b3af-34f46dff948a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:21:01 devstack cinder-volume[87007]: DEBUG cinder.image.glance [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Creating Keystone auth plugin from conf {{(pid=87007) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 14:21:02 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (006d97fd-ac38-40f7-b3af-34f46dff948a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '98c331ab-eddc-45df-93b6-c5dbf0bc3fa9', 'volume_name': 'volume-98c331ab-eddc-45df-93b6-c5dbf0bc3fa9', 'volume_size': 1, 'image_id': '49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd4e87261137045028f09a9da96d0acd8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'created_at': datetime.datetime(2026, 9, 3, 12, 12, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 12, 12, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/49981579-d0a4-4b4a-9bc6-bd809c76cea9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:21:02 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dab5dd8a-4068-4ad2-b8f0-1a3eb39bcd08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:21:02 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dab5dd8a-4068-4ad2-b8f0-1a3eb39bcd08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:21:02 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ffcd0d8-f716-417d-84e5-7881623584b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:21:02 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Volume 98c331ab-eddc-45df-93b6-c5dbf0bc3fa9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-98c331ab-eddc-45df-93b6-c5dbf0bc3fa9', 'volume_size': 1, 'image_id': '49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd4e87261137045028f09a9da96d0acd8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'created_at': datetime.datetime(2026, 9, 3, 12, 12, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 12, 12, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/49981579-d0a4-4b4a-9bc6-bd809c76cea9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 03 14:21:02 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Trying to clone 98c331ab-eddc-45df-93b6-c5dbf0bc3fa9 from image 49981579-d0a4-4b4a-9bc6-bd809c76cea9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'metadata': {}}]). {{(pid=87007) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 14:21:02 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_pbx4zci8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87007) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 14:21:02 devstack cinder-volume[87007]: INFO cinder.image.image_utils [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Image download 20.69 MB at 20.69 MB/s Sep 03 14:21:03 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8f66d8-9b60-46d7-994f-b5ea6fe6d330]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:21:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_pbx4zci8devstack@QuobyteHD {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:21:03 devstack sudo[91024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_pbx4zci8devstack@QuobyteHD Sep 03 14:21:03 devstack sudo[91024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:21:03 devstack sudo[91024]: pam_unix(sudo:session): session closed for user root Sep 03 14:21:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_pbx4zci8devstack@QuobyteHD" returned: 0 in 0.769s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:21:03 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Temporary image 49981579-d0a4-4b4a-9bc6-bd809c76cea9 is fetched for user 9fd43a50f1fe465ea9d3c9cce7ae5821. {{(pid=87007) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 14:21:04 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44920f5-45ba-4c77-8eab-7ac5b2c76a15]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:21:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_pbx4zci8devstack@QuobyteHD {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:21:04 devstack sudo[91040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_pbx4zci8devstack@QuobyteHD Sep 03 14:21:04 devstack sudo[91040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:21:04 devstack sudo[91040]: pam_unix(sudo:session): session closed for user root Sep 03 14:21:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_pbx4zci8devstack@QuobyteHD" returned: 0 in 0.700s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:21:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:21:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:21:04 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-134622690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98c331ab-eddc-45df-93b6-c5dbf0bc3fa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41fcda5231044468a18b62045e29db81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:21:01Z,use_quota=True,user_id='9fd43a50f1fe465ea9d3c9cce7ae5821',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:21:04 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Creating volume 98c331ab-eddc-45df-93b6-c5dbf0bc3fa9 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:21:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:21:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:21:04 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:21:04 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:21:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:21:04 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:21:04 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:21:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-98c331ab-eddc-45df-93b6-c5dbf0bc3fa9 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:21:04 devstack sudo[91052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-98c331ab-eddc-45df-93b6-c5dbf0bc3fa9 1073741824 Sep 03 14:21:04 devstack sudo[91052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:21:05 devstack sudo[91052]: pam_unix(sudo:session): session closed for user root Sep 03 14:21:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-98c331ab-eddc-45df-93b6-c5dbf0bc3fa9 1073741824" returned: 0 in 0.564s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:21:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-98c331ab-eddc-45df-93b6-c5dbf0bc3fa9 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:21:05 devstack sudo[91059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-98c331ab-eddc-45df-93b6-c5dbf0bc3fa9 Sep 03 14:21:05 devstack sudo[91059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:21:05 devstack sudo[91059]: pam_unix(sudo:session): session closed for user root Sep 03 14:21:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-98c331ab-eddc-45df-93b6-c5dbf0bc3fa9" returned: 0 in 0.372s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:21:05 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:21:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:21:05 devstack cinder-volume[87007]: DEBUG cinder.volume.volume_utils [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Attempting download of 49981579-d0a4-4b4a-9bc6-bd809c76cea9 ((None, [{'url': 'file:///opt/stack/data/glance/images/49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'metadata': {}}])) to volume 98c331ab-eddc-45df-93b6-c5dbf0bc3fa9. {{(pid=87007) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 14:21:05 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ab7f3e-a0d7-4fe9-b100-15acca8cfcbc]: (4, 'raw') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:21:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_49981579-d0a4-4b4a-9bc6-bd809c76cea9_z8x3kn4c {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:21:06 devstack sudo[91063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_49981579-d0a4-4b4a-9bc6-bd809c76cea9_z8x3kn4c Sep 03 14:21:06 devstack sudo[91063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:21:06 devstack sudo[91063]: pam_unix(sudo:session): session closed for user root Sep 03 14:21:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_49981579-d0a4-4b4a-9bc6-bd809c76cea9_z8x3kn4c" returned: 0 in 0.390s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:21:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49981579-d0a4-4b4a-9bc6-bd809c76cea9_z8x3kn4c {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:21:06 devstack sudo[91068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49981579-d0a4-4b4a-9bc6-bd809c76cea9_z8x3kn4c Sep 03 14:21:06 devstack sudo[91068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:21:06 devstack sudo[91068]: pam_unix(sudo:session): session closed for user root Sep 03 14:21:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49981579-d0a4-4b4a-9bc6-bd809c76cea9_z8x3kn4c" returned: 1 in 0.436s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:21:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49981579-d0a4-4b4a-9bc6-bd809c76cea9_z8x3kn4c' failed. Not Retrying. {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 14:21:06 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae197fe6-c249-4393-b9ee-aedc256bb40d]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:21:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_pbx4zci8devstack@QuobyteHD {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:21:06 devstack sudo[91072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_pbx4zci8devstack@QuobyteHD Sep 03 14:21:06 devstack sudo[91072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:21:07 devstack sudo[91072]: pam_unix(sudo:session): session closed for user root Sep 03 14:21:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_pbx4zci8devstack@QuobyteHD" returned: 0 in 0.422s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:21:07 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] 49981579-d0a4-4b4a-9bc6-bd809c76cea9 was qcow2, converting to qcow2 {{(pid=87007) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 14:21:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_pbx4zci8devstack@QuobyteHD /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-98c331ab-eddc-45df-93b6-c5dbf0bc3fa9 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:21:07 devstack sudo[91077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_pbx4zci8devstack@QuobyteHD /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-98c331ab-eddc-45df-93b6-c5dbf0bc3fa9 Sep 03 14:21:07 devstack sudo[91077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:21:09 devstack sudo[91077]: pam_unix(sudo:session): session closed for user root Sep 03 14:21:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_pbx4zci8devstack@QuobyteHD /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-98c331ab-eddc-45df-93b6-c5dbf0bc3fa9" returned: 0 in 2.652s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:21:09 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_pbx4zci8devstack@QuobyteHD, size 112.00 MB, duration 2.65 sec, destination /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-98c331ab-eddc-45df-93b6-c5dbf0bc3fa9 {{(pid=87007) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 14:21:09 devstack cinder-volume[87007]: INFO cinder.image.image_utils [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Converted 112.00 MB image at 42.21 MB/s Sep 03 14:21:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-98c331ab-eddc-45df-93b6-c5dbf0bc3fa9 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:21:09 devstack sudo[91087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-98c331ab-eddc-45df-93b6-c5dbf0bc3fa9 1G Sep 03 14:21:09 devstack sudo[91087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:21:10 devstack sudo[91087]: pam_unix(sudo:session): session closed for user root Sep 03 14:21:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-98c331ab-eddc-45df-93b6-c5dbf0bc3fa9 1G" returned: 0 in 0.609s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:21:10 devstack cinder-volume[87007]: DEBUG cinder.volume.volume_utils [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Downloaded image 49981579-d0a4-4b4a-9bc6-bd809c76cea9 ((None, [{'url': 'file:///opt/stack/data/glance/images/49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'metadata': {}}])) to volume 98c331ab-eddc-45df-93b6-c5dbf0bc3fa9 successfully. {{(pid=87007) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 14:21:10 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Temporary image 49981579-d0a4-4b4a-9bc6-bd809c76cea9 for user 9fd43a50f1fe465ea9d3c9cce7ae5821 is deleted. {{(pid=87007) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 14:21:10 devstack cinder-volume[87007]: DEBUG cinder.volume.volume_utils [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Marking volume 98c331ab-eddc-45df-93b6-c5dbf0bc3fa9 as bootable. {{(pid=87007) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 14:21:10 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Copying metadata from image 49981579-d0a4-4b4a-9bc6-bd809c76cea9 to 98c331ab-eddc-45df-93b6-c5dbf0bc3fa9. {{(pid=87007) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 14:21:10 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Creating volume glance metadata for volume 98c331ab-eddc-45df-93b6-c5dbf0bc3fa9 backed by image 49981579-d0a4-4b4a-9bc6-bd809c76cea9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87007) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 14:21:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ffcd0d8-f716-417d-84e5-7881623584b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98c331ab-eddc-45df-93b6-c5dbf0bc3fa9', 'volume_size': 1, 'image_id': '49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd4e87261137045028f09a9da96d0acd8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'created_at': datetime.datetime(2026, 9, 3, 12, 12, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 12, 12, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/49981579-d0a4-4b4a-9bc6-bd809c76cea9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:21:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc33aa64-e31f-48b7-89f0-b158aeb85ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:21:10 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Volume volume-98c331ab-eddc-45df-93b6-c5dbf0bc3fa9 (98c331ab-eddc-45df-93b6-c5dbf0bc3fa9): created successfully Sep 03 14:21:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc33aa64-e31f-48b7-89f0-b158aeb85ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:21:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Flow 'volume_create_manager' (5a2b1aee-dac5-4937-8c8d-4b98c07ddd42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:21:10 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-71ef7440-abf8-4795-9411-d5a63958a218 tempest-ServerActionsTestOtherA-1572917712 None] Created volume successfully. Sep 03 14:21:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-4e676ecc-0afe-4d42-bab7-70b5a7cbf263 req-a8866ec8-d8cf-4501-9385-e69b218d7104 tempest-ServerActionsTestOtherA-1572917712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:21:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-4e676ecc-0afe-4d42-bab7-70b5a7cbf263 req-a8866ec8-d8cf-4501-9385-e69b218d7104 tempest-ServerActionsTestOtherA-1572917712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:21:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-4e676ecc-0afe-4d42-bab7-70b5a7cbf263 req-a8866ec8-d8cf-4501-9385-e69b218d7104 tempest-ServerActionsTestOtherA-1572917712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.061s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:21:18 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-4e676ecc-0afe-4d42-bab7-70b5a7cbf263 req-a8866ec8-d8cf-4501-9385-e69b218d7104 tempest-ServerActionsTestOtherA-1572917712 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713', 'name': 'volume-98c331ab-eddc-45df-93b6-c5dbf0bc3fa9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dac75cb4-c21b-4791-8ad7-bb22d7d6237a', 'enforce_multipath': True} {{(pid=87007) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 14:21:18 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-4e676ecc-0afe-4d42-bab7-70b5a7cbf263 req-a8866ec8-d8cf-4501-9385-e69b218d7104 tempest-ServerActionsTestOtherA-1572917712 None] attachment_update completed successfully. Sep 03 14:21:25 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a41c1b0-76b0-445d-ac89-9cca15adca65 tempest-ServersNegativeTestJSON-1772840870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:21:25 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4a41c1b0-76b0-445d-ac89-9cca15adca65 tempest-ServersNegativeTestJSON-1772840870 None] Flow 'volume_create_manager' (2e7c7238-3391-448d-b507-86745a069890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:21:25 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4a41c1b0-76b0-445d-ac89-9cca15adca65 tempest-ServersNegativeTestJSON-1772840870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (359f97fc-a964-4508-ae22-59ea33e39779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:21:25 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4a41c1b0-76b0-445d-ac89-9cca15adca65 tempest-ServersNegativeTestJSON-1772840870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (359f97fc-a964-4508-ae22-59ea33e39779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-597813073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b193d462-520a-479f-8d30-22ff6362f15e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='034e8a7223c54a008c5cc9d9e87987cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:21:25Z,use_quota=True,user_id='6e9465017cc64def92b4fae2daf7814d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:21:25 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4a41c1b0-76b0-445d-ac89-9cca15adca65 tempest-ServersNegativeTestJSON-1772840870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5130da2-4930-47e3-a766-d9bdb2db9f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:21:25 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4a41c1b0-76b0-445d-ac89-9cca15adca65 tempest-ServersNegativeTestJSON-1772840870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5130da2-4930-47e3-a766-d9bdb2db9f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:21:25 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4a41c1b0-76b0-445d-ac89-9cca15adca65 tempest-ServersNegativeTestJSON-1772840870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5aac853-64e7-48b3-a35f-0793eb22aef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:21:25 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4a41c1b0-76b0-445d-ac89-9cca15adca65 tempest-ServersNegativeTestJSON-1772840870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5aac853-64e7-48b3-a35f-0793eb22aef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b193d462-520a-479f-8d30-22ff6362f15e', 'volume_name': 'volume-b193d462-520a-479f-8d30-22ff6362f15e', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:21:25 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4a41c1b0-76b0-445d-ac89-9cca15adca65 tempest-ServersNegativeTestJSON-1772840870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4070440b-b6c8-4ea5-b5bd-3e069da67ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:21:25 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4a41c1b0-76b0-445d-ac89-9cca15adca65 tempest-ServersNegativeTestJSON-1772840870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4070440b-b6c8-4ea5-b5bd-3e069da67ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:21:25 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4a41c1b0-76b0-445d-ac89-9cca15adca65 tempest-ServersNegativeTestJSON-1772840870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aa52310-66bc-46f9-af9a-0351025446c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:21:25 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-4a41c1b0-76b0-445d-ac89-9cca15adca65 tempest-ServersNegativeTestJSON-1772840870 None] Volume b193d462-520a-479f-8d30-22ff6362f15e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b193d462-520a-479f-8d30-22ff6362f15e', 'volume_size': 1} Sep 03 14:21:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4a41c1b0-76b0-445d-ac89-9cca15adca65 tempest-ServersNegativeTestJSON-1772840870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:21:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4a41c1b0-76b0-445d-ac89-9cca15adca65 tempest-ServersNegativeTestJSON-1772840870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:21:25 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-4a41c1b0-76b0-445d-ac89-9cca15adca65 tempest-ServersNegativeTestJSON-1772840870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-597813073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b193d462-520a-479f-8d30-22ff6362f15e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='034e8a7223c54a008c5cc9d9e87987cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:21:25Z,use_quota=True,user_id='6e9465017cc64def92b4fae2daf7814d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:21:25 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-4a41c1b0-76b0-445d-ac89-9cca15adca65 tempest-ServersNegativeTestJSON-1772840870 None] Creating volume b193d462-520a-479f-8d30-22ff6362f15e {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:21:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4a41c1b0-76b0-445d-ac89-9cca15adca65 tempest-ServersNegativeTestJSON-1772840870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:21:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4a41c1b0-76b0-445d-ac89-9cca15adca65 tempest-ServersNegativeTestJSON-1772840870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:21:25 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-4a41c1b0-76b0-445d-ac89-9cca15adca65 tempest-ServersNegativeTestJSON-1772840870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:21:25 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-4a41c1b0-76b0-445d-ac89-9cca15adca65 tempest-ServersNegativeTestJSON-1772840870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:21:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4a41c1b0-76b0-445d-ac89-9cca15adca65 tempest-ServersNegativeTestJSON-1772840870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:21:25 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-4a41c1b0-76b0-445d-ac89-9cca15adca65 tempest-ServersNegativeTestJSON-1772840870 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:21:25 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-4a41c1b0-76b0-445d-ac89-9cca15adca65 tempest-ServersNegativeTestJSON-1772840870 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:21:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4a41c1b0-76b0-445d-ac89-9cca15adca65 tempest-ServersNegativeTestJSON-1772840870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b193d462-520a-479f-8d30-22ff6362f15e 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:21:25 devstack sudo[91754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b193d462-520a-479f-8d30-22ff6362f15e 1073741824 Sep 03 14:21:25 devstack sudo[91754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:21:27 devstack sudo[91754]: pam_unix(sudo:session): session closed for user root Sep 03 14:21:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4a41c1b0-76b0-445d-ac89-9cca15adca65 tempest-ServersNegativeTestJSON-1772840870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b193d462-520a-479f-8d30-22ff6362f15e 1073741824" returned: 0 in 1.370s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:21:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4a41c1b0-76b0-445d-ac89-9cca15adca65 tempest-ServersNegativeTestJSON-1772840870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b193d462-520a-479f-8d30-22ff6362f15e {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:21:27 devstack sudo[91774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b193d462-520a-479f-8d30-22ff6362f15e Sep 03 14:21:27 devstack sudo[91774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:21:27 devstack sudo[91774]: pam_unix(sudo:session): session closed for user root Sep 03 14:21:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4a41c1b0-76b0-445d-ac89-9cca15adca65 tempest-ServersNegativeTestJSON-1772840870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b193d462-520a-479f-8d30-22ff6362f15e" returned: 0 in 0.650s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:21:28 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-4a41c1b0-76b0-445d-ac89-9cca15adca65 tempest-ServersNegativeTestJSON-1772840870 None] <== create_volume: return (2199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:21:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4a41c1b0-76b0-445d-ac89-9cca15adca65 tempest-ServersNegativeTestJSON-1772840870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.226s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:21:28 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4a41c1b0-76b0-445d-ac89-9cca15adca65 tempest-ServersNegativeTestJSON-1772840870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aa52310-66bc-46f9-af9a-0351025446c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b193d462-520a-479f-8d30-22ff6362f15e', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:21:28 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4a41c1b0-76b0-445d-ac89-9cca15adca65 tempest-ServersNegativeTestJSON-1772840870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41733d31-ba81-4013-8c92-96b412041245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:21:28 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-4a41c1b0-76b0-445d-ac89-9cca15adca65 tempest-ServersNegativeTestJSON-1772840870 None] Volume volume-b193d462-520a-479f-8d30-22ff6362f15e (b193d462-520a-479f-8d30-22ff6362f15e): created successfully Sep 03 14:21:28 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4a41c1b0-76b0-445d-ac89-9cca15adca65 tempest-ServersNegativeTestJSON-1772840870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41733d31-ba81-4013-8c92-96b412041245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:21:28 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4a41c1b0-76b0-445d-ac89-9cca15adca65 tempest-ServersNegativeTestJSON-1772840870 None] Flow 'volume_create_manager' (2e7c7238-3391-448d-b507-86745a069890) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:21:28 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-4a41c1b0-76b0-445d-ac89-9cca15adca65 tempest-ServersNegativeTestJSON-1772840870 None] Created volume successfully. Sep 03 14:21:32 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bc34a5b-09be-4fb2-9be6-8edb3d3f9c9b tempest-ServersNegativeTestJSON-1772840870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:21:32 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6bc34a5b-09be-4fb2-9be6-8edb3d3f9c9b tempest-ServersNegativeTestJSON-1772840870 None] Flow 'volume_create_manager' (82b302c9-931b-4afb-9eef-492f2870dd5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:21:32 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6bc34a5b-09be-4fb2-9be6-8edb3d3f9c9b tempest-ServersNegativeTestJSON-1772840870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5017a484-6ea6-4ee3-a290-cbe2d915ebc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:21:32 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6bc34a5b-09be-4fb2-9be6-8edb3d3f9c9b tempest-ServersNegativeTestJSON-1772840870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5017a484-6ea6-4ee3-a290-cbe2d915ebc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-555294774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=707014c3-bd70-4668-9501-e276fa2874d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='034e8a7223c54a008c5cc9d9e87987cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:21:33Z,use_quota=True,user_id='6e9465017cc64def92b4fae2daf7814d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:21:32 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6bc34a5b-09be-4fb2-9be6-8edb3d3f9c9b tempest-ServersNegativeTestJSON-1772840870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66c96698-39eb-4bee-bb58-208aa07b32c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:21:32 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6bc34a5b-09be-4fb2-9be6-8edb3d3f9c9b tempest-ServersNegativeTestJSON-1772840870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66c96698-39eb-4bee-bb58-208aa07b32c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:21:32 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6bc34a5b-09be-4fb2-9be6-8edb3d3f9c9b tempest-ServersNegativeTestJSON-1772840870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af8eda04-44eb-4244-8a4d-84cf2791ff32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:21:32 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6bc34a5b-09be-4fb2-9be6-8edb3d3f9c9b tempest-ServersNegativeTestJSON-1772840870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af8eda04-44eb-4244-8a4d-84cf2791ff32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '707014c3-bd70-4668-9501-e276fa2874d6', 'volume_name': 'volume-707014c3-bd70-4668-9501-e276fa2874d6', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:21:32 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6bc34a5b-09be-4fb2-9be6-8edb3d3f9c9b tempest-ServersNegativeTestJSON-1772840870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (030f9e13-4689-4d28-a732-9d5db9c71876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:21:32 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6bc34a5b-09be-4fb2-9be6-8edb3d3f9c9b tempest-ServersNegativeTestJSON-1772840870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (030f9e13-4689-4d28-a732-9d5db9c71876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:21:32 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6bc34a5b-09be-4fb2-9be6-8edb3d3f9c9b tempest-ServersNegativeTestJSON-1772840870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9009f7d1-302a-4bd9-a3b3-919c5f30a0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:21:32 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-6bc34a5b-09be-4fb2-9be6-8edb3d3f9c9b tempest-ServersNegativeTestJSON-1772840870 None] Volume 707014c3-bd70-4668-9501-e276fa2874d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-707014c3-bd70-4668-9501-e276fa2874d6', 'volume_size': 1} Sep 03 14:21:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6bc34a5b-09be-4fb2-9be6-8edb3d3f9c9b tempest-ServersNegativeTestJSON-1772840870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:21:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6bc34a5b-09be-4fb2-9be6-8edb3d3f9c9b tempest-ServersNegativeTestJSON-1772840870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:21:32 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-6bc34a5b-09be-4fb2-9be6-8edb3d3f9c9b tempest-ServersNegativeTestJSON-1772840870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-555294774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=707014c3-bd70-4668-9501-e276fa2874d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='034e8a7223c54a008c5cc9d9e87987cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:21:33Z,use_quota=True,user_id='6e9465017cc64def92b4fae2daf7814d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:21:32 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-6bc34a5b-09be-4fb2-9be6-8edb3d3f9c9b tempest-ServersNegativeTestJSON-1772840870 None] Creating volume 707014c3-bd70-4668-9501-e276fa2874d6 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:21:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6bc34a5b-09be-4fb2-9be6-8edb3d3f9c9b tempest-ServersNegativeTestJSON-1772840870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:21:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6bc34a5b-09be-4fb2-9be6-8edb3d3f9c9b tempest-ServersNegativeTestJSON-1772840870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:21:32 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-6bc34a5b-09be-4fb2-9be6-8edb3d3f9c9b tempest-ServersNegativeTestJSON-1772840870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:21:32 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-6bc34a5b-09be-4fb2-9be6-8edb3d3f9c9b tempest-ServersNegativeTestJSON-1772840870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:21:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6bc34a5b-09be-4fb2-9be6-8edb3d3f9c9b tempest-ServersNegativeTestJSON-1772840870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:21:32 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-6bc34a5b-09be-4fb2-9be6-8edb3d3f9c9b tempest-ServersNegativeTestJSON-1772840870 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:21:32 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-6bc34a5b-09be-4fb2-9be6-8edb3d3f9c9b tempest-ServersNegativeTestJSON-1772840870 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:21:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6bc34a5b-09be-4fb2-9be6-8edb3d3f9c9b tempest-ServersNegativeTestJSON-1772840870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-707014c3-bd70-4668-9501-e276fa2874d6 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:21:33 devstack sudo[91845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-707014c3-bd70-4668-9501-e276fa2874d6 1073741824 Sep 03 14:21:33 devstack sudo[91845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:21:34 devstack sudo[91845]: pam_unix(sudo:session): session closed for user root Sep 03 14:21:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6bc34a5b-09be-4fb2-9be6-8edb3d3f9c9b tempest-ServersNegativeTestJSON-1772840870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-707014c3-bd70-4668-9501-e276fa2874d6 1073741824" returned: 0 in 1.528s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:21:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6bc34a5b-09be-4fb2-9be6-8edb3d3f9c9b tempest-ServersNegativeTestJSON-1772840870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-707014c3-bd70-4668-9501-e276fa2874d6 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:21:34 devstack sudo[91866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-707014c3-bd70-4668-9501-e276fa2874d6 Sep 03 14:21:34 devstack sudo[91866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:21:35 devstack sudo[91866]: pam_unix(sudo:session): session closed for user root Sep 03 14:21:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6bc34a5b-09be-4fb2-9be6-8edb3d3f9c9b tempest-ServersNegativeTestJSON-1772840870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-707014c3-bd70-4668-9501-e276fa2874d6" returned: 0 in 0.685s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:21:35 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-6bc34a5b-09be-4fb2-9be6-8edb3d3f9c9b tempest-ServersNegativeTestJSON-1772840870 None] <== create_volume: return (2538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:21:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6bc34a5b-09be-4fb2-9be6-8edb3d3f9c9b tempest-ServersNegativeTestJSON-1772840870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.549s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:21:35 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6bc34a5b-09be-4fb2-9be6-8edb3d3f9c9b tempest-ServersNegativeTestJSON-1772840870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9009f7d1-302a-4bd9-a3b3-919c5f30a0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-707014c3-bd70-4668-9501-e276fa2874d6', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:21:35 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6bc34a5b-09be-4fb2-9be6-8edb3d3f9c9b tempest-ServersNegativeTestJSON-1772840870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c8b216d-f371-4345-b27f-918cac4ee0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:21:35 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-6bc34a5b-09be-4fb2-9be6-8edb3d3f9c9b tempest-ServersNegativeTestJSON-1772840870 None] Volume volume-707014c3-bd70-4668-9501-e276fa2874d6 (707014c3-bd70-4668-9501-e276fa2874d6): created successfully Sep 03 14:21:35 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6bc34a5b-09be-4fb2-9be6-8edb3d3f9c9b tempest-ServersNegativeTestJSON-1772840870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c8b216d-f371-4345-b27f-918cac4ee0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:21:35 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6bc34a5b-09be-4fb2-9be6-8edb3d3f9c9b tempest-ServersNegativeTestJSON-1772840870 None] Flow 'volume_create_manager' (82b302c9-931b-4afb-9eef-492f2870dd5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:21:35 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-6bc34a5b-09be-4fb2-9be6-8edb3d3f9c9b tempest-ServersNegativeTestJSON-1772840870 None] Created volume successfully. Sep 03 14:21:36 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-418f7b4c-ce64-4794-846a-caf9d82a3b4c tempest-ServersNegativeTestJSON-1772840870 None] Acquiring lock "cinder-707014c3-bd70-4668-9501-e276fa2874d6-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:21:36 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-418f7b4c-ce64-4794-846a-caf9d82a3b4c tempest-ServersNegativeTestJSON-1772840870 None] Lock "cinder-707014c3-bd70-4668-9501-e276fa2874d6-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:21:37 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-418f7b4c-ce64-4794-846a-caf9d82a3b4c tempest-ServersNegativeTestJSON-1772840870 None] Acquiring lock "cinder-quobyte-707014c3-bd70-4668-9501-e276fa2874d6" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:21:37 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-418f7b4c-ce64-4794-846a-caf9d82a3b4c tempest-ServersNegativeTestJSON-1772840870 None] Lock "cinder-quobyte-707014c3-bd70-4668-9501-e276fa2874d6" acquired by "delete_volume" :: waited 0.036s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:21:37 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[be73f2e7-c3fb-4ad2-80b6-26dcf117f78b]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:21:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-418f7b4c-ce64-4794-846a-caf9d82a3b4c tempest-ServersNegativeTestJSON-1772840870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-707014c3-bd70-4668-9501-e276fa2874d6 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:21:37 devstack sudo[91876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-707014c3-bd70-4668-9501-e276fa2874d6 Sep 03 14:21:37 devstack sudo[91876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:21:37 devstack sudo[91876]: pam_unix(sudo:session): session closed for user root Sep 03 14:21:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-418f7b4c-ce64-4794-846a-caf9d82a3b4c tempest-ServersNegativeTestJSON-1772840870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-707014c3-bd70-4668-9501-e276fa2874d6" returned: 0 in 0.763s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:21:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-418f7b4c-ce64-4794-846a-caf9d82a3b4c tempest-ServersNegativeTestJSON-1772840870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-707014c3-bd70-4668-9501-e276fa2874d6 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:21:37 devstack sudo[91882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-707014c3-bd70-4668-9501-e276fa2874d6 Sep 03 14:21:37 devstack sudo[91882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:21:38 devstack sudo[91882]: pam_unix(sudo:session): session closed for user root Sep 03 14:21:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-418f7b4c-ce64-4794-846a-caf9d82a3b4c tempest-ServersNegativeTestJSON-1772840870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-707014c3-bd70-4668-9501-e276fa2874d6" returned: 0 in 0.488s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:21:38 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-418f7b4c-ce64-4794-846a-caf9d82a3b4c tempest-ServersNegativeTestJSON-1772840870 None] Lock "cinder-quobyte-707014c3-bd70-4668-9501-e276fa2874d6" released by "delete_volume" :: held 1.394s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:21:38 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-418f7b4c-ce64-4794-846a-caf9d82a3b4c tempest-ServersNegativeTestJSON-1772840870 None] Created reservations ['513e35ad-f24c-48ec-925a-b7c2f1adee63', '69cf7836-ab76-4607-9a41-4e3fb15ed739', '9bfda52f-2f9f-47ea-abbe-681bbe5cc343', 'a077ce68-d62d-4f36-8d65-ca36ccdff060'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:21:38 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:UPDATE=29,cinder:SELECT=34,cinder:INSERT=12,cinder:DELETE=4 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:21:38 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:SELECT=35,cinder:INSERT=13,cinder:UPDATE=29,cinder:DELETE=1 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:21:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-418f7b4c-ce64-4794-846a-caf9d82a3b4c tempest-ServersNegativeTestJSON-1772840870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:21:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-418f7b4c-ce64-4794-846a-caf9d82a3b4c tempest-ServersNegativeTestJSON-1772840870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:21:38 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-418f7b4c-ce64-4794-846a-caf9d82a3b4c tempest-ServersNegativeTestJSON-1772840870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:21:38 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-418f7b4c-ce64-4794-846a-caf9d82a3b4c tempest-ServersNegativeTestJSON-1772840870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:21:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-418f7b4c-ce64-4794-846a-caf9d82a3b4c tempest-ServersNegativeTestJSON-1772840870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:21:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-418f7b4c-ce64-4794-846a-caf9d82a3b4c tempest-ServersNegativeTestJSON-1772840870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:21:38 devstack sudo[91885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:21:38 devstack sudo[91885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:21:39 devstack sudo[91885]: pam_unix(sudo:session): session closed for user root Sep 03 14:21:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-418f7b4c-ce64-4794-846a-caf9d82a3b4c tempest-ServersNegativeTestJSON-1772840870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.410s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:21:39 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-418f7b4c-ce64-4794-846a-caf9d82a3b4c tempest-ServersNegativeTestJSON-1772840870 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:21:39 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-418f7b4c-ce64-4794-846a-caf9d82a3b4c tempest-ServersNegativeTestJSON-1772840870 None] Deleted volume successfully. Sep 03 14:21:39 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-418f7b4c-ce64-4794-846a-caf9d82a3b4c tempest-ServersNegativeTestJSON-1772840870 None] Lock "cinder-707014c3-bd70-4668-9501-e276fa2874d6-delete_volume" released by "delete_volume" :: held 2.346s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:21:39 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1f92d0bb-6f42-4c2f-878d-dc86b4b54692 tempest-ServersNegativeTestJSON-1772840870 None] Acquiring lock "cinder-b193d462-520a-479f-8d30-22ff6362f15e-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:21:39 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1f92d0bb-6f42-4c2f-878d-dc86b4b54692 tempest-ServersNegativeTestJSON-1772840870 None] Lock "cinder-b193d462-520a-479f-8d30-22ff6362f15e-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:21:39 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1f92d0bb-6f42-4c2f-878d-dc86b4b54692 tempest-ServersNegativeTestJSON-1772840870 None] Acquiring lock "cinder-quobyte-b193d462-520a-479f-8d30-22ff6362f15e" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:21:39 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1f92d0bb-6f42-4c2f-878d-dc86b4b54692 tempest-ServersNegativeTestJSON-1772840870 None] Lock "cinder-quobyte-b193d462-520a-479f-8d30-22ff6362f15e" acquired by "delete_volume" :: waited 0.046s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:21:39 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca8c2d0-73bd-47d6-8be1-2c7bb6f7a8a0]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:21:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1f92d0bb-6f42-4c2f-878d-dc86b4b54692 tempest-ServersNegativeTestJSON-1772840870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b193d462-520a-479f-8d30-22ff6362f15e {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:21:40 devstack sudo[91891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b193d462-520a-479f-8d30-22ff6362f15e Sep 03 14:21:40 devstack sudo[91891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:21:40 devstack sudo[91891]: pam_unix(sudo:session): session closed for user root Sep 03 14:21:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1f92d0bb-6f42-4c2f-878d-dc86b4b54692 tempest-ServersNegativeTestJSON-1772840870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b193d462-520a-479f-8d30-22ff6362f15e" returned: 0 in 0.891s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:21:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1f92d0bb-6f42-4c2f-878d-dc86b4b54692 tempest-ServersNegativeTestJSON-1772840870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b193d462-520a-479f-8d30-22ff6362f15e {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:21:40 devstack sudo[91898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b193d462-520a-479f-8d30-22ff6362f15e Sep 03 14:21:40 devstack sudo[91898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:21:41 devstack sudo[91898]: pam_unix(sudo:session): session closed for user root Sep 03 14:21:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1f92d0bb-6f42-4c2f-878d-dc86b4b54692 tempest-ServersNegativeTestJSON-1772840870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b193d462-520a-479f-8d30-22ff6362f15e" returned: 0 in 0.442s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:21:41 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1f92d0bb-6f42-4c2f-878d-dc86b4b54692 tempest-ServersNegativeTestJSON-1772840870 None] Lock "cinder-quobyte-b193d462-520a-479f-8d30-22ff6362f15e" released by "delete_volume" :: held 1.437s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:21:41 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-1f92d0bb-6f42-4c2f-878d-dc86b4b54692 tempest-ServersNegativeTestJSON-1772840870 None] Created reservations ['426d7a9d-ef31-433c-9ab3-280717d05b8b', '30a33952-e211-4875-ac9e-4fbdf7c83b95', '11720293-542e-4731-afcc-b2144954897f', 'bb01a23f-8501-415f-bf29-dc22f45a0c1e'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:21:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1f92d0bb-6f42-4c2f-878d-dc86b4b54692 tempest-ServersNegativeTestJSON-1772840870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:21:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1f92d0bb-6f42-4c2f-878d-dc86b4b54692 tempest-ServersNegativeTestJSON-1772840870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:21:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-1f92d0bb-6f42-4c2f-878d-dc86b4b54692 tempest-ServersNegativeTestJSON-1772840870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:21:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-1f92d0bb-6f42-4c2f-878d-dc86b4b54692 tempest-ServersNegativeTestJSON-1772840870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:21:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1f92d0bb-6f42-4c2f-878d-dc86b4b54692 tempest-ServersNegativeTestJSON-1772840870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:21:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1f92d0bb-6f42-4c2f-878d-dc86b4b54692 tempest-ServersNegativeTestJSON-1772840870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:21:41 devstack sudo[91902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:21:41 devstack sudo[91902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:21:42 devstack sudo[91902]: pam_unix(sudo:session): session closed for user root Sep 03 14:21:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1f92d0bb-6f42-4c2f-878d-dc86b4b54692 tempest-ServersNegativeTestJSON-1772840870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.712s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:21:42 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-1f92d0bb-6f42-4c2f-878d-dc86b4b54692 tempest-ServersNegativeTestJSON-1772840870 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:21:42 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-1f92d0bb-6f42-4c2f-878d-dc86b4b54692 tempest-ServersNegativeTestJSON-1772840870 None] Deleted volume successfully. Sep 03 14:21:42 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1f92d0bb-6f42-4c2f-878d-dc86b4b54692 tempest-ServersNegativeTestJSON-1772840870 None] Lock "cinder-b193d462-520a-479f-8d30-22ff6362f15e-delete_volume" released by "delete_volume" :: held 2.709s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:21:42 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-3ad27221-ba41-4d04-944f-5b0567fd8c70 req-bfcd2e09-7878-4fb3-a45c-384848e01a66 tempest-ServerActionsTestOtherA-1572917712 None] Terminate volume connection completed successfully. Sep 03 14:21:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-3ad27221-ba41-4d04-944f-5b0567fd8c70 req-bfcd2e09-7878-4fb3-a45c-384848e01a66 tempest-ServerActionsTestOtherA-1572917712 None] Deleting attachment dac75cb4-c21b-4791-8ad7-bb22d7d6237a. {{(pid=87007) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 14:21:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-3ad27221-ba41-4d04-944f-5b0567fd8c70 req-49f860c6-0b41-4d52-874a-30b85a5bb52b tempest-ServerActionsTestOtherA-1572917712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:21:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-3ad27221-ba41-4d04-944f-5b0567fd8c70 req-49f860c6-0b41-4d52-874a-30b85a5bb52b tempest-ServerActionsTestOtherA-1572917712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:21:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-3ad27221-ba41-4d04-944f-5b0567fd8c70 req-49f860c6-0b41-4d52-874a-30b85a5bb52b tempest-ServerActionsTestOtherA-1572917712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:21:46 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-3ad27221-ba41-4d04-944f-5b0567fd8c70 req-49f860c6-0b41-4d52-874a-30b85a5bb52b tempest-ServerActionsTestOtherA-1572917712 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713', 'name': 'volume-98c331ab-eddc-45df-93b6-c5dbf0bc3fa9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '807fbbe1-6db6-43f0-927b-c279dbef6806', 'enforce_multipath': True} {{(pid=87007) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 14:21:46 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-3ad27221-ba41-4d04-944f-5b0567fd8c70 req-49f860c6-0b41-4d52-874a-30b85a5bb52b tempest-ServerActionsTestOtherA-1572917712 None] attachment_update completed successfully. Sep 03 14:21:51 devstack cinder-volume[87007]: DEBUG oslo_service.periodic_task [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87007) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 14:21:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:21:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:21:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:21:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:21:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:21:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:21:51 devstack sudo[92413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:21:51 devstack sudo[92413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:21:52 devstack sudo[92413]: pam_unix(sudo:session): session closed for user root Sep 03 14:21:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.618s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:21:52 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:21:56 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:DELETE=2,cinder:SELECT=14,cinder:INSERT=3,cinder:UPDATE=9 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:21:56 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:UPDATE=15,cinder:SELECT=11,cinder:INSERT=1 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:21:57 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [req-dd41efb3-157e-47d5-8089-ef975dcc9bd4 req-7ca26939-2d06-44d1-a3cc-97af02df4276 tempest-VolumesSnapshotsTestJSON-325179961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:21:57 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-dd41efb3-157e-47d5-8089-ef975dcc9bd4 req-7ca26939-2d06-44d1-a3cc-97af02df4276 tempest-VolumesSnapshotsTestJSON-325179961 None] Flow 'volume_create_manager' (e45117cf-a458-472f-b34d-ca2881f7c5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:21:57 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-dd41efb3-157e-47d5-8089-ef975dcc9bd4 req-7ca26939-2d06-44d1-a3cc-97af02df4276 tempest-VolumesSnapshotsTestJSON-325179961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a23eaa8-8e52-4c43-84be-f3a5cfb3cb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:21:57 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-dd41efb3-157e-47d5-8089-ef975dcc9bd4 req-7ca26939-2d06-44d1-a3cc-97af02df4276 tempest-VolumesSnapshotsTestJSON-325179961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a23eaa8-8e52-4c43-84be-f3a5cfb3cb13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-715657004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=821df5af-6f78-4dcf-aabc-16c35b2e1ee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a53c2438aaea40e79f23713303ff82c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:21:58Z,use_quota=True,user_id='9c80efbf314d4e62bbfb04022b3df01d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:21:57 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-dd41efb3-157e-47d5-8089-ef975dcc9bd4 req-7ca26939-2d06-44d1-a3cc-97af02df4276 tempest-VolumesSnapshotsTestJSON-325179961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ada4005-dd8b-4814-aab2-d21718be9f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:21:57 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-dd41efb3-157e-47d5-8089-ef975dcc9bd4 req-7ca26939-2d06-44d1-a3cc-97af02df4276 tempest-VolumesSnapshotsTestJSON-325179961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ada4005-dd8b-4814-aab2-d21718be9f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:21:57 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-dd41efb3-157e-47d5-8089-ef975dcc9bd4 req-7ca26939-2d06-44d1-a3cc-97af02df4276 tempest-VolumesSnapshotsTestJSON-325179961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b95e98f0-f258-41a4-b9fd-c8c23912818d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:21:57 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-dd41efb3-157e-47d5-8089-ef975dcc9bd4 req-7ca26939-2d06-44d1-a3cc-97af02df4276 tempest-VolumesSnapshotsTestJSON-325179961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b95e98f0-f258-41a4-b9fd-c8c23912818d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '821df5af-6f78-4dcf-aabc-16c35b2e1ee3', 'volume_name': 'volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:21:57 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-dd41efb3-157e-47d5-8089-ef975dcc9bd4 req-7ca26939-2d06-44d1-a3cc-97af02df4276 tempest-VolumesSnapshotsTestJSON-325179961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efda8929-a4c2-4488-a4dd-7c6b5f89aff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:21:57 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-dd41efb3-157e-47d5-8089-ef975dcc9bd4 req-7ca26939-2d06-44d1-a3cc-97af02df4276 tempest-VolumesSnapshotsTestJSON-325179961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efda8929-a4c2-4488-a4dd-7c6b5f89aff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:21:57 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-dd41efb3-157e-47d5-8089-ef975dcc9bd4 req-7ca26939-2d06-44d1-a3cc-97af02df4276 tempest-VolumesSnapshotsTestJSON-325179961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28a09d7e-d7c3-4371-8fff-61264a7500e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:21:57 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [req-dd41efb3-157e-47d5-8089-ef975dcc9bd4 req-7ca26939-2d06-44d1-a3cc-97af02df4276 tempest-VolumesSnapshotsTestJSON-325179961 None] Volume 821df5af-6f78-4dcf-aabc-16c35b2e1ee3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3', 'volume_size': 1} Sep 03 14:21:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-dd41efb3-157e-47d5-8089-ef975dcc9bd4 req-7ca26939-2d06-44d1-a3cc-97af02df4276 tempest-VolumesSnapshotsTestJSON-325179961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:21:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-dd41efb3-157e-47d5-8089-ef975dcc9bd4 req-7ca26939-2d06-44d1-a3cc-97af02df4276 tempest-VolumesSnapshotsTestJSON-325179961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:21:57 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [req-dd41efb3-157e-47d5-8089-ef975dcc9bd4 req-7ca26939-2d06-44d1-a3cc-97af02df4276 tempest-VolumesSnapshotsTestJSON-325179961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-715657004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=821df5af-6f78-4dcf-aabc-16c35b2e1ee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a53c2438aaea40e79f23713303ff82c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:21:58Z,use_quota=True,user_id='9c80efbf314d4e62bbfb04022b3df01d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:21:57 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [req-dd41efb3-157e-47d5-8089-ef975dcc9bd4 req-7ca26939-2d06-44d1-a3cc-97af02df4276 tempest-VolumesSnapshotsTestJSON-325179961 None] Creating volume 821df5af-6f78-4dcf-aabc-16c35b2e1ee3 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:21:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-dd41efb3-157e-47d5-8089-ef975dcc9bd4 req-7ca26939-2d06-44d1-a3cc-97af02df4276 tempest-VolumesSnapshotsTestJSON-325179961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:21:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-dd41efb3-157e-47d5-8089-ef975dcc9bd4 req-7ca26939-2d06-44d1-a3cc-97af02df4276 tempest-VolumesSnapshotsTestJSON-325179961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:21:57 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [req-dd41efb3-157e-47d5-8089-ef975dcc9bd4 req-7ca26939-2d06-44d1-a3cc-97af02df4276 tempest-VolumesSnapshotsTestJSON-325179961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:21:57 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [req-dd41efb3-157e-47d5-8089-ef975dcc9bd4 req-7ca26939-2d06-44d1-a3cc-97af02df4276 tempest-VolumesSnapshotsTestJSON-325179961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:21:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-dd41efb3-157e-47d5-8089-ef975dcc9bd4 req-7ca26939-2d06-44d1-a3cc-97af02df4276 tempest-VolumesSnapshotsTestJSON-325179961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:21:57 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [req-dd41efb3-157e-47d5-8089-ef975dcc9bd4 req-7ca26939-2d06-44d1-a3cc-97af02df4276 tempest-VolumesSnapshotsTestJSON-325179961 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:21:57 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [req-dd41efb3-157e-47d5-8089-ef975dcc9bd4 req-7ca26939-2d06-44d1-a3cc-97af02df4276 tempest-VolumesSnapshotsTestJSON-325179961 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:21:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-dd41efb3-157e-47d5-8089-ef975dcc9bd4 req-7ca26939-2d06-44d1-a3cc-97af02df4276 tempest-VolumesSnapshotsTestJSON-325179961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:21:57 devstack sudo[92442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3 1073741824 Sep 03 14:21:57 devstack sudo[92442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:21:58 devstack sudo[92442]: pam_unix(sudo:session): session closed for user root Sep 03 14:21:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-dd41efb3-157e-47d5-8089-ef975dcc9bd4 req-7ca26939-2d06-44d1-a3cc-97af02df4276 tempest-VolumesSnapshotsTestJSON-325179961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3 1073741824" returned: 0 in 0.449s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:21:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-dd41efb3-157e-47d5-8089-ef975dcc9bd4 req-7ca26939-2d06-44d1-a3cc-97af02df4276 tempest-VolumesSnapshotsTestJSON-325179961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:21:58 devstack sudo[92448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3 Sep 03 14:21:58 devstack sudo[92448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:21:58 devstack sudo[92448]: pam_unix(sudo:session): session closed for user root Sep 03 14:21:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-dd41efb3-157e-47d5-8089-ef975dcc9bd4 req-7ca26939-2d06-44d1-a3cc-97af02df4276 tempest-VolumesSnapshotsTestJSON-325179961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3" returned: 0 in 0.244s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:21:58 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [req-dd41efb3-157e-47d5-8089-ef975dcc9bd4 req-7ca26939-2d06-44d1-a3cc-97af02df4276 tempest-VolumesSnapshotsTestJSON-325179961 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:21:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-dd41efb3-157e-47d5-8089-ef975dcc9bd4 req-7ca26939-2d06-44d1-a3cc-97af02df4276 tempest-VolumesSnapshotsTestJSON-325179961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:21:58 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-dd41efb3-157e-47d5-8089-ef975dcc9bd4 req-7ca26939-2d06-44d1-a3cc-97af02df4276 tempest-VolumesSnapshotsTestJSON-325179961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28a09d7e-d7c3-4371-8fff-61264a7500e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:21:58 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-dd41efb3-157e-47d5-8089-ef975dcc9bd4 req-7ca26939-2d06-44d1-a3cc-97af02df4276 tempest-VolumesSnapshotsTestJSON-325179961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (812c687f-632b-4e9f-8222-855db5fa9711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:21:58 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [req-dd41efb3-157e-47d5-8089-ef975dcc9bd4 req-7ca26939-2d06-44d1-a3cc-97af02df4276 tempest-VolumesSnapshotsTestJSON-325179961 None] Volume volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3 (821df5af-6f78-4dcf-aabc-16c35b2e1ee3): created successfully Sep 03 14:21:58 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-dd41efb3-157e-47d5-8089-ef975dcc9bd4 req-7ca26939-2d06-44d1-a3cc-97af02df4276 tempest-VolumesSnapshotsTestJSON-325179961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (812c687f-632b-4e9f-8222-855db5fa9711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:21:58 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-dd41efb3-157e-47d5-8089-ef975dcc9bd4 req-7ca26939-2d06-44d1-a3cc-97af02df4276 tempest-VolumesSnapshotsTestJSON-325179961 None] Flow 'volume_create_manager' (e45117cf-a458-472f-b34d-ca2881f7c5bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:21:58 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-dd41efb3-157e-47d5-8089-ef975dcc9bd4 req-7ca26939-2d06-44d1-a3cc-97af02df4276 tempest-VolumesSnapshotsTestJSON-325179961 None] Created volume successfully. Sep 03 14:21:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-8ace065f-4861-4823-8ab9-9d6b666740e2 req-351f6337-9907-477c-8cb7-8801cbc531bd tempest-VolumesSnapshotsTestJSON-325179961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:21:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-8ace065f-4861-4823-8ab9-9d6b666740e2 req-351f6337-9907-477c-8cb7-8801cbc531bd tempest-VolumesSnapshotsTestJSON-325179961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:21:58 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [req-8ace065f-4861-4823-8ab9-9d6b666740e2 req-351f6337-9907-477c-8cb7-8801cbc531bd tempest-VolumesSnapshotsTestJSON-325179961 None] Creating offline snapshot 8b3effc9-5800-456a-9d8d-709d22056dfd of volume 821df5af-6f78-4dcf-aabc-16c35b2e1ee3 {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:21:59 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3beca213-a3e7-4a48-acf0-e01d0e08ce30]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:21:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-8ace065f-4861-4823-8ab9-9d6b666740e2 req-351f6337-9907-477c-8cb7-8801cbc531bd tempest-VolumesSnapshotsTestJSON-325179961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:21:59 devstack sudo[92485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3 Sep 03 14:21:59 devstack sudo[92485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:21:59 devstack sudo[92485]: pam_unix(sudo:session): session closed for user root Sep 03 14:21:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-8ace065f-4861-4823-8ab9-9d6b666740e2 req-351f6337-9907-477c-8cb7-8801cbc531bd tempest-VolumesSnapshotsTestJSON-325179961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3" returned: 0 in 0.455s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:21:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-8ace065f-4861-4823-8ab9-9d6b666740e2 req-351f6337-9907-477c-8cb7-8801cbc531bd tempest-VolumesSnapshotsTestJSON-325179961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3.8b3effc9-5800-456a-9d8d-709d22056dfd 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:21:59 devstack sudo[92492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3.8b3effc9-5800-456a-9d8d-709d22056dfd 1G Sep 03 14:21:59 devstack sudo[92492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:21:59 devstack sudo[92492]: pam_unix(sudo:session): session closed for user root Sep 03 14:21:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-8ace065f-4861-4823-8ab9-9d6b666740e2 req-351f6337-9907-477c-8cb7-8801cbc531bd tempest-VolumesSnapshotsTestJSON-325179961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3.8b3effc9-5800-456a-9d8d-709d22056dfd 1G" returned: 0 in 0.382s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:21:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-8ace065f-4861-4823-8ab9-9d6b666740e2 req-351f6337-9907-477c-8cb7-8801cbc531bd tempest-VolumesSnapshotsTestJSON-325179961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3.8b3effc9-5800-456a-9d8d-709d22056dfd {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:21:59 devstack sudo[92497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3.8b3effc9-5800-456a-9d8d-709d22056dfd Sep 03 14:21:59 devstack sudo[92497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:00 devstack sudo[92497]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-8ace065f-4861-4823-8ab9-9d6b666740e2 req-351f6337-9907-477c-8cb7-8801cbc531bd tempest-VolumesSnapshotsTestJSON-325179961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3.8b3effc9-5800-456a-9d8d-709d22056dfd" returned: 0 in 0.304s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:00 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [req-8ace065f-4861-4823-8ab9-9d6b666740e2 req-351f6337-9907-477c-8cb7-8801cbc531bd tempest-VolumesSnapshotsTestJSON-325179961 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3.8b3effc9-5800-456a-9d8d-709d22056dfd is being set with open permissions: ugo+rw Sep 03 14:22:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-8ace065f-4861-4823-8ab9-9d6b666740e2 req-351f6337-9907-477c-8cb7-8801cbc531bd tempest-VolumesSnapshotsTestJSON-325179961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3.8b3effc9-5800-456a-9d8d-709d22056dfd {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:00 devstack sudo[92502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3.8b3effc9-5800-456a-9d8d-709d22056dfd Sep 03 14:22:00 devstack sudo[92502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:00 devstack sudo[92502]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-8ace065f-4861-4823-8ab9-9d6b666740e2 req-351f6337-9907-477c-8cb7-8801cbc531bd tempest-VolumesSnapshotsTestJSON-325179961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3.8b3effc9-5800-456a-9d8d-709d22056dfd" returned: 0 in 0.263s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-8ace065f-4861-4823-8ab9-9d6b666740e2 req-351f6337-9907-477c-8cb7-8801cbc531bd tempest-VolumesSnapshotsTestJSON-325179961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:00 devstack sudo[92505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3.info Sep 03 14:22:00 devstack sudo[92505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:00 devstack sudo[92505]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-8ace065f-4861-4823-8ab9-9d6b666740e2 req-351f6337-9907-477c-8cb7-8801cbc531bd tempest-VolumesSnapshotsTestJSON-325179961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3.info" returned: 0 in 0.285s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:00 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [req-8ace065f-4861-4823-8ab9-9d6b666740e2 req-351f6337-9907-477c-8cb7-8801cbc531bd tempest-VolumesSnapshotsTestJSON-325179961 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3.info is being set with open permissions: ugo+rw Sep 03 14:22:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-8ace065f-4861-4823-8ab9-9d6b666740e2 req-351f6337-9907-477c-8cb7-8801cbc531bd tempest-VolumesSnapshotsTestJSON-325179961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:00 devstack sudo[92508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3.info Sep 03 14:22:00 devstack sudo[92508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:01 devstack sudo[92508]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-8ace065f-4861-4823-8ab9-9d6b666740e2 req-351f6337-9907-477c-8cb7-8801cbc531bd tempest-VolumesSnapshotsTestJSON-325179961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3.info" returned: 0 in 0.263s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-8ace065f-4861-4823-8ab9-9d6b666740e2 req-351f6337-9907-477c-8cb7-8801cbc531bd tempest-VolumesSnapshotsTestJSON-325179961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.095s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:22:01 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-8ace065f-4861-4823-8ab9-9d6b666740e2 req-351f6337-9907-477c-8cb7-8801cbc531bd tempest-VolumesSnapshotsTestJSON-325179961 None] Create snapshot completed successfully Sep 03 14:22:01 devstack cinder-volume[87007]: DEBUG cinder.coordination [req-b9b2b1ab-2118-4ca7-bc7f-7d0f1b67a67e req-73a9115b-f893-4b54-934a-af676aea6ca9 tempest-VolumesSnapshotsTestJSON-325179961 None] Acquiring lock "cinder-8b3effc9-5800-456a-9d8d-709d22056dfd-delete_snapshot" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:22:01 devstack cinder-volume[87007]: DEBUG cinder.coordination [req-b9b2b1ab-2118-4ca7-bc7f-7d0f1b67a67e req-73a9115b-f893-4b54-934a-af676aea6ca9 tempest-VolumesSnapshotsTestJSON-325179961 None] Lock "cinder-8b3effc9-5800-456a-9d8d-709d22056dfd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:22:01 devstack cinder-volume[87007]: DEBUG cinder.coordination [req-b9b2b1ab-2118-4ca7-bc7f-7d0f1b67a67e req-73a9115b-f893-4b54-934a-af676aea6ca9 tempest-VolumesSnapshotsTestJSON-325179961 None] Acquiring lock "cinder-quobyte-821df5af-6f78-4dcf-aabc-16c35b2e1ee3" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:22:01 devstack cinder-volume[87007]: DEBUG cinder.coordination [req-b9b2b1ab-2118-4ca7-bc7f-7d0f1b67a67e req-73a9115b-f893-4b54-934a-af676aea6ca9 tempest-VolumesSnapshotsTestJSON-325179961 None] Lock "cinder-quobyte-821df5af-6f78-4dcf-aabc-16c35b2e1ee3" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:22:01 devstack cinder-volume[87007]: DEBUG cinder.coordination [req-b9b2b1ab-2118-4ca7-bc7f-7d0f1b67a67e req-73a9115b-f893-4b54-934a-af676aea6ca9 tempest-VolumesSnapshotsTestJSON-325179961 None] Acquiring lock "cinder-quobyte-8b3effc9-5800-456a-9d8d-709d22056dfd" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:22:01 devstack cinder-volume[87007]: DEBUG cinder.coordination [req-b9b2b1ab-2118-4ca7-bc7f-7d0f1b67a67e req-73a9115b-f893-4b54-934a-af676aea6ca9 tempest-VolumesSnapshotsTestJSON-325179961 None] Lock "cinder-quobyte-8b3effc9-5800-456a-9d8d-709d22056dfd" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:22:01 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [req-b9b2b1ab-2118-4ca7-bc7f-7d0f1b67a67e req-73a9115b-f893-4b54-934a-af676aea6ca9 tempest-VolumesSnapshotsTestJSON-325179961 None] Deleting offline snapshot 8b3effc9-5800-456a-9d8d-709d22056dfd of volume 821df5af-6f78-4dcf-aabc-16c35b2e1ee3 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:22:01 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [req-b9b2b1ab-2118-4ca7-bc7f-7d0f1b67a67e req-73a9115b-f893-4b54-934a-af676aea6ca9 tempest-VolumesSnapshotsTestJSON-325179961 None] snapshot_file for this snap is: volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3.8b3effc9-5800-456a-9d8d-709d22056dfd {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:22:01 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae747cf-affc-4a9d-b36e-e8f5cf6824c4]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:22:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-b9b2b1ab-2118-4ca7-bc7f-7d0f1b67a67e req-73a9115b-f893-4b54-934a-af676aea6ca9 tempest-VolumesSnapshotsTestJSON-325179961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3.8b3effc9-5800-456a-9d8d-709d22056dfd {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:01 devstack sudo[92511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3.8b3effc9-5800-456a-9d8d-709d22056dfd Sep 03 14:22:01 devstack sudo[92511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:01 devstack sudo[92511]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-b9b2b1ab-2118-4ca7-bc7f-7d0f1b67a67e req-73a9115b-f893-4b54-934a-af676aea6ca9 tempest-VolumesSnapshotsTestJSON-325179961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3.8b3effc9-5800-456a-9d8d-709d22056dfd" returned: 0 in 0.394s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:01 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [req-b9b2b1ab-2118-4ca7-bc7f-7d0f1b67a67e req-73a9115b-f893-4b54-934a-af676aea6ca9 tempest-VolumesSnapshotsTestJSON-325179961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:22:02 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[865a4e71-e0da-4753-a1bc-2f3c3fe06bc9]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:22:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-b9b2b1ab-2118-4ca7-bc7f-7d0f1b67a67e req-73a9115b-f893-4b54-934a-af676aea6ca9 tempest-VolumesSnapshotsTestJSON-325179961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:02 devstack sudo[92516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3 Sep 03 14:22:02 devstack sudo[92516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:02 devstack sudo[92516]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-b9b2b1ab-2118-4ca7-bc7f-7d0f1b67a67e req-73a9115b-f893-4b54-934a-af676aea6ca9 tempest-VolumesSnapshotsTestJSON-325179961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3" returned: 0 in 0.379s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-b9b2b1ab-2118-4ca7-bc7f-7d0f1b67a67e req-73a9115b-f893-4b54-934a-af676aea6ca9 tempest-VolumesSnapshotsTestJSON-325179961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3.8b3effc9-5800-456a-9d8d-709d22056dfd {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:02 devstack sudo[92521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3.8b3effc9-5800-456a-9d8d-709d22056dfd Sep 03 14:22:02 devstack sudo[92521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:02 devstack sudo[92521]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-b9b2b1ab-2118-4ca7-bc7f-7d0f1b67a67e req-73a9115b-f893-4b54-934a-af676aea6ca9 tempest-VolumesSnapshotsTestJSON-325179961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3.8b3effc9-5800-456a-9d8d-709d22056dfd" returned: 0 in 0.349s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-b9b2b1ab-2118-4ca7-bc7f-7d0f1b67a67e req-73a9115b-f893-4b54-934a-af676aea6ca9 tempest-VolumesSnapshotsTestJSON-325179961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3.8b3effc9-5800-456a-9d8d-709d22056dfd {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:02 devstack sudo[92526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3.8b3effc9-5800-456a-9d8d-709d22056dfd Sep 03 14:22:02 devstack sudo[92526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:02 devstack sudo[92526]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-b9b2b1ab-2118-4ca7-bc7f-7d0f1b67a67e req-73a9115b-f893-4b54-934a-af676aea6ca9 tempest-VolumesSnapshotsTestJSON-325179961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3.8b3effc9-5800-456a-9d8d-709d22056dfd" returned: 0 in 0.241s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:03 devstack cinder-volume[87007]: DEBUG cinder.coordination [req-b9b2b1ab-2118-4ca7-bc7f-7d0f1b67a67e req-73a9115b-f893-4b54-934a-af676aea6ca9 tempest-VolumesSnapshotsTestJSON-325179961 None] Lock "cinder-quobyte-8b3effc9-5800-456a-9d8d-709d22056dfd" released by "_delete_snapshot" :: held 1.496s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:22:03 devstack cinder-volume[87007]: DEBUG cinder.coordination [req-b9b2b1ab-2118-4ca7-bc7f-7d0f1b67a67e req-73a9115b-f893-4b54-934a-af676aea6ca9 tempest-VolumesSnapshotsTestJSON-325179961 None] Lock "cinder-quobyte-821df5af-6f78-4dcf-aabc-16c35b2e1ee3" released by "delete_snapshot" :: held 1.527s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:22:03 devstack cinder-volume[87007]: WARNING cinder.quota [req-b9b2b1ab-2118-4ca7-bc7f-7d0f1b67a67e req-73a9115b-f893-4b54-934a-af676aea6ca9 tempest-VolumesSnapshotsTestJSON-325179961 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 03 14:22:03 devstack cinder-volume[87007]: DEBUG cinder.quota [req-b9b2b1ab-2118-4ca7-bc7f-7d0f1b67a67e req-73a9115b-f893-4b54-934a-af676aea6ca9 tempest-VolumesSnapshotsTestJSON-325179961 None] Created reservations ['d69f17a0-f809-48db-b4c5-b0120cb83cd5', 'ee75f9ee-11d2-4178-ad0f-140bba697802', '62489a86-44f1-4286-88ec-ad5cb635c559', '35a2ddc4-11ae-49be-9b3a-a33ef8b6192d'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:22:03 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-b9b2b1ab-2118-4ca7-bc7f-7d0f1b67a67e req-73a9115b-f893-4b54-934a-af676aea6ca9 tempest-VolumesSnapshotsTestJSON-325179961 None] Delete snapshot completed successfully. Sep 03 14:22:03 devstack cinder-volume[87007]: DEBUG cinder.coordination [req-b9b2b1ab-2118-4ca7-bc7f-7d0f1b67a67e req-73a9115b-f893-4b54-934a-af676aea6ca9 tempest-VolumesSnapshotsTestJSON-325179961 None] Lock "cinder-8b3effc9-5800-456a-9d8d-709d22056dfd-delete_snapshot" released by "delete_snapshot" :: held 1.695s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:22:03 devstack cinder-volume[87007]: DEBUG cinder.coordination [req-5b66a357-5085-4ceb-925e-e0fe3fc90d9c req-456e616e-1b47-4176-9459-7e106e5fb17e tempest-VolumesSnapshotsTestJSON-325179961 None] Acquiring lock "cinder-821df5af-6f78-4dcf-aabc-16c35b2e1ee3-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:22:03 devstack cinder-volume[87007]: DEBUG cinder.coordination [req-5b66a357-5085-4ceb-925e-e0fe3fc90d9c req-456e616e-1b47-4176-9459-7e106e5fb17e tempest-VolumesSnapshotsTestJSON-325179961 None] Lock "cinder-821df5af-6f78-4dcf-aabc-16c35b2e1ee3-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:22:03 devstack cinder-volume[87007]: DEBUG cinder.coordination [req-5b66a357-5085-4ceb-925e-e0fe3fc90d9c req-456e616e-1b47-4176-9459-7e106e5fb17e tempest-VolumesSnapshotsTestJSON-325179961 None] Acquiring lock "cinder-quobyte-821df5af-6f78-4dcf-aabc-16c35b2e1ee3" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:22:03 devstack cinder-volume[87007]: DEBUG cinder.coordination [req-5b66a357-5085-4ceb-925e-e0fe3fc90d9c req-456e616e-1b47-4176-9459-7e106e5fb17e tempest-VolumesSnapshotsTestJSON-325179961 None] Lock "cinder-quobyte-821df5af-6f78-4dcf-aabc-16c35b2e1ee3" acquired by "delete_volume" :: waited 0.057s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:22:04 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[869b8dd2-a271-4f34-bb80-fa80600423df]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:22:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-5b66a357-5085-4ceb-925e-e0fe3fc90d9c req-456e616e-1b47-4176-9459-7e106e5fb17e tempest-VolumesSnapshotsTestJSON-325179961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:04 devstack sudo[92548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3 Sep 03 14:22:04 devstack sudo[92548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:04 devstack sudo[92548]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-5b66a357-5085-4ceb-925e-e0fe3fc90d9c req-456e616e-1b47-4176-9459-7e106e5fb17e tempest-VolumesSnapshotsTestJSON-325179961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3" returned: 0 in 0.571s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-5b66a357-5085-4ceb-925e-e0fe3fc90d9c req-456e616e-1b47-4176-9459-7e106e5fb17e tempest-VolumesSnapshotsTestJSON-325179961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:04 devstack sudo[92559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3 Sep 03 14:22:04 devstack sudo[92559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:05 devstack sudo[92559]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-5b66a357-5085-4ceb-925e-e0fe3fc90d9c req-456e616e-1b47-4176-9459-7e106e5fb17e tempest-VolumesSnapshotsTestJSON-325179961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-821df5af-6f78-4dcf-aabc-16c35b2e1ee3" returned: 0 in 0.380s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:05 devstack cinder-volume[87007]: DEBUG cinder.coordination [req-5b66a357-5085-4ceb-925e-e0fe3fc90d9c req-456e616e-1b47-4176-9459-7e106e5fb17e tempest-VolumesSnapshotsTestJSON-325179961 None] Lock "cinder-quobyte-821df5af-6f78-4dcf-aabc-16c35b2e1ee3" released by "delete_volume" :: held 1.152s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:22:05 devstack cinder-volume[87007]: DEBUG cinder.quota [req-5b66a357-5085-4ceb-925e-e0fe3fc90d9c req-456e616e-1b47-4176-9459-7e106e5fb17e tempest-VolumesSnapshotsTestJSON-325179961 None] Created reservations ['b56b49d3-21c9-4f6c-babb-f063068d3831', 'f75e2804-b445-4a68-9f9c-dbf8a0ef2175', '8b6df8dd-974a-45fe-ae9e-93a88b4c08ac', '1433b6b9-a521-43ad-93f3-25ccaf483fce'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:22:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-5b66a357-5085-4ceb-925e-e0fe3fc90d9c req-456e616e-1b47-4176-9459-7e106e5fb17e tempest-VolumesSnapshotsTestJSON-325179961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:22:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-5b66a357-5085-4ceb-925e-e0fe3fc90d9c req-456e616e-1b47-4176-9459-7e106e5fb17e tempest-VolumesSnapshotsTestJSON-325179961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:22:05 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [req-5b66a357-5085-4ceb-925e-e0fe3fc90d9c req-456e616e-1b47-4176-9459-7e106e5fb17e tempest-VolumesSnapshotsTestJSON-325179961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:22:05 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [req-5b66a357-5085-4ceb-925e-e0fe3fc90d9c req-456e616e-1b47-4176-9459-7e106e5fb17e tempest-VolumesSnapshotsTestJSON-325179961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:22:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-5b66a357-5085-4ceb-925e-e0fe3fc90d9c req-456e616e-1b47-4176-9459-7e106e5fb17e tempest-VolumesSnapshotsTestJSON-325179961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:22:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-5b66a357-5085-4ceb-925e-e0fe3fc90d9c req-456e616e-1b47-4176-9459-7e106e5fb17e tempest-VolumesSnapshotsTestJSON-325179961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:05 devstack sudo[92564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:22:05 devstack sudo[92564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:05 devstack sudo[92564]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-5b66a357-5085-4ceb-925e-e0fe3fc90d9c req-456e616e-1b47-4176-9459-7e106e5fb17e tempest-VolumesSnapshotsTestJSON-325179961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.319s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:05 devstack cinder-volume[87007]: DEBUG cinder.manager [req-5b66a357-5085-4ceb-925e-e0fe3fc90d9c req-456e616e-1b47-4176-9459-7e106e5fb17e tempest-VolumesSnapshotsTestJSON-325179961 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:22:05 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-5b66a357-5085-4ceb-925e-e0fe3fc90d9c req-456e616e-1b47-4176-9459-7e106e5fb17e tempest-VolumesSnapshotsTestJSON-325179961 None] Deleted volume successfully. Sep 03 14:22:05 devstack cinder-volume[87007]: DEBUG cinder.coordination [req-5b66a357-5085-4ceb-925e-e0fe3fc90d9c req-456e616e-1b47-4176-9459-7e106e5fb17e tempest-VolumesSnapshotsTestJSON-325179961 None] Lock "cinder-821df5af-6f78-4dcf-aabc-16c35b2e1ee3-delete_volume" released by "delete_volume" :: held 1.875s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:22:07 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8b56f0ff-93b0-4507-a013-73b2b29b00c9 tempest-AttachVolumeShelveTestJSON-245678517 None] Acquiring lock "cinder-bbe5c213-ef35-4f88-95da-11356ec91d49-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:22:07 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8b56f0ff-93b0-4507-a013-73b2b29b00c9 tempest-AttachVolumeShelveTestJSON-245678517 None] Lock "cinder-bbe5c213-ef35-4f88-95da-11356ec91d49-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:22:07 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8b56f0ff-93b0-4507-a013-73b2b29b00c9 tempest-AttachVolumeShelveTestJSON-245678517 None] Acquiring lock "cinder-quobyte-bbe5c213-ef35-4f88-95da-11356ec91d49" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:22:07 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8b56f0ff-93b0-4507-a013-73b2b29b00c9 tempest-AttachVolumeShelveTestJSON-245678517 None] Lock "cinder-quobyte-bbe5c213-ef35-4f88-95da-11356ec91d49" acquired by "delete_volume" :: waited 0.020s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:22:07 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcdb5dbf-f321-4ae2-a86d-0b61df851de7]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:22:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8b56f0ff-93b0-4507-a013-73b2b29b00c9 tempest-AttachVolumeShelveTestJSON-245678517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bbe5c213-ef35-4f88-95da-11356ec91d49 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:07 devstack sudo[92608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bbe5c213-ef35-4f88-95da-11356ec91d49 Sep 03 14:22:07 devstack sudo[92608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:08 devstack sudo[92608]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8b56f0ff-93b0-4507-a013-73b2b29b00c9 tempest-AttachVolumeShelveTestJSON-245678517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bbe5c213-ef35-4f88-95da-11356ec91d49" returned: 0 in 0.433s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8b56f0ff-93b0-4507-a013-73b2b29b00c9 tempest-AttachVolumeShelveTestJSON-245678517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bbe5c213-ef35-4f88-95da-11356ec91d49 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:08 devstack sudo[92613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bbe5c213-ef35-4f88-95da-11356ec91d49 Sep 03 14:22:08 devstack sudo[92613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:08 devstack sudo[92613]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8b56f0ff-93b0-4507-a013-73b2b29b00c9 tempest-AttachVolumeShelveTestJSON-245678517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bbe5c213-ef35-4f88-95da-11356ec91d49" returned: 0 in 0.286s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:08 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8b56f0ff-93b0-4507-a013-73b2b29b00c9 tempest-AttachVolumeShelveTestJSON-245678517 None] Lock "cinder-quobyte-bbe5c213-ef35-4f88-95da-11356ec91d49" released by "delete_volume" :: held 0.771s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:22:08 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-8b56f0ff-93b0-4507-a013-73b2b29b00c9 tempest-AttachVolumeShelveTestJSON-245678517 None] Created reservations ['6924252e-2f38-4071-ad1b-1e4a7345702e', '0535f126-cce9-416e-864e-8a1e7cddec1d', '91eb10f3-31db-4b44-ab67-4d65bc19300d', '495d06f1-7b96-419f-a1b0-39381342b03b'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:22:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8b56f0ff-93b0-4507-a013-73b2b29b00c9 tempest-AttachVolumeShelveTestJSON-245678517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:22:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8b56f0ff-93b0-4507-a013-73b2b29b00c9 tempest-AttachVolumeShelveTestJSON-245678517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:22:08 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-8b56f0ff-93b0-4507-a013-73b2b29b00c9 tempest-AttachVolumeShelveTestJSON-245678517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:22:08 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-8b56f0ff-93b0-4507-a013-73b2b29b00c9 tempest-AttachVolumeShelveTestJSON-245678517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:22:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8b56f0ff-93b0-4507-a013-73b2b29b00c9 tempest-AttachVolumeShelveTestJSON-245678517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:22:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8b56f0ff-93b0-4507-a013-73b2b29b00c9 tempest-AttachVolumeShelveTestJSON-245678517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:08 devstack sudo[92617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:22:08 devstack sudo[92617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:08 devstack sudo[92617]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8b56f0ff-93b0-4507-a013-73b2b29b00c9 tempest-AttachVolumeShelveTestJSON-245678517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.279s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:08 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-8b56f0ff-93b0-4507-a013-73b2b29b00c9 tempest-AttachVolumeShelveTestJSON-245678517 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:22:08 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-8b56f0ff-93b0-4507-a013-73b2b29b00c9 tempest-AttachVolumeShelveTestJSON-245678517 None] Deleted volume successfully. Sep 03 14:22:08 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8b56f0ff-93b0-4507-a013-73b2b29b00c9 tempest-AttachVolumeShelveTestJSON-245678517 None] Lock "cinder-bbe5c213-ef35-4f88-95da-11356ec91d49-delete_volume" released by "delete_volume" :: held 1.266s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:22:17 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-8b4a04ff-5d1f-41aa-80cf-e295e646dc96 tempest-GroupSnapshotsTest-801703735 None] Group tempest-GroupSnapshotsTest-Group-212390117: creating Sep 03 14:22:17 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-8b4a04ff-5d1f-41aa-80cf-e295e646dc96 tempest-GroupSnapshotsTest-801703735 None] Group tempest-GroupSnapshotsTest-Group-212390117: created successfully Sep 03 14:22:17 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-8b4a04ff-5d1f-41aa-80cf-e295e646dc96 tempest-GroupSnapshotsTest-801703735 None] Create group completed successfully. Sep 03 14:22:17 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-e74e0d31-0c35-4bbd-ab04-c5eb13d1d0de tempest-AttachVolumeTestJSON-1766853988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:22:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e74e0d31-0c35-4bbd-ab04-c5eb13d1d0de tempest-AttachVolumeTestJSON-1766853988 None] Flow 'volume_create_manager' (28017941-9dbf-4ad2-baf5-7344c7601333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:22:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e74e0d31-0c35-4bbd-ab04-c5eb13d1d0de tempest-AttachVolumeTestJSON-1766853988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f0da760-8b59-4ab6-a8a4-53bc03db0294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e74e0d31-0c35-4bbd-ab04-c5eb13d1d0de tempest-AttachVolumeTestJSON-1766853988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f0da760-8b59-4ab6-a8a4-53bc03db0294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-62640959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a2280bd-a309-4de5-b092-d5d3606da127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9786a2cfe4a246d5bc23e4df6064f5bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:22:18Z,use_quota=True,user_id='f844973d9a8046efb2a11b4b7ee420b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e74e0d31-0c35-4bbd-ab04-c5eb13d1d0de tempest-AttachVolumeTestJSON-1766853988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac9dc49a-e475-4c38-90b2-9b267df1fc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e74e0d31-0c35-4bbd-ab04-c5eb13d1d0de tempest-AttachVolumeTestJSON-1766853988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac9dc49a-e475-4c38-90b2-9b267df1fc78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e74e0d31-0c35-4bbd-ab04-c5eb13d1d0de tempest-AttachVolumeTestJSON-1766853988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5485524-3327-4960-b43d-122243d5b928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e74e0d31-0c35-4bbd-ab04-c5eb13d1d0de tempest-AttachVolumeTestJSON-1766853988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5485524-3327-4960-b43d-122243d5b928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a2280bd-a309-4de5-b092-d5d3606da127', 'volume_name': 'volume-3a2280bd-a309-4de5-b092-d5d3606da127', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e74e0d31-0c35-4bbd-ab04-c5eb13d1d0de tempest-AttachVolumeTestJSON-1766853988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c33c5def-97d4-42dd-bf1c-2a99f9e34af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e74e0d31-0c35-4bbd-ab04-c5eb13d1d0de tempest-AttachVolumeTestJSON-1766853988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c33c5def-97d4-42dd-bf1c-2a99f9e34af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e74e0d31-0c35-4bbd-ab04-c5eb13d1d0de tempest-AttachVolumeTestJSON-1766853988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35557cfe-262b-4367-b5f7-7af0b96748f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:17 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-e74e0d31-0c35-4bbd-ab04-c5eb13d1d0de tempest-AttachVolumeTestJSON-1766853988 None] Volume 3a2280bd-a309-4de5-b092-d5d3606da127: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a2280bd-a309-4de5-b092-d5d3606da127', 'volume_size': 1} Sep 03 14:22:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-e74e0d31-0c35-4bbd-ab04-c5eb13d1d0de tempest-AttachVolumeTestJSON-1766853988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:22:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-e74e0d31-0c35-4bbd-ab04-c5eb13d1d0de tempest-AttachVolumeTestJSON-1766853988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:22:17 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-e74e0d31-0c35-4bbd-ab04-c5eb13d1d0de tempest-AttachVolumeTestJSON-1766853988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-62640959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a2280bd-a309-4de5-b092-d5d3606da127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9786a2cfe4a246d5bc23e4df6064f5bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:22:18Z,use_quota=True,user_id='f844973d9a8046efb2a11b4b7ee420b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:22:17 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-e74e0d31-0c35-4bbd-ab04-c5eb13d1d0de tempest-AttachVolumeTestJSON-1766853988 None] Creating volume 3a2280bd-a309-4de5-b092-d5d3606da127 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:22:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-e74e0d31-0c35-4bbd-ab04-c5eb13d1d0de tempest-AttachVolumeTestJSON-1766853988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:22:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-e74e0d31-0c35-4bbd-ab04-c5eb13d1d0de tempest-AttachVolumeTestJSON-1766853988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:22:17 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-e74e0d31-0c35-4bbd-ab04-c5eb13d1d0de tempest-AttachVolumeTestJSON-1766853988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:22:17 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-e74e0d31-0c35-4bbd-ab04-c5eb13d1d0de tempest-AttachVolumeTestJSON-1766853988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:22:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-e74e0d31-0c35-4bbd-ab04-c5eb13d1d0de tempest-AttachVolumeTestJSON-1766853988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:22:17 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-e74e0d31-0c35-4bbd-ab04-c5eb13d1d0de tempest-AttachVolumeTestJSON-1766853988 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:22:17 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-e74e0d31-0c35-4bbd-ab04-c5eb13d1d0de tempest-AttachVolumeTestJSON-1766853988 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:22:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e74e0d31-0c35-4bbd-ab04-c5eb13d1d0de tempest-AttachVolumeTestJSON-1766853988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a2280bd-a309-4de5-b092-d5d3606da127 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:17 devstack sudo[92655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a2280bd-a309-4de5-b092-d5d3606da127 1073741824 Sep 03 14:22:17 devstack sudo[92655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:18 devstack sudo[92655]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e74e0d31-0c35-4bbd-ab04-c5eb13d1d0de tempest-AttachVolumeTestJSON-1766853988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a2280bd-a309-4de5-b092-d5d3606da127 1073741824" returned: 0 in 0.773s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e74e0d31-0c35-4bbd-ab04-c5eb13d1d0de tempest-AttachVolumeTestJSON-1766853988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a2280bd-a309-4de5-b092-d5d3606da127 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:18 devstack sudo[92683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a2280bd-a309-4de5-b092-d5d3606da127 Sep 03 14:22:18 devstack sudo[92683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:18 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-97d5c703-cdb1-4530-a29b-17df8b8edae5 tempest-VolumeQuotasAdminTestJSON-358516304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:22:18 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-97d5c703-cdb1-4530-a29b-17df8b8edae5 tempest-VolumeQuotasAdminTestJSON-358516304 None] Flow 'volume_create_manager' (f0f71462-068f-48ed-821d-c97d201d436d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:22:18 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-97d5c703-cdb1-4530-a29b-17df8b8edae5 tempest-VolumeQuotasAdminTestJSON-358516304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe3e18d9-575b-4023-ad9b-551e8dbd88f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:18 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-97d5c703-cdb1-4530-a29b-17df8b8edae5 tempest-VolumeQuotasAdminTestJSON-358516304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe3e18d9-575b-4023-ad9b-551e8dbd88f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2084027431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18d7e551-1aa2-4961-9dd5-9b30646f1253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7329043b33b40e3aaf89bbb2d0bbd2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:22:19Z,use_quota=True,user_id='f543d3e0835a417bb820a15dd049497a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:18 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-97d5c703-cdb1-4530-a29b-17df8b8edae5 tempest-VolumeQuotasAdminTestJSON-358516304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9e9fa58-1257-4dac-b9ef-8761788109b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:18 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-97d5c703-cdb1-4530-a29b-17df8b8edae5 tempest-VolumeQuotasAdminTestJSON-358516304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9e9fa58-1257-4dac-b9ef-8761788109b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:18 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-97d5c703-cdb1-4530-a29b-17df8b8edae5 tempest-VolumeQuotasAdminTestJSON-358516304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (329fdfa9-c195-4f66-8865-7ec80a27a939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:18 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-97d5c703-cdb1-4530-a29b-17df8b8edae5 tempest-VolumeQuotasAdminTestJSON-358516304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (329fdfa9-c195-4f66-8865-7ec80a27a939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18d7e551-1aa2-4961-9dd5-9b30646f1253', 'volume_name': 'volume-18d7e551-1aa2-4961-9dd5-9b30646f1253', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:18 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-97d5c703-cdb1-4530-a29b-17df8b8edae5 tempest-VolumeQuotasAdminTestJSON-358516304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a958606b-ee01-47dd-88bf-72d3cd73a523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:18 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-97d5c703-cdb1-4530-a29b-17df8b8edae5 tempest-VolumeQuotasAdminTestJSON-358516304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a958606b-ee01-47dd-88bf-72d3cd73a523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:18 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-97d5c703-cdb1-4530-a29b-17df8b8edae5 tempest-VolumeQuotasAdminTestJSON-358516304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc29afbd-adfa-48f4-8c9f-0792c675f781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:18 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-97d5c703-cdb1-4530-a29b-17df8b8edae5 tempest-VolumeQuotasAdminTestJSON-358516304 None] Volume 18d7e551-1aa2-4961-9dd5-9b30646f1253: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18d7e551-1aa2-4961-9dd5-9b30646f1253', 'volume_size': 1} Sep 03 14:22:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-97d5c703-cdb1-4530-a29b-17df8b8edae5 tempest-VolumeQuotasAdminTestJSON-358516304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:22:19 devstack sudo[92683]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e74e0d31-0c35-4bbd-ab04-c5eb13d1d0de tempest-AttachVolumeTestJSON-1766853988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a2280bd-a309-4de5-b092-d5d3606da127" returned: 0 in 0.538s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:19 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-e74e0d31-0c35-4bbd-ab04-c5eb13d1d0de tempest-AttachVolumeTestJSON-1766853988 None] <== create_volume: return (1388ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:22:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-e74e0d31-0c35-4bbd-ab04-c5eb13d1d0de tempest-AttachVolumeTestJSON-1766853988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.391s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:22:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-97d5c703-cdb1-4530-a29b-17df8b8edae5 tempest-VolumeQuotasAdminTestJSON-358516304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.318s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:22:19 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-97d5c703-cdb1-4530-a29b-17df8b8edae5 tempest-VolumeQuotasAdminTestJSON-358516304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2084027431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18d7e551-1aa2-4961-9dd5-9b30646f1253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7329043b33b40e3aaf89bbb2d0bbd2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:22:19Z,use_quota=True,user_id='f543d3e0835a417bb820a15dd049497a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:22:19 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-97d5c703-cdb1-4530-a29b-17df8b8edae5 tempest-VolumeQuotasAdminTestJSON-358516304 None] Creating volume 18d7e551-1aa2-4961-9dd5-9b30646f1253 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:22:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-97d5c703-cdb1-4530-a29b-17df8b8edae5 tempest-VolumeQuotasAdminTestJSON-358516304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:22:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-97d5c703-cdb1-4530-a29b-17df8b8edae5 tempest-VolumeQuotasAdminTestJSON-358516304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:22:19 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-97d5c703-cdb1-4530-a29b-17df8b8edae5 tempest-VolumeQuotasAdminTestJSON-358516304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:22:19 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-97d5c703-cdb1-4530-a29b-17df8b8edae5 tempest-VolumeQuotasAdminTestJSON-358516304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:22:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-97d5c703-cdb1-4530-a29b-17df8b8edae5 tempest-VolumeQuotasAdminTestJSON-358516304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:22:19 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-97d5c703-cdb1-4530-a29b-17df8b8edae5 tempest-VolumeQuotasAdminTestJSON-358516304 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:22:19 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-97d5c703-cdb1-4530-a29b-17df8b8edae5 tempest-VolumeQuotasAdminTestJSON-358516304 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:22:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-97d5c703-cdb1-4530-a29b-17df8b8edae5 tempest-VolumeQuotasAdminTestJSON-358516304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-18d7e551-1aa2-4961-9dd5-9b30646f1253 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:19 devstack sudo[92687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-18d7e551-1aa2-4961-9dd5-9b30646f1253 1073741824 Sep 03 14:22:19 devstack sudo[92687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:19 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e74e0d31-0c35-4bbd-ab04-c5eb13d1d0de tempest-AttachVolumeTestJSON-1766853988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35557cfe-262b-4367-b5f7-7af0b96748f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a2280bd-a309-4de5-b092-d5d3606da127', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:19 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e74e0d31-0c35-4bbd-ab04-c5eb13d1d0de tempest-AttachVolumeTestJSON-1766853988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c02edfe9-9bfb-40d7-9398-32003ccdb0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:19 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-e74e0d31-0c35-4bbd-ab04-c5eb13d1d0de tempest-AttachVolumeTestJSON-1766853988 None] Volume volume-3a2280bd-a309-4de5-b092-d5d3606da127 (3a2280bd-a309-4de5-b092-d5d3606da127): created successfully Sep 03 14:22:19 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e74e0d31-0c35-4bbd-ab04-c5eb13d1d0de tempest-AttachVolumeTestJSON-1766853988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c02edfe9-9bfb-40d7-9398-32003ccdb0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:19 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e74e0d31-0c35-4bbd-ab04-c5eb13d1d0de tempest-AttachVolumeTestJSON-1766853988 None] Flow 'volume_create_manager' (28017941-9dbf-4ad2-baf5-7344c7601333) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:22:19 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-1644126b-bf28-4ed9-97c6-bf03eddea8d3 tempest-GroupSnapshotsTest-801703735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:22:19 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-1644126b-bf28-4ed9-97c6-bf03eddea8d3 tempest-GroupSnapshotsTest-801703735 None] Flow 'volume_create_manager' (aeb3cbf0-e0f2-494d-9030-318d9f44ce60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:22:19 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-1644126b-bf28-4ed9-97c6-bf03eddea8d3 tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c69dcd6e-ff72-484f-972a-204d29f5a0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:19 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-e74e0d31-0c35-4bbd-ab04-c5eb13d1d0de tempest-AttachVolumeTestJSON-1766853988 None] Created volume successfully. Sep 03 14:22:19 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-1644126b-bf28-4ed9-97c6-bf03eddea8d3 tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c69dcd6e-ff72-484f-972a-204d29f5a0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1145869222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=94972638-cef4-4f25-bd7d-05e2bf20f9a4,host='devstack@QuobyteHD#QuobyteHD',id=b045b5de-902d-4f43-93d0-3ff551befa90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f1cf5b0021e4dcda66d166da40bcd1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:22:19Z,use_quota=True,user_id='773b6757a7aa43e39b1dd5179e480f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5f8d838-a16a-429d-9614-69b4c4389c94),volume_type_id=c5f8d838-a16a-429d-9614-69b4c4389c94)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:19 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-1644126b-bf28-4ed9-97c6-bf03eddea8d3 tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d117273c-aecb-4bff-9bc3-547fe1cce638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:19 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-1644126b-bf28-4ed9-97c6-bf03eddea8d3 tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d117273c-aecb-4bff-9bc3-547fe1cce638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:19 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-1644126b-bf28-4ed9-97c6-bf03eddea8d3 tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d003df7-1840-49ad-be8f-fea3c3b41ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:19 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-1644126b-bf28-4ed9-97c6-bf03eddea8d3 tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d003df7-1840-49ad-be8f-fea3c3b41ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b045b5de-902d-4f43-93d0-3ff551befa90', 'volume_name': 'volume-b045b5de-902d-4f43-93d0-3ff551befa90', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:19 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-1644126b-bf28-4ed9-97c6-bf03eddea8d3 tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1168baf5-d674-43f5-9525-a89ec74fcdb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:19 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-1644126b-bf28-4ed9-97c6-bf03eddea8d3 tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1168baf5-d674-43f5-9525-a89ec74fcdb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:19 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-1644126b-bf28-4ed9-97c6-bf03eddea8d3 tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c52cd0fd-a9f6-4b9d-ab63-f9e42b15b6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:19 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-1644126b-bf28-4ed9-97c6-bf03eddea8d3 tempest-GroupSnapshotsTest-801703735 None] Volume b045b5de-902d-4f43-93d0-3ff551befa90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b045b5de-902d-4f43-93d0-3ff551befa90', 'volume_size': 1} Sep 03 14:22:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1644126b-bf28-4ed9-97c6-bf03eddea8d3 tempest-GroupSnapshotsTest-801703735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:22:19 devstack sudo[92687]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-97d5c703-cdb1-4530-a29b-17df8b8edae5 tempest-VolumeQuotasAdminTestJSON-358516304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-18d7e551-1aa2-4961-9dd5-9b30646f1253 1073741824" returned: 0 in 0.416s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-97d5c703-cdb1-4530-a29b-17df8b8edae5 tempest-VolumeQuotasAdminTestJSON-358516304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-18d7e551-1aa2-4961-9dd5-9b30646f1253 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:19 devstack sudo[92693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-18d7e551-1aa2-4961-9dd5-9b30646f1253 Sep 03 14:22:19 devstack sudo[92693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:19 devstack sudo[92693]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-97d5c703-cdb1-4530-a29b-17df8b8edae5 tempest-VolumeQuotasAdminTestJSON-358516304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-18d7e551-1aa2-4961-9dd5-9b30646f1253" returned: 0 in 0.286s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:19 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-97d5c703-cdb1-4530-a29b-17df8b8edae5 tempest-VolumeQuotasAdminTestJSON-358516304 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:22:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-97d5c703-cdb1-4530-a29b-17df8b8edae5 tempest-VolumeQuotasAdminTestJSON-358516304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:22:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1644126b-bf28-4ed9-97c6-bf03eddea8d3 tempest-GroupSnapshotsTest-801703735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.573s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:22:19 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-1644126b-bf28-4ed9-97c6-bf03eddea8d3 tempest-GroupSnapshotsTest-801703735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=94972638-cef4-4f25-bd7d-05e2bf20f9a4,created_at=2026-09-03T12:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1145869222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=94972638-cef4-4f25-bd7d-05e2bf20f9a4,host='devstack@QuobyteHD#QuobyteHD',id=b045b5de-902d-4f43-93d0-3ff551befa90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f1cf5b0021e4dcda66d166da40bcd1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:22:19Z,use_quota=True,user_id='773b6757a7aa43e39b1dd5179e480f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5f8d838-a16a-429d-9614-69b4c4389c94),volume_type_id=c5f8d838-a16a-429d-9614-69b4c4389c94)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:22:19 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-1644126b-bf28-4ed9-97c6-bf03eddea8d3 tempest-GroupSnapshotsTest-801703735 None] Creating volume b045b5de-902d-4f43-93d0-3ff551befa90 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:22:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1644126b-bf28-4ed9-97c6-bf03eddea8d3 tempest-GroupSnapshotsTest-801703735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:22:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1644126b-bf28-4ed9-97c6-bf03eddea8d3 tempest-GroupSnapshotsTest-801703735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:22:19 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-1644126b-bf28-4ed9-97c6-bf03eddea8d3 tempest-GroupSnapshotsTest-801703735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:22:19 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-1644126b-bf28-4ed9-97c6-bf03eddea8d3 tempest-GroupSnapshotsTest-801703735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:22:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1644126b-bf28-4ed9-97c6-bf03eddea8d3 tempest-GroupSnapshotsTest-801703735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:22:19 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-1644126b-bf28-4ed9-97c6-bf03eddea8d3 tempest-GroupSnapshotsTest-801703735 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:22:19 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-1644126b-bf28-4ed9-97c6-bf03eddea8d3 tempest-GroupSnapshotsTest-801703735 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:22:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1644126b-bf28-4ed9-97c6-bf03eddea8d3 tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:19 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-97d5c703-cdb1-4530-a29b-17df8b8edae5 tempest-VolumeQuotasAdminTestJSON-358516304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc29afbd-adfa-48f4-8c9f-0792c675f781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18d7e551-1aa2-4961-9dd5-9b30646f1253', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:19 devstack sudo[92700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90 1073741824 Sep 03 14:22:19 devstack sudo[92700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:19 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-97d5c703-cdb1-4530-a29b-17df8b8edae5 tempest-VolumeQuotasAdminTestJSON-358516304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84e0daf8-3aa1-42e4-bfd4-be7f5dddede2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:20 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-97d5c703-cdb1-4530-a29b-17df8b8edae5 tempest-VolumeQuotasAdminTestJSON-358516304 None] Volume volume-18d7e551-1aa2-4961-9dd5-9b30646f1253 (18d7e551-1aa2-4961-9dd5-9b30646f1253): created successfully Sep 03 14:22:20 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-97d5c703-cdb1-4530-a29b-17df8b8edae5 tempest-VolumeQuotasAdminTestJSON-358516304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84e0daf8-3aa1-42e4-bfd4-be7f5dddede2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:20 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-97d5c703-cdb1-4530-a29b-17df8b8edae5 tempest-VolumeQuotasAdminTestJSON-358516304 None] Flow 'volume_create_manager' (f0f71462-068f-48ed-821d-c97d201d436d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:22:20 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-97d5c703-cdb1-4530-a29b-17df8b8edae5 tempest-VolumeQuotasAdminTestJSON-358516304 None] Created volume successfully. Sep 03 14:22:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-f23f9126-019e-447d-846b-5e948b101dab req-52a091b1-e494-4ec6-beaf-8864e601aa2a tempest-AttachVolumeTestJSON-1766853988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:22:20 devstack sudo[92700]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1644126b-bf28-4ed9-97c6-bf03eddea8d3 tempest-GroupSnapshotsTest-801703735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90 1073741824" returned: 0 in 0.655s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1644126b-bf28-4ed9-97c6-bf03eddea8d3 tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:20 devstack sudo[92717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90 Sep 03 14:22:20 devstack sudo[92717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:20 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1bd7bee8-c402-4710-a8fc-208314a95f48 tempest-VolumeQuotasAdminTestJSON-358516304 None] Acquiring lock "cinder-18d7e551-1aa2-4961-9dd5-9b30646f1253-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:22:20 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1bd7bee8-c402-4710-a8fc-208314a95f48 tempest-VolumeQuotasAdminTestJSON-358516304 None] Lock "cinder-18d7e551-1aa2-4961-9dd5-9b30646f1253-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:22:20 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1bd7bee8-c402-4710-a8fc-208314a95f48 tempest-VolumeQuotasAdminTestJSON-358516304 None] Acquiring lock "cinder-quobyte-18d7e551-1aa2-4961-9dd5-9b30646f1253" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:22:20 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-b311c850-2188-445b-8acd-222b16497e40 req-dfe32b2c-6f17-4ed9-8b53-de0bc25a4ef5 tempest-ServerActionsTestOtherA-1572917712 None] Terminate volume connection completed successfully. Sep 03 14:22:20 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-b311c850-2188-445b-8acd-222b16497e40 req-dfe32b2c-6f17-4ed9-8b53-de0bc25a4ef5 tempest-ServerActionsTestOtherA-1572917712 None] Deleting attachment 807fbbe1-6db6-43f0-927b-c279dbef6806. {{(pid=87007) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 14:22:20 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1bd7bee8-c402-4710-a8fc-208314a95f48 tempest-VolumeQuotasAdminTestJSON-358516304 None] Lock "cinder-quobyte-18d7e551-1aa2-4961-9dd5-9b30646f1253" acquired by "delete_volume" :: waited 0.017s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:22:20 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fdf98c-3a14-4ac2-bcd6-c357f7433ac0]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:22:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1bd7bee8-c402-4710-a8fc-208314a95f48 tempest-VolumeQuotasAdminTestJSON-358516304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-18d7e551-1aa2-4961-9dd5-9b30646f1253 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:20 devstack sudo[92717]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1644126b-bf28-4ed9-97c6-bf03eddea8d3 tempest-GroupSnapshotsTest-801703735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90" returned: 0 in 0.275s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:20 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-1644126b-bf28-4ed9-97c6-bf03eddea8d3 tempest-GroupSnapshotsTest-801703735 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:22:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1644126b-bf28-4ed9-97c6-bf03eddea8d3 tempest-GroupSnapshotsTest-801703735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:22:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-f23f9126-019e-447d-846b-5e948b101dab req-52a091b1-e494-4ec6-beaf-8864e601aa2a tempest-AttachVolumeTestJSON-1766853988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.439s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:22:20 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-1644126b-bf28-4ed9-97c6-bf03eddea8d3 tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c52cd0fd-a9f6-4b9d-ab63-f9e42b15b6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b045b5de-902d-4f43-93d0-3ff551befa90', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:20 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-1644126b-bf28-4ed9-97c6-bf03eddea8d3 tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31af99ed-3258-4b4f-968c-c0f68be039a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-f23f9126-019e-447d-846b-5e948b101dab req-52a091b1-e494-4ec6-beaf-8864e601aa2a tempest-AttachVolumeTestJSON-1766853988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:22:20 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-1644126b-bf28-4ed9-97c6-bf03eddea8d3 tempest-GroupSnapshotsTest-801703735 None] Volume volume-b045b5de-902d-4f43-93d0-3ff551befa90 (b045b5de-902d-4f43-93d0-3ff551befa90): created successfully Sep 03 14:22:20 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-1644126b-bf28-4ed9-97c6-bf03eddea8d3 tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31af99ed-3258-4b4f-968c-c0f68be039a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:20 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-1644126b-bf28-4ed9-97c6-bf03eddea8d3 tempest-GroupSnapshotsTest-801703735 None] Flow 'volume_create_manager' (aeb3cbf0-e0f2-494d-9030-318d9f44ce60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:22:21 devstack sudo[92720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-18d7e551-1aa2-4961-9dd5-9b30646f1253 Sep 03 14:22:21 devstack sudo[92720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:21 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-1644126b-bf28-4ed9-97c6-bf03eddea8d3 tempest-GroupSnapshotsTest-801703735 None] Created volume successfully. Sep 03 14:22:21 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-f23f9126-019e-447d-846b-5e948b101dab req-52a091b1-e494-4ec6-beaf-8864e601aa2a tempest-AttachVolumeTestJSON-1766853988 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713', 'name': 'volume-3a2280bd-a309-4de5-b092-d5d3606da127', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '789cf286-2df3-454f-a616-2731219840d8', 'enforce_multipath': True} {{(pid=87007) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 14:22:21 devstack cinder-volume[87007]: DEBUG cinder.coordination [req-b311c850-2188-445b-8acd-222b16497e40 req-e4da7717-420c-4087-a5c5-8f1f880a1a91 tempest-ServerActionsTestOtherA-1572917712 None] Acquiring lock "cinder-98c331ab-eddc-45df-93b6-c5dbf0bc3fa9-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:22:21 devstack cinder-volume[87007]: DEBUG cinder.coordination [req-b311c850-2188-445b-8acd-222b16497e40 req-e4da7717-420c-4087-a5c5-8f1f880a1a91 tempest-ServerActionsTestOtherA-1572917712 None] Lock "cinder-98c331ab-eddc-45df-93b6-c5dbf0bc3fa9-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:22:21 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-f23f9126-019e-447d-846b-5e948b101dab req-52a091b1-e494-4ec6-beaf-8864e601aa2a tempest-AttachVolumeTestJSON-1766853988 None] attachment_update completed successfully. Sep 03 14:22:21 devstack cinder-volume[87007]: DEBUG cinder.coordination [req-b311c850-2188-445b-8acd-222b16497e40 req-e4da7717-420c-4087-a5c5-8f1f880a1a91 tempest-ServerActionsTestOtherA-1572917712 None] Acquiring lock "cinder-quobyte-98c331ab-eddc-45df-93b6-c5dbf0bc3fa9" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:22:21 devstack cinder-volume[87007]: DEBUG cinder.coordination [req-b311c850-2188-445b-8acd-222b16497e40 req-e4da7717-420c-4087-a5c5-8f1f880a1a91 tempest-ServerActionsTestOtherA-1572917712 None] Lock "cinder-quobyte-98c331ab-eddc-45df-93b6-c5dbf0bc3fa9" acquired by "delete_volume" :: waited 0.016s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:22:21 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3afe938-239f-4a79-a8b6-c8f8a4c2889e]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:22:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-b311c850-2188-445b-8acd-222b16497e40 req-e4da7717-420c-4087-a5c5-8f1f880a1a91 tempest-ServerActionsTestOtherA-1572917712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-98c331ab-eddc-45df-93b6-c5dbf0bc3fa9 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:21 devstack sudo[92723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-98c331ab-eddc-45df-93b6-c5dbf0bc3fa9 Sep 03 14:22:21 devstack sudo[92723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:21 devstack sudo[92720]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1bd7bee8-c402-4710-a8fc-208314a95f48 tempest-VolumeQuotasAdminTestJSON-358516304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-18d7e551-1aa2-4961-9dd5-9b30646f1253" returned: 0 in 0.450s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1bd7bee8-c402-4710-a8fc-208314a95f48 tempest-VolumeQuotasAdminTestJSON-358516304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-18d7e551-1aa2-4961-9dd5-9b30646f1253 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:21 devstack sudo[92758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-18d7e551-1aa2-4961-9dd5-9b30646f1253 Sep 03 14:22:21 devstack sudo[92758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:21 devstack sudo[92723]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-b311c850-2188-445b-8acd-222b16497e40 req-e4da7717-420c-4087-a5c5-8f1f880a1a91 tempest-ServerActionsTestOtherA-1572917712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-98c331ab-eddc-45df-93b6-c5dbf0bc3fa9" returned: 0 in 0.568s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:21 devstack sudo[92758]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-b311c850-2188-445b-8acd-222b16497e40 req-e4da7717-420c-4087-a5c5-8f1f880a1a91 tempest-ServerActionsTestOtherA-1572917712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-98c331ab-eddc-45df-93b6-c5dbf0bc3fa9 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1bd7bee8-c402-4710-a8fc-208314a95f48 tempest-VolumeQuotasAdminTestJSON-358516304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-18d7e551-1aa2-4961-9dd5-9b30646f1253" returned: 0 in 0.445s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:21 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1bd7bee8-c402-4710-a8fc-208314a95f48 tempest-VolumeQuotasAdminTestJSON-358516304 None] Lock "cinder-quobyte-18d7e551-1aa2-4961-9dd5-9b30646f1253" released by "delete_volume" :: held 0.959s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:22:21 devstack sudo[93116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-98c331ab-eddc-45df-93b6-c5dbf0bc3fa9 Sep 03 14:22:21 devstack sudo[93116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:21 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-1bd7bee8-c402-4710-a8fc-208314a95f48 tempest-VolumeQuotasAdminTestJSON-358516304 None] Created reservations ['956e55e9-9c1a-484e-800d-98707c314c42', 'fd70dcdf-7f66-40ca-b1c7-794399eb00c7', 'ee642441-a4f9-408f-a6cc-a719bf41da12', 'b9f32e73-f5ba-4f3c-9fd7-19f69b1a1646'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:22:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1bd7bee8-c402-4710-a8fc-208314a95f48 tempest-VolumeQuotasAdminTestJSON-358516304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:22:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1bd7bee8-c402-4710-a8fc-208314a95f48 tempest-VolumeQuotasAdminTestJSON-358516304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:22:22 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-1bd7bee8-c402-4710-a8fc-208314a95f48 tempest-VolumeQuotasAdminTestJSON-358516304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:22:22 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-1bd7bee8-c402-4710-a8fc-208314a95f48 tempest-VolumeQuotasAdminTestJSON-358516304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:22:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1bd7bee8-c402-4710-a8fc-208314a95f48 tempest-VolumeQuotasAdminTestJSON-358516304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:22:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1bd7bee8-c402-4710-a8fc-208314a95f48 tempest-VolumeQuotasAdminTestJSON-358516304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:22 devstack sudo[93119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:22:22 devstack sudo[93119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:22 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-bd3bbd43-43ee-440c-ba34-004e1b88f555 tempest-GroupSnapshotsTest-801703735 None] GroupSnapshot 74a96595-d175-4fc1-9e35-6e2ba7cac86b: creating. Sep 03 14:22:22 devstack sudo[93116]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-b311c850-2188-445b-8acd-222b16497e40 req-e4da7717-420c-4087-a5c5-8f1f880a1a91 tempest-ServerActionsTestOtherA-1572917712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-98c331ab-eddc-45df-93b6-c5dbf0bc3fa9" returned: 0 in 0.392s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [req-b311c850-2188-445b-8acd-222b16497e40 req-e4da7717-420c-4087-a5c5-8f1f880a1a91 tempest-ServerActionsTestOtherA-1572917712 None] Lock "cinder-quobyte-98c331ab-eddc-45df-93b6-c5dbf0bc3fa9" released by "delete_volume" :: held 1.039s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:22:22 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-bd3bbd43-43ee-440c-ba34-004e1b88f555 tempest-GroupSnapshotsTest-801703735 None] Group snapshot 74a96595-d175-4fc1-9e35-6e2ba7cac86b: creating. {{(pid=87007) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 03 14:22:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-bd3bbd43-43ee-440c-ba34-004e1b88f555 tempest-GroupSnapshotsTest-801703735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:22:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-bd3bbd43-43ee-440c-ba34-004e1b88f555 tempest-GroupSnapshotsTest-801703735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:22:22 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-bd3bbd43-43ee-440c-ba34-004e1b88f555 tempest-GroupSnapshotsTest-801703735 None] Creating offline snapshot f55aa576-35c5-43e4-a62f-ab2bd128c94c of volume b045b5de-902d-4f43-93d0-3ff551befa90 {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:22:22 devstack cinder-volume[87007]: DEBUG cinder.quota [req-b311c850-2188-445b-8acd-222b16497e40 req-e4da7717-420c-4087-a5c5-8f1f880a1a91 tempest-ServerActionsTestOtherA-1572917712 None] Created reservations ['1c9e629e-b0b2-4908-b973-26108152b5fa', 'bfc50350-9d0f-422a-a684-d7a3720e9327', '6ead7289-ad71-4dca-8bde-79cb70f2d419', '5fa4dacc-355b-4f4d-926f-6010f4937a0a'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:22:22 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a7bc02-e2c3-4161-a4bb-5adc58408ccf]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:22:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bd3bbd43-43ee-440c-ba34-004e1b88f555 tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-b311c850-2188-445b-8acd-222b16497e40 req-e4da7717-420c-4087-a5c5-8f1f880a1a91 tempest-ServerActionsTestOtherA-1572917712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:22:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-b311c850-2188-445b-8acd-222b16497e40 req-e4da7717-420c-4087-a5c5-8f1f880a1a91 tempest-ServerActionsTestOtherA-1572917712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:22:22 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [req-b311c850-2188-445b-8acd-222b16497e40 req-e4da7717-420c-4087-a5c5-8f1f880a1a91 tempest-ServerActionsTestOtherA-1572917712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:22:22 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [req-b311c850-2188-445b-8acd-222b16497e40 req-e4da7717-420c-4087-a5c5-8f1f880a1a91 tempest-ServerActionsTestOtherA-1572917712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:22:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-b311c850-2188-445b-8acd-222b16497e40 req-e4da7717-420c-4087-a5c5-8f1f880a1a91 tempest-ServerActionsTestOtherA-1572917712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:22:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-b311c850-2188-445b-8acd-222b16497e40 req-e4da7717-420c-4087-a5c5-8f1f880a1a91 tempest-ServerActionsTestOtherA-1572917712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:22 devstack sudo[93119]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1bd7bee8-c402-4710-a8fc-208314a95f48 tempest-VolumeQuotasAdminTestJSON-358516304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.422s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:22 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-1bd7bee8-c402-4710-a8fc-208314a95f48 tempest-VolumeQuotasAdminTestJSON-358516304 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:22:22 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-1bd7bee8-c402-4710-a8fc-208314a95f48 tempest-VolumeQuotasAdminTestJSON-358516304 None] Deleted volume successfully. Sep 03 14:22:22 devstack sudo[93123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:22:22 devstack sudo[93123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:22 devstack sudo[93121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90 Sep 03 14:22:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1bd7bee8-c402-4710-a8fc-208314a95f48 tempest-VolumeQuotasAdminTestJSON-358516304 None] Lock "cinder-18d7e551-1aa2-4961-9dd5-9b30646f1253-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:22:22 devstack sudo[93121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:22 devstack sudo[93123]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-b311c850-2188-445b-8acd-222b16497e40 req-e4da7717-420c-4087-a5c5-8f1f880a1a91 tempest-ServerActionsTestOtherA-1572917712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.394s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:22 devstack cinder-volume[87007]: DEBUG cinder.manager [req-b311c850-2188-445b-8acd-222b16497e40 req-e4da7717-420c-4087-a5c5-8f1f880a1a91 tempest-ServerActionsTestOtherA-1572917712 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:22:22 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-b311c850-2188-445b-8acd-222b16497e40 req-e4da7717-420c-4087-a5c5-8f1f880a1a91 tempest-ServerActionsTestOtherA-1572917712 None] Deleted volume successfully. Sep 03 14:22:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [req-b311c850-2188-445b-8acd-222b16497e40 req-e4da7717-420c-4087-a5c5-8f1f880a1a91 tempest-ServerActionsTestOtherA-1572917712 None] Lock "cinder-98c331ab-eddc-45df-93b6-c5dbf0bc3fa9-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:22:22 devstack sudo[93121]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bd3bbd43-43ee-440c-ba34-004e1b88f555 tempest-GroupSnapshotsTest-801703735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90" returned: 0 in 0.676s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bd3bbd43-43ee-440c-ba34-004e1b88f555 tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90.f55aa576-35c5-43e4-a62f-ab2bd128c94c 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:23 devstack sudo[93131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90.f55aa576-35c5-43e4-a62f-ab2bd128c94c 1G Sep 03 14:22:23 devstack sudo[93131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:23 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c8ad02b-edfc-4afa-932c-1d8aa3982d8e tempest-VolumeQuotasAdminTestJSON-358516304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:22:23 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4c8ad02b-edfc-4afa-932c-1d8aa3982d8e tempest-VolumeQuotasAdminTestJSON-358516304 None] Flow 'volume_create_manager' (eddd6c29-29d3-486f-aeb6-c685eaeb505c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:22:23 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4c8ad02b-edfc-4afa-932c-1d8aa3982d8e tempest-VolumeQuotasAdminTestJSON-358516304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0063d27d-4da0-4e5a-9bf0-eb2b2c16e715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:23 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4c8ad02b-edfc-4afa-932c-1d8aa3982d8e tempest-VolumeQuotasAdminTestJSON-358516304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0063d27d-4da0-4e5a-9bf0-eb2b2c16e715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-17723141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52389d52-942c-4e3e-beb0-714d1580be97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7329043b33b40e3aaf89bbb2d0bbd2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:22:23Z,use_quota=True,user_id='f543d3e0835a417bb820a15dd049497a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:23 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4c8ad02b-edfc-4afa-932c-1d8aa3982d8e tempest-VolumeQuotasAdminTestJSON-358516304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a4b139e-5d21-4ee4-9449-373b76c47c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:23 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4c8ad02b-edfc-4afa-932c-1d8aa3982d8e tempest-VolumeQuotasAdminTestJSON-358516304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a4b139e-5d21-4ee4-9449-373b76c47c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:23 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4c8ad02b-edfc-4afa-932c-1d8aa3982d8e tempest-VolumeQuotasAdminTestJSON-358516304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7832896-0efb-4232-ac23-e60cbc34646f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:23 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4c8ad02b-edfc-4afa-932c-1d8aa3982d8e tempest-VolumeQuotasAdminTestJSON-358516304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7832896-0efb-4232-ac23-e60cbc34646f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52389d52-942c-4e3e-beb0-714d1580be97', 'volume_name': 'volume-52389d52-942c-4e3e-beb0-714d1580be97', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:23 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4c8ad02b-edfc-4afa-932c-1d8aa3982d8e tempest-VolumeQuotasAdminTestJSON-358516304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b37cfe60-80fe-4892-8275-e96a71b1f2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:23 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4c8ad02b-edfc-4afa-932c-1d8aa3982d8e tempest-VolumeQuotasAdminTestJSON-358516304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b37cfe60-80fe-4892-8275-e96a71b1f2cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:23 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4c8ad02b-edfc-4afa-932c-1d8aa3982d8e tempest-VolumeQuotasAdminTestJSON-358516304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40a2313f-85ff-4a62-b8b1-0b1dea9ee250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:23 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-4c8ad02b-edfc-4afa-932c-1d8aa3982d8e tempest-VolumeQuotasAdminTestJSON-358516304 None] Volume 52389d52-942c-4e3e-beb0-714d1580be97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52389d52-942c-4e3e-beb0-714d1580be97', 'volume_size': 1} Sep 03 14:22:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4c8ad02b-edfc-4afa-932c-1d8aa3982d8e tempest-VolumeQuotasAdminTestJSON-358516304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:22:23 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-824bda6a-ed7d-4e03-9ac7-286057747a1f tempest-ServerActionsTestOtherA-1572917712 None] Acquiring lock "cinder-de201545-b003-4b67-bd29-0b205e1c6674-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:22:23 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-824bda6a-ed7d-4e03-9ac7-286057747a1f tempest-ServerActionsTestOtherA-1572917712 None] Lock "cinder-de201545-b003-4b67-bd29-0b205e1c6674-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:22:23 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-824bda6a-ed7d-4e03-9ac7-286057747a1f tempest-ServerActionsTestOtherA-1572917712 None] Acquiring lock "cinder-quobyte-de201545-b003-4b67-bd29-0b205e1c6674" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:22:23 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-824bda6a-ed7d-4e03-9ac7-286057747a1f tempest-ServerActionsTestOtherA-1572917712 None] Lock "cinder-quobyte-de201545-b003-4b67-bd29-0b205e1c6674" acquired by "delete_volume" :: waited 0.023s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:22:23 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[457ab25e-c43a-4b32-a312-0bf972fe2fdd]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:22:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-824bda6a-ed7d-4e03-9ac7-286057747a1f tempest-ServerActionsTestOtherA-1572917712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-de201545-b003-4b67-bd29-0b205e1c6674 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:23 devstack sudo[93140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-de201545-b003-4b67-bd29-0b205e1c6674 Sep 03 14:22:23 devstack sudo[93140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:23 devstack sudo[93131]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bd3bbd43-43ee-440c-ba34-004e1b88f555 tempest-GroupSnapshotsTest-801703735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90.f55aa576-35c5-43e4-a62f-ab2bd128c94c 1G" returned: 0 in 0.505s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bd3bbd43-43ee-440c-ba34-004e1b88f555 tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b045b5de-902d-4f43-93d0-3ff551befa90 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90.f55aa576-35c5-43e4-a62f-ab2bd128c94c {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:23 devstack sudo[93144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b045b5de-902d-4f43-93d0-3ff551befa90 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90.f55aa576-35c5-43e4-a62f-ab2bd128c94c Sep 03 14:22:23 devstack sudo[93144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:23 devstack sudo[93140]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-824bda6a-ed7d-4e03-9ac7-286057747a1f tempest-ServerActionsTestOtherA-1572917712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-de201545-b003-4b67-bd29-0b205e1c6674" returned: 0 in 0.367s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-824bda6a-ed7d-4e03-9ac7-286057747a1f tempest-ServerActionsTestOtherA-1572917712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-de201545-b003-4b67-bd29-0b205e1c6674 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:23 devstack sudo[93155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-de201545-b003-4b67-bd29-0b205e1c6674 Sep 03 14:22:23 devstack sudo[93155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:23 devstack sudo[93144]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bd3bbd43-43ee-440c-ba34-004e1b88f555 tempest-GroupSnapshotsTest-801703735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b045b5de-902d-4f43-93d0-3ff551befa90 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90.f55aa576-35c5-43e4-a62f-ab2bd128c94c" returned: 0 in 0.310s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:23 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-bd3bbd43-43ee-440c-ba34-004e1b88f555 tempest-GroupSnapshotsTest-801703735 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90.f55aa576-35c5-43e4-a62f-ab2bd128c94c is being set with open permissions: ugo+rw: NotImplementedError Sep 03 14:22:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bd3bbd43-43ee-440c-ba34-004e1b88f555 tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90.f55aa576-35c5-43e4-a62f-ab2bd128c94c {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:23 devstack sudo[93160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90.f55aa576-35c5-43e4-a62f-ab2bd128c94c Sep 03 14:22:23 devstack sudo[93160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:23 devstack sudo[93155]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-824bda6a-ed7d-4e03-9ac7-286057747a1f tempest-ServerActionsTestOtherA-1572917712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-de201545-b003-4b67-bd29-0b205e1c6674" returned: 0 in 0.239s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:23 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-824bda6a-ed7d-4e03-9ac7-286057747a1f tempest-ServerActionsTestOtherA-1572917712 None] Lock "cinder-quobyte-de201545-b003-4b67-bd29-0b205e1c6674" released by "delete_volume" :: held 0.657s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:22:23 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-824bda6a-ed7d-4e03-9ac7-286057747a1f tempest-ServerActionsTestOtherA-1572917712 None] Created reservations ['fbb5c220-8451-4270-bec9-f6288e798a8c', 'ff4734fb-eb93-456c-9e01-b1a6b02be225', '0309b9ba-f9d9-4b58-9371-f9d231a462b9', 'e1ee5dae-1c1c-47b7-a950-c1d2093b3c15'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:22:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-824bda6a-ed7d-4e03-9ac7-286057747a1f tempest-ServerActionsTestOtherA-1572917712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:22:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-824bda6a-ed7d-4e03-9ac7-286057747a1f tempest-ServerActionsTestOtherA-1572917712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:22:24 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-824bda6a-ed7d-4e03-9ac7-286057747a1f tempest-ServerActionsTestOtherA-1572917712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:22:24 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-824bda6a-ed7d-4e03-9ac7-286057747a1f tempest-ServerActionsTestOtherA-1572917712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:22:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-824bda6a-ed7d-4e03-9ac7-286057747a1f tempest-ServerActionsTestOtherA-1572917712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:22:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-824bda6a-ed7d-4e03-9ac7-286057747a1f tempest-ServerActionsTestOtherA-1572917712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:24 devstack sudo[93160]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bd3bbd43-43ee-440c-ba34-004e1b88f555 tempest-GroupSnapshotsTest-801703735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90.f55aa576-35c5-43e4-a62f-ab2bd128c94c" returned: 0 in 0.251s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:24 devstack sudo[93164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:22:24 devstack sudo[93164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bd3bbd43-43ee-440c-ba34-004e1b88f555 tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:24 devstack sudo[93166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90.info Sep 03 14:22:24 devstack sudo[93166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:24 devstack sudo[93164]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-824bda6a-ed7d-4e03-9ac7-286057747a1f tempest-ServerActionsTestOtherA-1572917712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.264s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:24 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-824bda6a-ed7d-4e03-9ac7-286057747a1f tempest-ServerActionsTestOtherA-1572917712 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:22:24 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-824bda6a-ed7d-4e03-9ac7-286057747a1f tempest-ServerActionsTestOtherA-1572917712 None] Deleted volume successfully. Sep 03 14:22:24 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-824bda6a-ed7d-4e03-9ac7-286057747a1f tempest-ServerActionsTestOtherA-1572917712 None] Lock "cinder-de201545-b003-4b67-bd29-0b205e1c6674-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:22:24 devstack sudo[93166]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bd3bbd43-43ee-440c-ba34-004e1b88f555 tempest-GroupSnapshotsTest-801703735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90.info" returned: 0 in 0.276s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:24 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-bd3bbd43-43ee-440c-ba34-004e1b88f555 tempest-GroupSnapshotsTest-801703735 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90.info is being set with open permissions: ugo+rw: NotImplementedError Sep 03 14:22:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bd3bbd43-43ee-440c-ba34-004e1b88f555 tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:24 devstack sudo[93170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90.info Sep 03 14:22:24 devstack sudo[93170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:24 devstack sudo[93170]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bd3bbd43-43ee-440c-ba34-004e1b88f555 tempest-GroupSnapshotsTest-801703735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90.info" returned: 0 in 0.312s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-bd3bbd43-43ee-440c-ba34-004e1b88f555 tempest-GroupSnapshotsTest-801703735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.462s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:22:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4c8ad02b-edfc-4afa-932c-1d8aa3982d8e tempest-VolumeQuotasAdminTestJSON-358516304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.565s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:22:24 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-4c8ad02b-edfc-4afa-932c-1d8aa3982d8e tempest-VolumeQuotasAdminTestJSON-358516304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-17723141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52389d52-942c-4e3e-beb0-714d1580be97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7329043b33b40e3aaf89bbb2d0bbd2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:22:23Z,use_quota=True,user_id='f543d3e0835a417bb820a15dd049497a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:22:24 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-4c8ad02b-edfc-4afa-932c-1d8aa3982d8e tempest-VolumeQuotasAdminTestJSON-358516304 None] Creating volume 52389d52-942c-4e3e-beb0-714d1580be97 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:22:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4c8ad02b-edfc-4afa-932c-1d8aa3982d8e tempest-VolumeQuotasAdminTestJSON-358516304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:22:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4c8ad02b-edfc-4afa-932c-1d8aa3982d8e tempest-VolumeQuotasAdminTestJSON-358516304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:22:24 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-4c8ad02b-edfc-4afa-932c-1d8aa3982d8e tempest-VolumeQuotasAdminTestJSON-358516304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:22:24 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-4c8ad02b-edfc-4afa-932c-1d8aa3982d8e tempest-VolumeQuotasAdminTestJSON-358516304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:22:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4c8ad02b-edfc-4afa-932c-1d8aa3982d8e tempest-VolumeQuotasAdminTestJSON-358516304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:22:24 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-4c8ad02b-edfc-4afa-932c-1d8aa3982d8e tempest-VolumeQuotasAdminTestJSON-358516304 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:22:24 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-4c8ad02b-edfc-4afa-932c-1d8aa3982d8e tempest-VolumeQuotasAdminTestJSON-358516304 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:22:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4c8ad02b-edfc-4afa-932c-1d8aa3982d8e tempest-VolumeQuotasAdminTestJSON-358516304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-52389d52-942c-4e3e-beb0-714d1580be97 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:24 devstack sudo[93180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-52389d52-942c-4e3e-beb0-714d1580be97 1073741824 Sep 03 14:22:24 devstack sudo[93180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:24 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-bd3bbd43-43ee-440c-ba34-004e1b88f555 tempest-GroupSnapshotsTest-801703735 None] group_snapshot 74a96595-d175-4fc1-9e35-6e2ba7cac86b: created successfully Sep 03 14:22:25 devstack sudo[93180]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4c8ad02b-edfc-4afa-932c-1d8aa3982d8e tempest-VolumeQuotasAdminTestJSON-358516304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-52389d52-942c-4e3e-beb0-714d1580be97 1073741824" returned: 0 in 0.764s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4c8ad02b-edfc-4afa-932c-1d8aa3982d8e tempest-VolumeQuotasAdminTestJSON-358516304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-52389d52-942c-4e3e-beb0-714d1580be97 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:25 devstack sudo[93203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-52389d52-942c-4e3e-beb0-714d1580be97 Sep 03 14:22:25 devstack sudo[93203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:25 devstack sudo[93203]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4c8ad02b-edfc-4afa-932c-1d8aa3982d8e tempest-VolumeQuotasAdminTestJSON-358516304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-52389d52-942c-4e3e-beb0-714d1580be97" returned: 0 in 0.346s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:25 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-4c8ad02b-edfc-4afa-932c-1d8aa3982d8e tempest-VolumeQuotasAdminTestJSON-358516304 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:22:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4c8ad02b-edfc-4afa-932c-1d8aa3982d8e tempest-VolumeQuotasAdminTestJSON-358516304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:22:25 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4c8ad02b-edfc-4afa-932c-1d8aa3982d8e tempest-VolumeQuotasAdminTestJSON-358516304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40a2313f-85ff-4a62-b8b1-0b1dea9ee250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52389d52-942c-4e3e-beb0-714d1580be97', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:25 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4c8ad02b-edfc-4afa-932c-1d8aa3982d8e tempest-VolumeQuotasAdminTestJSON-358516304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81937b92-4729-4019-a596-3d98468a4c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:25 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-4c8ad02b-edfc-4afa-932c-1d8aa3982d8e tempest-VolumeQuotasAdminTestJSON-358516304 None] Volume volume-52389d52-942c-4e3e-beb0-714d1580be97 (52389d52-942c-4e3e-beb0-714d1580be97): created successfully Sep 03 14:22:25 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4c8ad02b-edfc-4afa-932c-1d8aa3982d8e tempest-VolumeQuotasAdminTestJSON-358516304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81937b92-4729-4019-a596-3d98468a4c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:25 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4c8ad02b-edfc-4afa-932c-1d8aa3982d8e tempest-VolumeQuotasAdminTestJSON-358516304 None] Flow 'volume_create_manager' (eddd6c29-29d3-486f-aeb6-c685eaeb505c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:22:25 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-4c8ad02b-edfc-4afa-932c-1d8aa3982d8e tempest-VolumeQuotasAdminTestJSON-358516304 None] Created volume successfully. Sep 03 14:22:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-dd6da916-af1e-4c87-834c-e7df1ee33d95 tempest-GroupSnapshotsTest-801703735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:22:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-dd6da916-af1e-4c87-834c-e7df1ee33d95 tempest-GroupSnapshotsTest-801703735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:22:26 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-dd6da916-af1e-4c87-834c-e7df1ee33d95 tempest-GroupSnapshotsTest-801703735 None] Acquiring lock "cinder-quobyte-f55aa576-35c5-43e4-a62f-ab2bd128c94c-4af56c11-6f80-4fba-9b18-ea3b62c4155d" by "_create_volume_from_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:22:26 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-dd6da916-af1e-4c87-834c-e7df1ee33d95 tempest-GroupSnapshotsTest-801703735 None] Lock "cinder-quobyte-f55aa576-35c5-43e4-a62f-ab2bd128c94c-4af56c11-6f80-4fba-9b18-ea3b62c4155d" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:22:26 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-dd6da916-af1e-4c87-834c-e7df1ee33d95 tempest-GroupSnapshotsTest-801703735 None] Creating volume 4af56c11-6f80-4fba-9b18-ea3b62c4155d from snapshot f55aa576-35c5-43e4-a62f-ab2bd128c94c {{(pid=87007) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 14:22:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-dd6da916-af1e-4c87-834c-e7df1ee33d95 tempest-GroupSnapshotsTest-801703735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:22:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-dd6da916-af1e-4c87-834c-e7df1ee33d95 tempest-GroupSnapshotsTest-801703735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:22:26 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-dd6da916-af1e-4c87-834c-e7df1ee33d95 tempest-GroupSnapshotsTest-801703735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:22:26 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-dd6da916-af1e-4c87-834c-e7df1ee33d95 tempest-GroupSnapshotsTest-801703735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:22:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-dd6da916-af1e-4c87-834c-e7df1ee33d95 tempest-GroupSnapshotsTest-801703735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:22:26 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-dd6da916-af1e-4c87-834c-e7df1ee33d95 tempest-GroupSnapshotsTest-801703735 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:22:26 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-dd6da916-af1e-4c87-834c-e7df1ee33d95 tempest-GroupSnapshotsTest-801703735 None] Acquiring lock "cinder-quobyte-4af56c11-6f80-4fba-9b18-ea3b62c4155d" by "_copy_volume_from_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:22:26 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-dd6da916-af1e-4c87-834c-e7df1ee33d95 tempest-GroupSnapshotsTest-801703735 None] Lock "cinder-quobyte-4af56c11-6f80-4fba-9b18-ea3b62c4155d" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:22:26 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-dd6da916-af1e-4c87-834c-e7df1ee33d95 tempest-GroupSnapshotsTest-801703735 None] snapshot: f55aa576-35c5-43e4-a62f-ab2bd128c94c, volume: 4af56c11-6f80-4fba-9b18-ea3b62c4155d, {{(pid=87007) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 14:22:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-dd6da916-af1e-4c87-834c-e7df1ee33d95 tempest-GroupSnapshotsTest-801703735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:22:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-dd6da916-af1e-4c87-834c-e7df1ee33d95 tempest-GroupSnapshotsTest-801703735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:22:26 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-dd6da916-af1e-4c87-834c-e7df1ee33d95 tempest-GroupSnapshotsTest-801703735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:22:26 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-dd6da916-af1e-4c87-834c-e7df1ee33d95 tempest-GroupSnapshotsTest-801703735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:22:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-dd6da916-af1e-4c87-834c-e7df1ee33d95 tempest-GroupSnapshotsTest-801703735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:22:26 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaba0ab0-393f-4b18-900d-b355c315261b]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:22:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dd6da916-af1e-4c87-834c-e7df1ee33d95 tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90.f55aa576-35c5-43e4-a62f-ab2bd128c94c {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:26 devstack sudo[93209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90.f55aa576-35c5-43e4-a62f-ab2bd128c94c Sep 03 14:22:26 devstack sudo[93209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:27 devstack sudo[93209]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dd6da916-af1e-4c87-834c-e7df1ee33d95 tempest-GroupSnapshotsTest-801703735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90.f55aa576-35c5-43e4-a62f-ab2bd128c94c" returned: 0 in 0.770s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:27 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-dd6da916-af1e-4c87-834c-e7df1ee33d95 tempest-GroupSnapshotsTest-801703735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b045b5de-902d-4f43-93d0-3ff551befa90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:22:27 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[993cc8c5-9c5f-4a8c-8b82-ad3607f56b44]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:22:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dd6da916-af1e-4c87-834c-e7df1ee33d95 tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:27 devstack sudo[93317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90 Sep 03 14:22:27 devstack sudo[93317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:27 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-3c967778-7263-4e1a-b285-bdcaf07f375a tempest-VolumeQuotasAdminTestJSON-1986211570 None] Transfer volume completed successfully. Sep 03 14:22:27 devstack sudo[93317]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dd6da916-af1e-4c87-834c-e7df1ee33d95 tempest-GroupSnapshotsTest-801703735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90" returned: 0 in 0.546s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:27 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-dd6da916-af1e-4c87-834c-e7df1ee33d95 tempest-GroupSnapshotsTest-801703735 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90 {{(pid=87007) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 14:22:27 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-dd6da916-af1e-4c87-834c-e7df1ee33d95 tempest-GroupSnapshotsTest-801703735 None] Creating direct copy from snapshot {{(pid=87007) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 14:22:27 devstack cinder-volume[87007]: DEBUG cinder.utils [None req-dd6da916-af1e-4c87-834c-e7df1ee33d95 tempest-GroupSnapshotsTest-801703735 None] Path /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4af56c11-6f80-4fba-9b18-ea3b62c4155d not found in is_blk_device check {{(pid=87007) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 14:22:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dd6da916-af1e-4c87-834c-e7df1ee33d95 tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4af56c11-6f80-4fba-9b18-ea3b62c4155d {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:27 devstack sudo[93330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4af56c11-6f80-4fba-9b18-ea3b62c4155d Sep 03 14:22:27 devstack sudo[93330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:28 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-04bc576b-3742-4903-9397-9902890cb613 tempest-VolumeQuotasAdminTestJSON-1833989672 None] Acquiring lock "cinder-52389d52-942c-4e3e-beb0-714d1580be97-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:22:28 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-04bc576b-3742-4903-9397-9902890cb613 tempest-VolumeQuotasAdminTestJSON-1833989672 None] Lock "cinder-52389d52-942c-4e3e-beb0-714d1580be97-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:22:28 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-04bc576b-3742-4903-9397-9902890cb613 tempest-VolumeQuotasAdminTestJSON-1833989672 None] Acquiring lock "cinder-quobyte-52389d52-942c-4e3e-beb0-714d1580be97" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:22:28 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-04bc576b-3742-4903-9397-9902890cb613 tempest-VolumeQuotasAdminTestJSON-1833989672 None] Lock "cinder-quobyte-52389d52-942c-4e3e-beb0-714d1580be97" acquired by "delete_volume" :: waited 0.023s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:22:28 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[11966b4c-f7d7-4824-9464-a1243d15ac88]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:22:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-04bc576b-3742-4903-9397-9902890cb613 tempest-VolumeQuotasAdminTestJSON-1833989672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-52389d52-942c-4e3e-beb0-714d1580be97 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:28 devstack sudo[93354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-52389d52-942c-4e3e-beb0-714d1580be97 Sep 03 14:22:28 devstack sudo[93354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:29 devstack sudo[93354]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-04bc576b-3742-4903-9397-9902890cb613 tempest-VolumeQuotasAdminTestJSON-1833989672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-52389d52-942c-4e3e-beb0-714d1580be97" returned: 0 in 0.862s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-04bc576b-3742-4903-9397-9902890cb613 tempest-VolumeQuotasAdminTestJSON-1833989672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-52389d52-942c-4e3e-beb0-714d1580be97 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:29 devstack sudo[93736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-52389d52-942c-4e3e-beb0-714d1580be97 Sep 03 14:22:29 devstack sudo[93736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:30 devstack sudo[93736]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-04bc576b-3742-4903-9397-9902890cb613 tempest-VolumeQuotasAdminTestJSON-1833989672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-52389d52-942c-4e3e-beb0-714d1580be97" returned: 0 in 0.657s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:30 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-04bc576b-3742-4903-9397-9902890cb613 tempest-VolumeQuotasAdminTestJSON-1833989672 None] Lock "cinder-quobyte-52389d52-942c-4e3e-beb0-714d1580be97" released by "delete_volume" :: held 1.647s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:22:30 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-04bc576b-3742-4903-9397-9902890cb613 tempest-VolumeQuotasAdminTestJSON-1833989672 None] Created reservations ['b0428f79-6f38-45b8-8a0f-2c5cbe8e6e46', '0aa05f32-5cb5-4b71-af8d-85d6015aeb43', '2cd0049d-1e9b-4d4d-8b51-b051a3f0b8d1', '1a4cbb40-28b5-4a7b-8bdc-bec9116ea268'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:22:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-04bc576b-3742-4903-9397-9902890cb613 tempest-VolumeQuotasAdminTestJSON-1833989672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:22:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-04bc576b-3742-4903-9397-9902890cb613 tempest-VolumeQuotasAdminTestJSON-1833989672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:22:30 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-04bc576b-3742-4903-9397-9902890cb613 tempest-VolumeQuotasAdminTestJSON-1833989672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:22:30 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-04bc576b-3742-4903-9397-9902890cb613 tempest-VolumeQuotasAdminTestJSON-1833989672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:22:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-04bc576b-3742-4903-9397-9902890cb613 tempest-VolumeQuotasAdminTestJSON-1833989672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:22:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-04bc576b-3742-4903-9397-9902890cb613 tempest-VolumeQuotasAdminTestJSON-1833989672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:30 devstack sudo[93752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:22:30 devstack sudo[93752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:31 devstack sudo[93752]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-04bc576b-3742-4903-9397-9902890cb613 tempest-VolumeQuotasAdminTestJSON-1833989672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 1.127s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:31 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-04bc576b-3742-4903-9397-9902890cb613 tempest-VolumeQuotasAdminTestJSON-1833989672 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:22:31 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-04bc576b-3742-4903-9397-9902890cb613 tempest-VolumeQuotasAdminTestJSON-1833989672 None] Deleted volume successfully. Sep 03 14:22:31 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-04bc576b-3742-4903-9397-9902890cb613 tempest-VolumeQuotasAdminTestJSON-1833989672 None] Lock "cinder-52389d52-942c-4e3e-beb0-714d1580be97-delete_volume" released by "delete_volume" :: held 3.482s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:22:36 devstack sudo[93330]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dd6da916-af1e-4c87-834c-e7df1ee33d95 tempest-GroupSnapshotsTest-801703735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4af56c11-6f80-4fba-9b18-ea3b62c4155d" returned: 0 in 8.240s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:36 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-dd6da916-af1e-4c87-834c-e7df1ee33d95 tempest-GroupSnapshotsTest-801703735 None] Image conversion details: src /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90, size 1024.00 MB, duration 8.24 sec, destination /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4af56c11-6f80-4fba-9b18-ea3b62c4155d {{(pid=87007) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 14:22:36 devstack cinder-volume[87007]: INFO cinder.image.image_utils [None req-dd6da916-af1e-4c87-834c-e7df1ee33d95 tempest-GroupSnapshotsTest-801703735 None] Converted 1024.00 MB image at 124.26 MB/s Sep 03 14:22:36 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-dd6da916-af1e-4c87-834c-e7df1ee33d95 tempest-GroupSnapshotsTest-801703735 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4af56c11-6f80-4fba-9b18-ea3b62c4155d is being set with open permissions: ugo+rw: NotImplementedError Sep 03 14:22:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dd6da916-af1e-4c87-834c-e7df1ee33d95 tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4af56c11-6f80-4fba-9b18-ea3b62c4155d {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:36 devstack sudo[93763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4af56c11-6f80-4fba-9b18-ea3b62c4155d Sep 03 14:22:36 devstack sudo[93763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:36 devstack sudo[93763]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dd6da916-af1e-4c87-834c-e7df1ee33d95 tempest-GroupSnapshotsTest-801703735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4af56c11-6f80-4fba-9b18-ea3b62c4155d" returned: 0 in 0.310s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:36 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-dd6da916-af1e-4c87-834c-e7df1ee33d95 tempest-GroupSnapshotsTest-801703735 None] Lock "cinder-quobyte-4af56c11-6f80-4fba-9b18-ea3b62c4155d" released by "_copy_volume_from_snapshot" :: held 10.045s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:22:36 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-dd6da916-af1e-4c87-834c-e7df1ee33d95 tempest-GroupSnapshotsTest-801703735 None] Lock "cinder-quobyte-f55aa576-35c5-43e4-a62f-ab2bd128c94c-4af56c11-6f80-4fba-9b18-ea3b62c4155d" released by "_create_volume_from_snapshot" :: held 10.144s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:22:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-dd6da916-af1e-4c87-834c-e7df1ee33d95 tempest-GroupSnapshotsTest-801703735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.170s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:22:36 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-dd6da916-af1e-4c87-834c-e7df1ee33d95 tempest-GroupSnapshotsTest-801703735 None] Create group from source-snapshot-74a96595-d175-4fc1-9e35-6e2ba7cac86b completed successfully. Sep 03 14:22:38 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-24249a9f-ac48-4905-94ac-2ef4db44fb52 tempest-GroupSnapshotsTest-801703735 None] Acquiring lock "cinder-quobyte-4af56c11-6f80-4fba-9b18-ea3b62c4155d" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:22:38 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-24249a9f-ac48-4905-94ac-2ef4db44fb52 tempest-GroupSnapshotsTest-801703735 None] Lock "cinder-quobyte-4af56c11-6f80-4fba-9b18-ea3b62c4155d" acquired by "delete_volume" :: waited 0.024s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:22:38 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a31f85-4360-4b6c-85a5-f737a5e1e1d4]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:22:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-24249a9f-ac48-4905-94ac-2ef4db44fb52 tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4af56c11-6f80-4fba-9b18-ea3b62c4155d {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:38 devstack sudo[93768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4af56c11-6f80-4fba-9b18-ea3b62c4155d Sep 03 14:22:38 devstack sudo[93768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:38 devstack sudo[93768]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-24249a9f-ac48-4905-94ac-2ef4db44fb52 tempest-GroupSnapshotsTest-801703735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4af56c11-6f80-4fba-9b18-ea3b62c4155d" returned: 0 in 0.517s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-24249a9f-ac48-4905-94ac-2ef4db44fb52 tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4af56c11-6f80-4fba-9b18-ea3b62c4155d {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:38 devstack sudo[93774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4af56c11-6f80-4fba-9b18-ea3b62c4155d Sep 03 14:22:38 devstack sudo[93774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:39 devstack sudo[93774]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-24249a9f-ac48-4905-94ac-2ef4db44fb52 tempest-GroupSnapshotsTest-801703735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4af56c11-6f80-4fba-9b18-ea3b62c4155d" returned: 0 in 0.428s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:39 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-24249a9f-ac48-4905-94ac-2ef4db44fb52 tempest-GroupSnapshotsTest-801703735 None] Lock "cinder-quobyte-4af56c11-6f80-4fba-9b18-ea3b62c4155d" released by "delete_volume" :: held 1.028s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:22:39 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-24249a9f-ac48-4905-94ac-2ef4db44fb52 tempest-GroupSnapshotsTest-801703735 None] Created reservations ['19c1cb1b-26ac-476a-a425-c5a794342642'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:22:39 devstack cinder-volume[87007]: WARNING cinder.quota [None req-24249a9f-ac48-4905-94ac-2ef4db44fb52 tempest-GroupSnapshotsTest-801703735 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1327699705 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1327699705, it is now deprecated. Please use the default quota class for default quota. Sep 03 14:22:39 devstack cinder-volume[87007]: WARNING cinder.quota [None req-24249a9f-ac48-4905-94ac-2ef4db44fb52 tempest-GroupSnapshotsTest-801703735 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1327699705 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1327699705, it is now deprecated. Please use the default quota class for default quota. Sep 03 14:22:39 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-24249a9f-ac48-4905-94ac-2ef4db44fb52 tempest-GroupSnapshotsTest-801703735 None] Created reservations ['0844dcd8-da81-4e2d-a919-2da98b249336', '6a3371d1-9228-4869-85b6-71d7fe64b4ec', 'f91a80a4-7333-4d32-9545-11bad48257ee', '899746ce-cd12-46c5-b5dc-3dfb2887eaf4'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:22:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-24249a9f-ac48-4905-94ac-2ef4db44fb52 tempest-GroupSnapshotsTest-801703735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:22:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-24249a9f-ac48-4905-94ac-2ef4db44fb52 tempest-GroupSnapshotsTest-801703735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:22:39 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-24249a9f-ac48-4905-94ac-2ef4db44fb52 tempest-GroupSnapshotsTest-801703735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:22:39 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-24249a9f-ac48-4905-94ac-2ef4db44fb52 tempest-GroupSnapshotsTest-801703735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:22:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-24249a9f-ac48-4905-94ac-2ef4db44fb52 tempest-GroupSnapshotsTest-801703735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:22:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-24249a9f-ac48-4905-94ac-2ef4db44fb52 tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:39 devstack sudo[93777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:22:39 devstack sudo[93777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:39 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-d530f0a2-6439-4bb8-bfdf-aa6fa51c8c4c tempest-GroupSnapshotsTest-801703735 None] group_snapshot 74a96595-d175-4fc1-9e35-6e2ba7cac86b: deleting Sep 03 14:22:39 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d530f0a2-6439-4bb8-bfdf-aa6fa51c8c4c tempest-GroupSnapshotsTest-801703735 None] group_snapshot 74a96595-d175-4fc1-9e35-6e2ba7cac86b: deleting {{(pid=87007) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 03 14:22:39 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d530f0a2-6439-4bb8-bfdf-aa6fa51c8c4c tempest-GroupSnapshotsTest-801703735 None] Acquiring lock "cinder-quobyte-b045b5de-902d-4f43-93d0-3ff551befa90" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:22:39 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d530f0a2-6439-4bb8-bfdf-aa6fa51c8c4c tempest-GroupSnapshotsTest-801703735 None] Lock "cinder-quobyte-b045b5de-902d-4f43-93d0-3ff551befa90" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:22:39 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d530f0a2-6439-4bb8-bfdf-aa6fa51c8c4c tempest-GroupSnapshotsTest-801703735 None] Acquiring lock "cinder-quobyte-f55aa576-35c5-43e4-a62f-ab2bd128c94c" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:22:39 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d530f0a2-6439-4bb8-bfdf-aa6fa51c8c4c tempest-GroupSnapshotsTest-801703735 None] Lock "cinder-quobyte-f55aa576-35c5-43e4-a62f-ab2bd128c94c" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:22:39 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-d530f0a2-6439-4bb8-bfdf-aa6fa51c8c4c tempest-GroupSnapshotsTest-801703735 None] Deleting offline snapshot f55aa576-35c5-43e4-a62f-ab2bd128c94c of volume b045b5de-902d-4f43-93d0-3ff551befa90 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:22:39 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-d530f0a2-6439-4bb8-bfdf-aa6fa51c8c4c tempest-GroupSnapshotsTest-801703735 None] snapshot_file for this snap is: volume-b045b5de-902d-4f43-93d0-3ff551befa90.f55aa576-35c5-43e4-a62f-ab2bd128c94c {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:22:39 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[286312ec-6235-45ce-a0ba-9ef6eae0406e]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:22:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d530f0a2-6439-4bb8-bfdf-aa6fa51c8c4c tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90.f55aa576-35c5-43e4-a62f-ab2bd128c94c {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:40 devstack sudo[93777]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-24249a9f-ac48-4905-94ac-2ef4db44fb52 tempest-GroupSnapshotsTest-801703735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.507s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:40 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-24249a9f-ac48-4905-94ac-2ef4db44fb52 tempest-GroupSnapshotsTest-801703735 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:22:40 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-24249a9f-ac48-4905-94ac-2ef4db44fb52 tempest-GroupSnapshotsTest-801703735 None] Delete group completed successfully. Sep 03 14:22:40 devstack sudo[93779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90.f55aa576-35c5-43e4-a62f-ab2bd128c94c Sep 03 14:22:40 devstack sudo[93779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:40 devstack sudo[93779]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d530f0a2-6439-4bb8-bfdf-aa6fa51c8c4c tempest-GroupSnapshotsTest-801703735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90.f55aa576-35c5-43e4-a62f-ab2bd128c94c" returned: 0 in 0.594s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:40 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-d530f0a2-6439-4bb8-bfdf-aa6fa51c8c4c tempest-GroupSnapshotsTest-801703735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b045b5de-902d-4f43-93d0-3ff551befa90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:22:40 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b4812d-bd99-4862-ad42-e3c3a4bf7066]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:22:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d530f0a2-6439-4bb8-bfdf-aa6fa51c8c4c tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:40 devstack sudo[93785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90 Sep 03 14:22:40 devstack sudo[93785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:41 devstack sudo[93785]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d530f0a2-6439-4bb8-bfdf-aa6fa51c8c4c tempest-GroupSnapshotsTest-801703735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90" returned: 0 in 0.707s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d530f0a2-6439-4bb8-bfdf-aa6fa51c8c4c tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90.f55aa576-35c5-43e4-a62f-ab2bd128c94c {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:41 devstack sudo[93791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90.f55aa576-35c5-43e4-a62f-ab2bd128c94c Sep 03 14:22:41 devstack sudo[93791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:41 devstack sudo[93791]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d530f0a2-6439-4bb8-bfdf-aa6fa51c8c4c tempest-GroupSnapshotsTest-801703735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90.f55aa576-35c5-43e4-a62f-ab2bd128c94c" returned: 0 in 0.562s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d530f0a2-6439-4bb8-bfdf-aa6fa51c8c4c tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90.f55aa576-35c5-43e4-a62f-ab2bd128c94c {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:41 devstack sudo[93797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90.f55aa576-35c5-43e4-a62f-ab2bd128c94c Sep 03 14:22:41 devstack sudo[93797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:42 devstack sudo[93797]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d530f0a2-6439-4bb8-bfdf-aa6fa51c8c4c tempest-GroupSnapshotsTest-801703735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90.f55aa576-35c5-43e4-a62f-ab2bd128c94c" returned: 0 in 0.340s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:42 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d530f0a2-6439-4bb8-bfdf-aa6fa51c8c4c tempest-GroupSnapshotsTest-801703735 None] Lock "cinder-quobyte-f55aa576-35c5-43e4-a62f-ab2bd128c94c" released by "_delete_snapshot" :: held 2.428s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:22:42 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d530f0a2-6439-4bb8-bfdf-aa6fa51c8c4c tempest-GroupSnapshotsTest-801703735 None] Lock "cinder-quobyte-b045b5de-902d-4f43-93d0-3ff551befa90" released by "delete_snapshot" :: held 2.470s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:22:42 devstack cinder-volume[87007]: WARNING cinder.quota [None req-d530f0a2-6439-4bb8-bfdf-aa6fa51c8c4c tempest-GroupSnapshotsTest-801703735 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1327699705 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1327699705, it is now deprecated. Please use the default quota class for default quota. Sep 03 14:22:42 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-d530f0a2-6439-4bb8-bfdf-aa6fa51c8c4c tempest-GroupSnapshotsTest-801703735 None] Created reservations ['9c935b35-3a82-42de-88d5-daea90c52cfd', '98281876-4330-4b52-937e-e0de82df5397', '07e78326-e367-47e0-ae1f-6b027ec9f404', 'ba9bb19a-9225-4f7b-9a50-45250dd900f4'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:22:42 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-d530f0a2-6439-4bb8-bfdf-aa6fa51c8c4c tempest-GroupSnapshotsTest-801703735 None] group_snapshot 74a96595-d175-4fc1-9e35-6e2ba7cac86b: deleted successfully Sep 03 14:22:43 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c684fc4d-97c7-4ddf-ab0a-60441c5506da tempest-GroupSnapshotsTest-801703735 None] Acquiring lock "cinder-quobyte-b045b5de-902d-4f43-93d0-3ff551befa90" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:22:43 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c684fc4d-97c7-4ddf-ab0a-60441c5506da tempest-GroupSnapshotsTest-801703735 None] Lock "cinder-quobyte-b045b5de-902d-4f43-93d0-3ff551befa90" acquired by "delete_volume" :: waited 0.042s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:22:43 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8bbde9-e2f7-428f-a4bd-892c3385286e]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:22:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c684fc4d-97c7-4ddf-ab0a-60441c5506da tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:44 devstack sudo[93808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90 Sep 03 14:22:44 devstack sudo[93808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:44 devstack sudo[93808]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c684fc4d-97c7-4ddf-ab0a-60441c5506da tempest-GroupSnapshotsTest-801703735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90" returned: 0 in 0.478s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c684fc4d-97c7-4ddf-ab0a-60441c5506da tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:44 devstack sudo[93813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90 Sep 03 14:22:44 devstack sudo[93813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:44 devstack sudo[93813]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c684fc4d-97c7-4ddf-ab0a-60441c5506da tempest-GroupSnapshotsTest-801703735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b045b5de-902d-4f43-93d0-3ff551befa90" returned: 0 in 0.285s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:44 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c684fc4d-97c7-4ddf-ab0a-60441c5506da tempest-GroupSnapshotsTest-801703735 None] Lock "cinder-quobyte-b045b5de-902d-4f43-93d0-3ff551befa90" released by "delete_volume" :: held 0.875s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:22:44 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe957156-148b-4951-afa7-f159dd0e1ef6 tempest-VolumesServicesTestJSON-1155956212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:22:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fe957156-148b-4951-afa7-f159dd0e1ef6 tempest-VolumesServicesTestJSON-1155956212 None] Flow 'volume_create_manager' (3f594173-db32-481d-b6bb-3da5c02d904e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:22:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fe957156-148b-4951-afa7-f159dd0e1ef6 tempest-VolumesServicesTestJSON-1155956212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (529c8792-84aa-4c4d-ad42-17bb1c5d7e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fe957156-148b-4951-afa7-f159dd0e1ef6 tempest-VolumesServicesTestJSON-1155956212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (529c8792-84aa-4c4d-ad42-17bb1c5d7e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1903885921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35a2dcb3-9142-4198-ae86-dddf6ae13190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14999c6d54614350a762e0ce3a41c295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:22:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:22:45Z,use_quota=True,user_id='3af0b7462ba34c7f81010813b878d086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fe957156-148b-4951-afa7-f159dd0e1ef6 tempest-VolumesServicesTestJSON-1155956212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c399b099-f875-42c0-99d4-b37f8ab8796b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fe957156-148b-4951-afa7-f159dd0e1ef6 tempest-VolumesServicesTestJSON-1155956212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c399b099-f875-42c0-99d4-b37f8ab8796b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fe957156-148b-4951-afa7-f159dd0e1ef6 tempest-VolumesServicesTestJSON-1155956212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec24e7b9-6951-49bc-be5e-aa869984d9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fe957156-148b-4951-afa7-f159dd0e1ef6 tempest-VolumesServicesTestJSON-1155956212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec24e7b9-6951-49bc-be5e-aa869984d9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35a2dcb3-9142-4198-ae86-dddf6ae13190', 'volume_name': 'volume-35a2dcb3-9142-4198-ae86-dddf6ae13190', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fe957156-148b-4951-afa7-f159dd0e1ef6 tempest-VolumesServicesTestJSON-1155956212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (942418bf-d566-466c-9f0a-bf186015f894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fe957156-148b-4951-afa7-f159dd0e1ef6 tempest-VolumesServicesTestJSON-1155956212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (942418bf-d566-466c-9f0a-bf186015f894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fe957156-148b-4951-afa7-f159dd0e1ef6 tempest-VolumesServicesTestJSON-1155956212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca1f349d-6c7a-4ff6-bcd8-98123b9dc21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:44 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-fe957156-148b-4951-afa7-f159dd0e1ef6 tempest-VolumesServicesTestJSON-1155956212 None] Volume 35a2dcb3-9142-4198-ae86-dddf6ae13190: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35a2dcb3-9142-4198-ae86-dddf6ae13190', 'volume_size': 1} Sep 03 14:22:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-fe957156-148b-4951-afa7-f159dd0e1ef6 tempest-VolumesServicesTestJSON-1155956212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:22:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-fe957156-148b-4951-afa7-f159dd0e1ef6 tempest-VolumesServicesTestJSON-1155956212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:22:44 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-fe957156-148b-4951-afa7-f159dd0e1ef6 tempest-VolumesServicesTestJSON-1155956212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1903885921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35a2dcb3-9142-4198-ae86-dddf6ae13190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14999c6d54614350a762e0ce3a41c295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:22:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:22:45Z,use_quota=True,user_id='3af0b7462ba34c7f81010813b878d086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:22:44 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-fe957156-148b-4951-afa7-f159dd0e1ef6 tempest-VolumesServicesTestJSON-1155956212 None] Creating volume 35a2dcb3-9142-4198-ae86-dddf6ae13190 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:22:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-fe957156-148b-4951-afa7-f159dd0e1ef6 tempest-VolumesServicesTestJSON-1155956212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:22:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-fe957156-148b-4951-afa7-f159dd0e1ef6 tempest-VolumesServicesTestJSON-1155956212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:22:44 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-fe957156-148b-4951-afa7-f159dd0e1ef6 tempest-VolumesServicesTestJSON-1155956212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:22:44 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-fe957156-148b-4951-afa7-f159dd0e1ef6 tempest-VolumesServicesTestJSON-1155956212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:22:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-fe957156-148b-4951-afa7-f159dd0e1ef6 tempest-VolumesServicesTestJSON-1155956212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:22:44 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-fe957156-148b-4951-afa7-f159dd0e1ef6 tempest-VolumesServicesTestJSON-1155956212 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:22:44 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-fe957156-148b-4951-afa7-f159dd0e1ef6 tempest-VolumesServicesTestJSON-1155956212 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:22:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fe957156-148b-4951-afa7-f159dd0e1ef6 tempest-VolumesServicesTestJSON-1155956212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-35a2dcb3-9142-4198-ae86-dddf6ae13190 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:44 devstack sudo[93816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-35a2dcb3-9142-4198-ae86-dddf6ae13190 1073741824 Sep 03 14:22:44 devstack sudo[93816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:44 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-c684fc4d-97c7-4ddf-ab0a-60441c5506da tempest-GroupSnapshotsTest-801703735 None] Created reservations ['09fa0b9e-ca42-4592-87e8-08433c3b5332'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:22:44 devstack cinder-volume[87007]: WARNING cinder.db.api [None req-c684fc4d-97c7-4ddf-ab0a-60441c5506da tempest-GroupSnapshotsTest-801703735 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1327699705'] Sep 03 14:22:44 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-c684fc4d-97c7-4ddf-ab0a-60441c5506da tempest-GroupSnapshotsTest-801703735 None] Created reservations ['8ca65e10-eb00-4d55-a962-8a4286818540', 'c11ce47c-6cc9-4eaa-83e8-6d802d0026e6', 'bbe96026-ddd2-4c14-9345-53d5560b1b6a', 'f0baa2c0-6d4c-4dbc-8d20-6f3032a7a510'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:22:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c684fc4d-97c7-4ddf-ab0a-60441c5506da tempest-GroupSnapshotsTest-801703735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:22:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c684fc4d-97c7-4ddf-ab0a-60441c5506da tempest-GroupSnapshotsTest-801703735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:22:45 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-c684fc4d-97c7-4ddf-ab0a-60441c5506da tempest-GroupSnapshotsTest-801703735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:22:45 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-c684fc4d-97c7-4ddf-ab0a-60441c5506da tempest-GroupSnapshotsTest-801703735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:22:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c684fc4d-97c7-4ddf-ab0a-60441c5506da tempest-GroupSnapshotsTest-801703735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:22:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c684fc4d-97c7-4ddf-ab0a-60441c5506da tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:45 devstack sudo[93818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:22:45 devstack sudo[93818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:45 devstack sudo[93816]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fe957156-148b-4951-afa7-f159dd0e1ef6 tempest-VolumesServicesTestJSON-1155956212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-35a2dcb3-9142-4198-ae86-dddf6ae13190 1073741824" returned: 0 in 0.497s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fe957156-148b-4951-afa7-f159dd0e1ef6 tempest-VolumesServicesTestJSON-1155956212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-35a2dcb3-9142-4198-ae86-dddf6ae13190 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:45 devstack sudo[93818]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c684fc4d-97c7-4ddf-ab0a-60441c5506da tempest-GroupSnapshotsTest-801703735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.326s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:45 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-c684fc4d-97c7-4ddf-ab0a-60441c5506da tempest-GroupSnapshotsTest-801703735 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:22:45 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-c684fc4d-97c7-4ddf-ab0a-60441c5506da tempest-GroupSnapshotsTest-801703735 None] Delete group completed successfully. Sep 03 14:22:45 devstack sudo[93825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-35a2dcb3-9142-4198-ae86-dddf6ae13190 Sep 03 14:22:45 devstack sudo[93825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:45 devstack sudo[93825]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fe957156-148b-4951-afa7-f159dd0e1ef6 tempest-VolumesServicesTestJSON-1155956212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-35a2dcb3-9142-4198-ae86-dddf6ae13190" returned: 0 in 0.255s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:45 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-fe957156-148b-4951-afa7-f159dd0e1ef6 tempest-VolumesServicesTestJSON-1155956212 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:22:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-fe957156-148b-4951-afa7-f159dd0e1ef6 tempest-VolumesServicesTestJSON-1155956212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:22:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fe957156-148b-4951-afa7-f159dd0e1ef6 tempest-VolumesServicesTestJSON-1155956212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca1f349d-6c7a-4ff6-bcd8-98123b9dc21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35a2dcb3-9142-4198-ae86-dddf6ae13190', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fe957156-148b-4951-afa7-f159dd0e1ef6 tempest-VolumesServicesTestJSON-1155956212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce1479e4-3afb-44a2-8850-2735caecedea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:45 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-fe957156-148b-4951-afa7-f159dd0e1ef6 tempest-VolumesServicesTestJSON-1155956212 None] Volume volume-35a2dcb3-9142-4198-ae86-dddf6ae13190 (35a2dcb3-9142-4198-ae86-dddf6ae13190): created successfully Sep 03 14:22:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fe957156-148b-4951-afa7-f159dd0e1ef6 tempest-VolumesServicesTestJSON-1155956212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce1479e4-3afb-44a2-8850-2735caecedea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fe957156-148b-4951-afa7-f159dd0e1ef6 tempest-VolumesServicesTestJSON-1155956212 None] Flow 'volume_create_manager' (3f594173-db32-481d-b6bb-3da5c02d904e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:22:45 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-fe957156-148b-4951-afa7-f159dd0e1ef6 tempest-VolumesServicesTestJSON-1155956212 None] Created volume successfully. Sep 03 14:22:46 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-41d56b75-e642-40f3-9b9e-7675dd805ea7 tempest-GroupSnapshotsTest-801703735 None] Group tempest-GroupSnapshotsTest-Group-1140850904: creating Sep 03 14:22:46 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-41d56b75-e642-40f3-9b9e-7675dd805ea7 tempest-GroupSnapshotsTest-801703735 None] Group tempest-GroupSnapshotsTest-Group-1140850904: created successfully Sep 03 14:22:46 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-41d56b75-e642-40f3-9b9e-7675dd805ea7 tempest-GroupSnapshotsTest-801703735 None] Create group completed successfully. Sep 03 14:22:47 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1aa68951-4421-4e6f-b736-2e48015f8429 tempest-VolumesServicesTestJSON-1155956212 None] Acquiring lock "cinder-35a2dcb3-9142-4198-ae86-dddf6ae13190-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:22:47 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1aa68951-4421-4e6f-b736-2e48015f8429 tempest-VolumesServicesTestJSON-1155956212 None] Lock "cinder-35a2dcb3-9142-4198-ae86-dddf6ae13190-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:22:47 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1aa68951-4421-4e6f-b736-2e48015f8429 tempest-VolumesServicesTestJSON-1155956212 None] Acquiring lock "cinder-quobyte-35a2dcb3-9142-4198-ae86-dddf6ae13190" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:22:47 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1aa68951-4421-4e6f-b736-2e48015f8429 tempest-VolumesServicesTestJSON-1155956212 None] Lock "cinder-quobyte-35a2dcb3-9142-4198-ae86-dddf6ae13190" acquired by "delete_volume" :: waited 0.026s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:22:47 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3517f32b-c68a-401a-800a-6e243525a7b5]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:22:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1aa68951-4421-4e6f-b736-2e48015f8429 tempest-VolumesServicesTestJSON-1155956212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-35a2dcb3-9142-4198-ae86-dddf6ae13190 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:47 devstack sudo[93829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-35a2dcb3-9142-4198-ae86-dddf6ae13190 Sep 03 14:22:47 devstack sudo[93829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:47 devstack sudo[93829]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1aa68951-4421-4e6f-b736-2e48015f8429 tempest-VolumesServicesTestJSON-1155956212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-35a2dcb3-9142-4198-ae86-dddf6ae13190" returned: 0 in 0.387s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1aa68951-4421-4e6f-b736-2e48015f8429 tempest-VolumesServicesTestJSON-1155956212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-35a2dcb3-9142-4198-ae86-dddf6ae13190 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:47 devstack sudo[93858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-35a2dcb3-9142-4198-ae86-dddf6ae13190 Sep 03 14:22:47 devstack sudo[93858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:47 devstack sudo[93858]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1aa68951-4421-4e6f-b736-2e48015f8429 tempest-VolumesServicesTestJSON-1155956212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-35a2dcb3-9142-4198-ae86-dddf6ae13190" returned: 0 in 0.276s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:47 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1aa68951-4421-4e6f-b736-2e48015f8429 tempest-VolumesServicesTestJSON-1155956212 None] Lock "cinder-quobyte-35a2dcb3-9142-4198-ae86-dddf6ae13190" released by "delete_volume" :: held 0.713s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:22:47 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-1aa68951-4421-4e6f-b736-2e48015f8429 tempest-VolumesServicesTestJSON-1155956212 None] Created reservations ['b4fa6710-0d7e-474b-9202-29b2ca43a897', 'cfb9e81a-0f3e-421a-8981-6197ad871708', 'b13edf4b-4db5-4dd4-b4bf-20c8d45735b3', 'd81c4680-0e7c-4e97-9f41-05a2fe120535'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:22:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1aa68951-4421-4e6f-b736-2e48015f8429 tempest-VolumesServicesTestJSON-1155956212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:22:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1aa68951-4421-4e6f-b736-2e48015f8429 tempest-VolumesServicesTestJSON-1155956212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:22:47 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-1aa68951-4421-4e6f-b736-2e48015f8429 tempest-VolumesServicesTestJSON-1155956212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:22:47 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-1aa68951-4421-4e6f-b736-2e48015f8429 tempest-VolumesServicesTestJSON-1155956212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:22:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1aa68951-4421-4e6f-b736-2e48015f8429 tempest-VolumesServicesTestJSON-1155956212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:22:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1aa68951-4421-4e6f-b736-2e48015f8429 tempest-VolumesServicesTestJSON-1155956212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:48 devstack sudo[93861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:22:48 devstack sudo[93861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:48 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-b22ff39d-737e-41ea-a9ee-672262a23647 tempest-GroupSnapshotsTest-801703735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:22:48 devstack sudo[93861]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:48 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b22ff39d-737e-41ea-a9ee-672262a23647 tempest-GroupSnapshotsTest-801703735 None] Flow 'volume_create_manager' (5379682e-84b6-4dc5-b092-b492900a9ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:22:48 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b22ff39d-737e-41ea-a9ee-672262a23647 tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58800dda-2240-4351-bb43-6027df194a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1aa68951-4421-4e6f-b736-2e48015f8429 tempest-VolumesServicesTestJSON-1155956212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.406s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:48 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-1aa68951-4421-4e6f-b736-2e48015f8429 tempest-VolumesServicesTestJSON-1155956212 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:22:48 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-1aa68951-4421-4e6f-b736-2e48015f8429 tempest-VolumesServicesTestJSON-1155956212 None] Deleted volume successfully. Sep 03 14:22:48 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b22ff39d-737e-41ea-a9ee-672262a23647 tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58800dda-2240-4351-bb43-6027df194a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-318316386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=028a8a62-0c24-4334-b2e7-2f4b1621b4da,host='devstack@QuobyteHD#QuobyteHD',id=6dfe970a-1f45-4246-b4fa-d8fcf197b17c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f1cf5b0021e4dcda66d166da40bcd1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:22:48Z,use_quota=True,user_id='773b6757a7aa43e39b1dd5179e480f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46fb3857-cd4d-449d-87e7-2f851a1246e0),volume_type_id=46fb3857-cd4d-449d-87e7-2f851a1246e0)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:48 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b22ff39d-737e-41ea-a9ee-672262a23647 tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3feb151d-2a78-47a2-b5c1-ae99417f8596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:48 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b22ff39d-737e-41ea-a9ee-672262a23647 tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3feb151d-2a78-47a2-b5c1-ae99417f8596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:48 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b22ff39d-737e-41ea-a9ee-672262a23647 tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9852eb4-e301-44e6-938c-aa4381375760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:48 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b22ff39d-737e-41ea-a9ee-672262a23647 tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9852eb4-e301-44e6-938c-aa4381375760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dfe970a-1f45-4246-b4fa-d8fcf197b17c', 'volume_name': 'volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:48 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b22ff39d-737e-41ea-a9ee-672262a23647 tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (551ff307-5f57-4226-a491-07745e3ecc47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:48 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b22ff39d-737e-41ea-a9ee-672262a23647 tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (551ff307-5f57-4226-a491-07745e3ecc47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:48 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b22ff39d-737e-41ea-a9ee-672262a23647 tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cad724de-84fa-494b-a282-d7ca278ad5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:48 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-b22ff39d-737e-41ea-a9ee-672262a23647 tempest-GroupSnapshotsTest-801703735 None] Volume 6dfe970a-1f45-4246-b4fa-d8fcf197b17c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c', 'volume_size': 1} Sep 03 14:22:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b22ff39d-737e-41ea-a9ee-672262a23647 tempest-GroupSnapshotsTest-801703735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:22:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b22ff39d-737e-41ea-a9ee-672262a23647 tempest-GroupSnapshotsTest-801703735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:22:48 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b22ff39d-737e-41ea-a9ee-672262a23647 tempest-GroupSnapshotsTest-801703735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=028a8a62-0c24-4334-b2e7-2f4b1621b4da,created_at=2026-09-03T12:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-318316386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=028a8a62-0c24-4334-b2e7-2f4b1621b4da,host='devstack@QuobyteHD#QuobyteHD',id=6dfe970a-1f45-4246-b4fa-d8fcf197b17c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f1cf5b0021e4dcda66d166da40bcd1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:22:48Z,use_quota=True,user_id='773b6757a7aa43e39b1dd5179e480f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46fb3857-cd4d-449d-87e7-2f851a1246e0),volume_type_id=46fb3857-cd4d-449d-87e7-2f851a1246e0)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:22:48 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-b22ff39d-737e-41ea-a9ee-672262a23647 tempest-GroupSnapshotsTest-801703735 None] Creating volume 6dfe970a-1f45-4246-b4fa-d8fcf197b17c {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:22:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b22ff39d-737e-41ea-a9ee-672262a23647 tempest-GroupSnapshotsTest-801703735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:22:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b22ff39d-737e-41ea-a9ee-672262a23647 tempest-GroupSnapshotsTest-801703735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:22:48 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b22ff39d-737e-41ea-a9ee-672262a23647 tempest-GroupSnapshotsTest-801703735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:22:48 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b22ff39d-737e-41ea-a9ee-672262a23647 tempest-GroupSnapshotsTest-801703735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:22:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b22ff39d-737e-41ea-a9ee-672262a23647 tempest-GroupSnapshotsTest-801703735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:22:48 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b22ff39d-737e-41ea-a9ee-672262a23647 tempest-GroupSnapshotsTest-801703735 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:22:48 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-b22ff39d-737e-41ea-a9ee-672262a23647 tempest-GroupSnapshotsTest-801703735 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:22:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b22ff39d-737e-41ea-a9ee-672262a23647 tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:48 devstack sudo[93864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c 1073741824 Sep 03 14:22:48 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1aa68951-4421-4e6f-b736-2e48015f8429 tempest-VolumesServicesTestJSON-1155956212 None] Lock "cinder-35a2dcb3-9142-4198-ae86-dddf6ae13190-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:22:48 devstack sudo[93864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:48 devstack sudo[93864]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b22ff39d-737e-41ea-a9ee-672262a23647 tempest-GroupSnapshotsTest-801703735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c 1073741824" returned: 0 in 0.505s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b22ff39d-737e-41ea-a9ee-672262a23647 tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:49 devstack sudo[93870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c Sep 03 14:22:49 devstack sudo[93870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:49 devstack sudo[93870]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b22ff39d-737e-41ea-a9ee-672262a23647 tempest-GroupSnapshotsTest-801703735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c" returned: 0 in 0.305s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:49 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b22ff39d-737e-41ea-a9ee-672262a23647 tempest-GroupSnapshotsTest-801703735 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:22:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b22ff39d-737e-41ea-a9ee-672262a23647 tempest-GroupSnapshotsTest-801703735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:22:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b22ff39d-737e-41ea-a9ee-672262a23647 tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cad724de-84fa-494b-a282-d7ca278ad5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b22ff39d-737e-41ea-a9ee-672262a23647 tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0d5bb46-7c80-4076-ae11-78ee6d8a4a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:49 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-b22ff39d-737e-41ea-a9ee-672262a23647 tempest-GroupSnapshotsTest-801703735 None] Volume volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c (6dfe970a-1f45-4246-b4fa-d8fcf197b17c): created successfully Sep 03 14:22:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b22ff39d-737e-41ea-a9ee-672262a23647 tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0d5bb46-7c80-4076-ae11-78ee6d8a4a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b22ff39d-737e-41ea-a9ee-672262a23647 tempest-GroupSnapshotsTest-801703735 None] Flow 'volume_create_manager' (5379682e-84b6-4dc5-b092-b492900a9ef0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:22:49 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-b22ff39d-737e-41ea-a9ee-672262a23647 tempest-GroupSnapshotsTest-801703735 None] Created volume successfully. Sep 03 14:22:51 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-b21f35fd-8768-4609-858e-678f62fa7d7d tempest-GroupSnapshotsTest-801703735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:22:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b21f35fd-8768-4609-858e-678f62fa7d7d tempest-GroupSnapshotsTest-801703735 None] Flow 'volume_create_manager' (dac19d6d-fa6c-4441-b1b7-e7e38e5a3b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:22:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b21f35fd-8768-4609-858e-678f62fa7d7d tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d843c23-77d5-4e4f-92c5-91047ec5c889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b21f35fd-8768-4609-858e-678f62fa7d7d tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d843c23-77d5-4e4f-92c5-91047ec5c889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1941926245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=028a8a62-0c24-4334-b2e7-2f4b1621b4da,host='devstack@QuobyteHD#QuobyteHD',id=2890ad24-8aaa-4486-bef6-82028eee1608,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f1cf5b0021e4dcda66d166da40bcd1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:22:51Z,use_quota=True,user_id='773b6757a7aa43e39b1dd5179e480f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46fb3857-cd4d-449d-87e7-2f851a1246e0),volume_type_id=46fb3857-cd4d-449d-87e7-2f851a1246e0)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b21f35fd-8768-4609-858e-678f62fa7d7d tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f61a7d7-ed0f-4eb9-b044-055cc0795f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b21f35fd-8768-4609-858e-678f62fa7d7d tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f61a7d7-ed0f-4eb9-b044-055cc0795f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b21f35fd-8768-4609-858e-678f62fa7d7d tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca64e317-07dd-4a2e-a256-0f9f5070299e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b21f35fd-8768-4609-858e-678f62fa7d7d tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca64e317-07dd-4a2e-a256-0f9f5070299e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2890ad24-8aaa-4486-bef6-82028eee1608', 'volume_name': 'volume-2890ad24-8aaa-4486-bef6-82028eee1608', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b21f35fd-8768-4609-858e-678f62fa7d7d tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (880d17ff-6d14-4ef8-8ff4-8acbc052a1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b21f35fd-8768-4609-858e-678f62fa7d7d tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (880d17ff-6d14-4ef8-8ff4-8acbc052a1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b21f35fd-8768-4609-858e-678f62fa7d7d tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ece475ba-91d0-430a-856b-79f68ea543e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:51 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-b21f35fd-8768-4609-858e-678f62fa7d7d tempest-GroupSnapshotsTest-801703735 None] Volume 2890ad24-8aaa-4486-bef6-82028eee1608: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2890ad24-8aaa-4486-bef6-82028eee1608', 'volume_size': 1} Sep 03 14:22:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b21f35fd-8768-4609-858e-678f62fa7d7d tempest-GroupSnapshotsTest-801703735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:22:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b21f35fd-8768-4609-858e-678f62fa7d7d tempest-GroupSnapshotsTest-801703735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:22:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b21f35fd-8768-4609-858e-678f62fa7d7d tempest-GroupSnapshotsTest-801703735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=028a8a62-0c24-4334-b2e7-2f4b1621b4da,created_at=2026-09-03T12:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1941926245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=028a8a62-0c24-4334-b2e7-2f4b1621b4da,host='devstack@QuobyteHD#QuobyteHD',id=2890ad24-8aaa-4486-bef6-82028eee1608,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f1cf5b0021e4dcda66d166da40bcd1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:22:51Z,use_quota=True,user_id='773b6757a7aa43e39b1dd5179e480f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46fb3857-cd4d-449d-87e7-2f851a1246e0),volume_type_id=46fb3857-cd4d-449d-87e7-2f851a1246e0)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:22:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-b21f35fd-8768-4609-858e-678f62fa7d7d tempest-GroupSnapshotsTest-801703735 None] Creating volume 2890ad24-8aaa-4486-bef6-82028eee1608 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:22:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b21f35fd-8768-4609-858e-678f62fa7d7d tempest-GroupSnapshotsTest-801703735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:22:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b21f35fd-8768-4609-858e-678f62fa7d7d tempest-GroupSnapshotsTest-801703735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:22:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b21f35fd-8768-4609-858e-678f62fa7d7d tempest-GroupSnapshotsTest-801703735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:22:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b21f35fd-8768-4609-858e-678f62fa7d7d tempest-GroupSnapshotsTest-801703735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:22:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b21f35fd-8768-4609-858e-678f62fa7d7d tempest-GroupSnapshotsTest-801703735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:22:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b21f35fd-8768-4609-858e-678f62fa7d7d tempest-GroupSnapshotsTest-801703735 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:22:51 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-b21f35fd-8768-4609-858e-678f62fa7d7d tempest-GroupSnapshotsTest-801703735 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:22:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b21f35fd-8768-4609-858e-678f62fa7d7d tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2890ad24-8aaa-4486-bef6-82028eee1608 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:51 devstack sudo[93873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2890ad24-8aaa-4486-bef6-82028eee1608 1073741824 Sep 03 14:22:51 devstack sudo[93873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:51 devstack cinder-volume[87007]: DEBUG oslo_service.periodic_task [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87007) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 14:22:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:22:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:22:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:22:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:22:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:22:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:51 devstack sudo[93875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:22:51 devstack sudo[93875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:51 devstack sudo[93875]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.353s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:51 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:22:51 devstack cinder-volume[87007]: DEBUG oslo_service.periodic_task [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running periodic task VolumeManager._thread_info {{(pid=87007) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 14:22:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] thread count: 28 {{(pid=87007) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 14:22:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] thread info: [<_MainThread(MainThread, started 123689171054720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87007) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 14:22:52 devstack sudo[93873]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b21f35fd-8768-4609-858e-678f62fa7d7d tempest-GroupSnapshotsTest-801703735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2890ad24-8aaa-4486-bef6-82028eee1608 1073741824" returned: 0 in 0.556s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b21f35fd-8768-4609-858e-678f62fa7d7d tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2890ad24-8aaa-4486-bef6-82028eee1608 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:52 devstack sudo[93881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2890ad24-8aaa-4486-bef6-82028eee1608 Sep 03 14:22:52 devstack sudo[93881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:52 devstack sudo[93881]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b21f35fd-8768-4609-858e-678f62fa7d7d tempest-GroupSnapshotsTest-801703735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2890ad24-8aaa-4486-bef6-82028eee1608" returned: 0 in 0.380s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:52 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b21f35fd-8768-4609-858e-678f62fa7d7d tempest-GroupSnapshotsTest-801703735 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:22:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b21f35fd-8768-4609-858e-678f62fa7d7d tempest-GroupSnapshotsTest-801703735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:22:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b21f35fd-8768-4609-858e-678f62fa7d7d tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ece475ba-91d0-430a-856b-79f68ea543e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2890ad24-8aaa-4486-bef6-82028eee1608', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b21f35fd-8768-4609-858e-678f62fa7d7d tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77b706bc-a4f5-47d0-8db2-85b4924a8bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:52 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-b21f35fd-8768-4609-858e-678f62fa7d7d tempest-GroupSnapshotsTest-801703735 None] Volume volume-2890ad24-8aaa-4486-bef6-82028eee1608 (2890ad24-8aaa-4486-bef6-82028eee1608): created successfully Sep 03 14:22:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b21f35fd-8768-4609-858e-678f62fa7d7d tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77b706bc-a4f5-47d0-8db2-85b4924a8bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b21f35fd-8768-4609-858e-678f62fa7d7d tempest-GroupSnapshotsTest-801703735 None] Flow 'volume_create_manager' (dac19d6d-fa6c-4441-b1b7-e7e38e5a3b4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:22:52 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-b21f35fd-8768-4609-858e-678f62fa7d7d tempest-GroupSnapshotsTest-801703735 None] Created volume successfully. Sep 03 14:22:54 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-1ab5162d-d7c3-4106-a8a7-8b1b1fc26112 tempest-GroupSnapshotsTest-801703735 None] Update group completed successfully. Sep 03 14:22:55 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-0b847839-9416-42b3-b3c0-65dbb7fc5d97 tempest-GroupSnapshotsTest-801703735 None] Update group completed successfully. Sep 03 14:22:55 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-61bdb072-7001-468e-8efe-d72178de2bc3 tempest-GroupSnapshotsTest-801703735 None] Update group completed successfully. Sep 03 14:22:55 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-eacb3b18-ee21-4f41-98c0-6e34d465a10a req-8c23422b-f6f9-4030-bcee-5f4200ddf65c tempest-AttachVolumeTestJSON-1766853988 None] Terminate volume connection completed successfully. Sep 03 14:22:55 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-eacb3b18-ee21-4f41-98c0-6e34d465a10a req-8c23422b-f6f9-4030-bcee-5f4200ddf65c tempest-AttachVolumeTestJSON-1766853988 None] Deleting attachment 789cf286-2df3-454f-a616-2731219840d8. {{(pid=87007) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 14:22:56 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-278ae4e5-1cc7-4475-9a36-24c432749560 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:22:56 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-278ae4e5-1cc7-4475-9a36-24c432749560 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Flow 'volume_create_manager' (8ca4eb6a-cb22-4fcc-9ebe-f19d1111b354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:22:56 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-278ae4e5-1cc7-4475-9a36-24c432749560 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (560645b8-25ba-47eb-afa7-6f312a539a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:56 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-278ae4e5-1cc7-4475-9a36-24c432749560 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (560645b8-25ba-47eb-afa7-6f312a539a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1697582444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e21f3db5-70f8-4f2f-b52f-0d667be3a755,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51e3392d181e4b96954ae2d3515bd821',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:22:56Z,use_quota=True,user_id='ca349f4d0fb54e86a175d2b43a19611b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:56 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-278ae4e5-1cc7-4475-9a36-24c432749560 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72e025b6-4f9f-428e-b656-ed35033928fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:56 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-278ae4e5-1cc7-4475-9a36-24c432749560 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72e025b6-4f9f-428e-b656-ed35033928fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:56 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-278ae4e5-1cc7-4475-9a36-24c432749560 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82c8241f-c85b-43e2-b0a5-2dc0e07a00ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:56 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-278ae4e5-1cc7-4475-9a36-24c432749560 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82c8241f-c85b-43e2-b0a5-2dc0e07a00ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e21f3db5-70f8-4f2f-b52f-0d667be3a755', 'volume_name': 'volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:56 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-278ae4e5-1cc7-4475-9a36-24c432749560 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ddcd223-e426-48ad-95ce-d8ce8c5b3f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:56 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-278ae4e5-1cc7-4475-9a36-24c432749560 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ddcd223-e426-48ad-95ce-d8ce8c5b3f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:56 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-278ae4e5-1cc7-4475-9a36-24c432749560 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b08eaeb-a431-45bc-8c08-c2942433bff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:56 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-278ae4e5-1cc7-4475-9a36-24c432749560 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Volume e21f3db5-70f8-4f2f-b52f-0d667be3a755: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755', 'volume_size': 1} Sep 03 14:22:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-278ae4e5-1cc7-4475-9a36-24c432749560 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:22:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-278ae4e5-1cc7-4475-9a36-24c432749560 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:22:56 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-278ae4e5-1cc7-4475-9a36-24c432749560 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1697582444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e21f3db5-70f8-4f2f-b52f-0d667be3a755,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51e3392d181e4b96954ae2d3515bd821',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:22:56Z,use_quota=True,user_id='ca349f4d0fb54e86a175d2b43a19611b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:22:56 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-278ae4e5-1cc7-4475-9a36-24c432749560 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Creating volume e21f3db5-70f8-4f2f-b52f-0d667be3a755 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:22:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-278ae4e5-1cc7-4475-9a36-24c432749560 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:22:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-278ae4e5-1cc7-4475-9a36-24c432749560 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:22:56 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-278ae4e5-1cc7-4475-9a36-24c432749560 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:22:56 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-278ae4e5-1cc7-4475-9a36-24c432749560 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:22:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-278ae4e5-1cc7-4475-9a36-24c432749560 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:22:56 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-278ae4e5-1cc7-4475-9a36-24c432749560 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:22:56 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-278ae4e5-1cc7-4475-9a36-24c432749560 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:22:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-278ae4e5-1cc7-4475-9a36-24c432749560 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:56 devstack sudo[93891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755 1073741824 Sep 03 14:22:56 devstack sudo[93891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:56 devstack sudo[93891]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-278ae4e5-1cc7-4475-9a36-24c432749560 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755 1073741824" returned: 0 in 0.555s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:56 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:SELECT=122,cinder:UPDATE=125,cinder:DELETE=8,cinder:INSERT=23 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:22:56 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:UPDATE=127,cinder:SELECT=107,cinder:INSERT=34,cinder:DELETE=8 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:22:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-278ae4e5-1cc7-4475-9a36-24c432749560 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:56 devstack sudo[93898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755 Sep 03 14:22:56 devstack sudo[93898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:57 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-8775f3d2-d724-49bc-a7ea-9fd398f02b43 tempest-GroupSnapshotsTest-801703735 None] Update group completed successfully. Sep 03 14:22:57 devstack sudo[93898]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-278ae4e5-1cc7-4475-9a36-24c432749560 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755" returned: 0 in 0.432s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:57 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-278ae4e5-1cc7-4475-9a36-24c432749560 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:22:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-278ae4e5-1cc7-4475-9a36-24c432749560 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:22:57 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-278ae4e5-1cc7-4475-9a36-24c432749560 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b08eaeb-a431-45bc-8c08-c2942433bff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:57 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-278ae4e5-1cc7-4475-9a36-24c432749560 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fd567cc-b367-4569-a6b6-e17f6a6f45b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:22:57 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-278ae4e5-1cc7-4475-9a36-24c432749560 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Volume volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755 (e21f3db5-70f8-4f2f-b52f-0d667be3a755): created successfully Sep 03 14:22:57 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-278ae4e5-1cc7-4475-9a36-24c432749560 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fd567cc-b367-4569-a6b6-e17f6a6f45b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:22:57 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-278ae4e5-1cc7-4475-9a36-24c432749560 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Flow 'volume_create_manager' (8ca4eb6a-cb22-4fcc-9ebe-f19d1111b354) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:22:57 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-278ae4e5-1cc7-4475-9a36-24c432749560 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Created volume successfully. Sep 03 14:22:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-26e03a1a-f04a-44a1-aa56-cc2cc450ddd2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:22:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-26e03a1a-f04a-44a1-aa56-cc2cc450ddd2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:22:58 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-26e03a1a-f04a-44a1-aa56-cc2cc450ddd2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Creating offline snapshot 58164875-3056-4fd4-911c-0f0b11b5d36d of volume e21f3db5-70f8-4f2f-b52f-0d667be3a755 {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:22:58 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe509531-429a-4601-a4e4-7a3448538cac]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:22:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-26e03a1a-f04a-44a1-aa56-cc2cc450ddd2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:58 devstack sudo[93905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755 Sep 03 14:22:58 devstack sudo[93905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:58 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-a6dd0f21-4dbe-48de-8a29-4e01e9809623 tempest-GroupSnapshotsTest-801703735 None] GroupSnapshot f4e49325-d42a-42eb-8792-3ded8f4837e9: creating. Sep 03 14:22:58 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a6dd0f21-4dbe-48de-8a29-4e01e9809623 tempest-GroupSnapshotsTest-801703735 None] Group snapshot f4e49325-d42a-42eb-8792-3ded8f4837e9: creating. {{(pid=87007) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 03 14:22:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a6dd0f21-4dbe-48de-8a29-4e01e9809623 tempest-GroupSnapshotsTest-801703735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:22:59 devstack sudo[93905]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-26e03a1a-f04a-44a1-aa56-cc2cc450ddd2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755" returned: 0 in 0.486s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-26e03a1a-f04a-44a1-aa56-cc2cc450ddd2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755.58164875-3056-4fd4-911c-0f0b11b5d36d 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:59 devstack sudo[93912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755.58164875-3056-4fd4-911c-0f0b11b5d36d 1G Sep 03 14:22:59 devstack sudo[93912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:22:59 devstack sudo[93912]: pam_unix(sudo:session): session closed for user root Sep 03 14:22:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-26e03a1a-f04a-44a1-aa56-cc2cc450ddd2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755.58164875-3056-4fd4-911c-0f0b11b5d36d 1G" returned: 0 in 0.574s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:22:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-26e03a1a-f04a-44a1-aa56-cc2cc450ddd2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755.58164875-3056-4fd4-911c-0f0b11b5d36d {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:22:59 devstack sudo[93957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755.58164875-3056-4fd4-911c-0f0b11b5d36d Sep 03 14:22:59 devstack sudo[93957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:00 devstack sudo[93957]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-26e03a1a-f04a-44a1-aa56-cc2cc450ddd2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755.58164875-3056-4fd4-911c-0f0b11b5d36d" returned: 0 in 0.517s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:00 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-26e03a1a-f04a-44a1-aa56-cc2cc450ddd2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755.58164875-3056-4fd4-911c-0f0b11b5d36d is being set with open permissions: ugo+rw Sep 03 14:23:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-26e03a1a-f04a-44a1-aa56-cc2cc450ddd2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755.58164875-3056-4fd4-911c-0f0b11b5d36d {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:00 devstack sudo[93976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755.58164875-3056-4fd4-911c-0f0b11b5d36d Sep 03 14:23:00 devstack sudo[93976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:00 devstack sudo[93976]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-26e03a1a-f04a-44a1-aa56-cc2cc450ddd2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755.58164875-3056-4fd4-911c-0f0b11b5d36d" returned: 0 in 0.548s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-26e03a1a-f04a-44a1-aa56-cc2cc450ddd2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:00 devstack sudo[93993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755.info Sep 03 14:23:00 devstack sudo[93993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:01 devstack sudo[93993]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-26e03a1a-f04a-44a1-aa56-cc2cc450ddd2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755.info" returned: 0 in 0.296s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:01 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-26e03a1a-f04a-44a1-aa56-cc2cc450ddd2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755.info is being set with open permissions: ugo+rw Sep 03 14:23:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-26e03a1a-f04a-44a1-aa56-cc2cc450ddd2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:01 devstack sudo[94001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755.info Sep 03 14:23:01 devstack sudo[94001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:01 devstack sudo[94001]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-26e03a1a-f04a-44a1-aa56-cc2cc450ddd2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755.info" returned: 0 in 0.350s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-26e03a1a-f04a-44a1-aa56-cc2cc450ddd2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.936s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:23:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a6dd0f21-4dbe-48de-8a29-4e01e9809623 tempest-GroupSnapshotsTest-801703735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.679s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:23:01 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-a6dd0f21-4dbe-48de-8a29-4e01e9809623 tempest-GroupSnapshotsTest-801703735 None] Creating offline snapshot 3a0dd3aa-ec8a-4e3a-8a35-42bac6388031 of volume 6dfe970a-1f45-4246-b4fa-d8fcf197b17c {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:23:01 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-26e03a1a-f04a-44a1-aa56-cc2cc450ddd2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Create snapshot completed successfully Sep 03 14:23:01 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[274c01d6-69e3-452b-8992-58deed8fad2f]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:23:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a6dd0f21-4dbe-48de-8a29-4e01e9809623 tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:01 devstack sudo[94047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c Sep 03 14:23:01 devstack sudo[94047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:02 devstack sudo[94047]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a6dd0f21-4dbe-48de-8a29-4e01e9809623 tempest-GroupSnapshotsTest-801703735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c" returned: 0 in 0.604s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a6dd0f21-4dbe-48de-8a29-4e01e9809623 tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c.3a0dd3aa-ec8a-4e3a-8a35-42bac6388031 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:02 devstack sudo[94071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c.3a0dd3aa-ec8a-4e3a-8a35-42bac6388031 1G Sep 03 14:23:02 devstack sudo[94071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:02 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9a0140b9-e795-4b12-a861-701d9bb2d37e tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Acquiring lock "cinder-58164875-3056-4fd4-911c-0f0b11b5d36d-delete_snapshot" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:23:02 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9a0140b9-e795-4b12-a861-701d9bb2d37e tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Lock "cinder-58164875-3056-4fd4-911c-0f0b11b5d36d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:23:02 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9a0140b9-e795-4b12-a861-701d9bb2d37e tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Acquiring lock "cinder-quobyte-e21f3db5-70f8-4f2f-b52f-0d667be3a755" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:23:02 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9a0140b9-e795-4b12-a861-701d9bb2d37e tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Lock "cinder-quobyte-e21f3db5-70f8-4f2f-b52f-0d667be3a755" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:23:02 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9a0140b9-e795-4b12-a861-701d9bb2d37e tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Acquiring lock "cinder-quobyte-58164875-3056-4fd4-911c-0f0b11b5d36d" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:23:02 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9a0140b9-e795-4b12-a861-701d9bb2d37e tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Lock "cinder-quobyte-58164875-3056-4fd4-911c-0f0b11b5d36d" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:23:02 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-9a0140b9-e795-4b12-a861-701d9bb2d37e tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Deleting offline snapshot 58164875-3056-4fd4-911c-0f0b11b5d36d of volume e21f3db5-70f8-4f2f-b52f-0d667be3a755 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:23:02 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-9a0140b9-e795-4b12-a861-701d9bb2d37e tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] snapshot_file for this snap is: volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755.58164875-3056-4fd4-911c-0f0b11b5d36d {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:23:02 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b076cf97-857c-4d29-b04a-3e6e03703484]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:23:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9a0140b9-e795-4b12-a861-701d9bb2d37e tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755.58164875-3056-4fd4-911c-0f0b11b5d36d {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:02 devstack sudo[94071]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a6dd0f21-4dbe-48de-8a29-4e01e9809623 tempest-GroupSnapshotsTest-801703735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c.3a0dd3aa-ec8a-4e3a-8a35-42bac6388031 1G" returned: 0 in 0.843s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a6dd0f21-4dbe-48de-8a29-4e01e9809623 tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c.3a0dd3aa-ec8a-4e3a-8a35-42bac6388031 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:03 devstack sudo[94099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c.3a0dd3aa-ec8a-4e3a-8a35-42bac6388031 Sep 03 14:23:03 devstack sudo[94099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:03 devstack sudo[94094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755.58164875-3056-4fd4-911c-0f0b11b5d36d Sep 03 14:23:03 devstack sudo[94094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:03 devstack sudo[94099]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a6dd0f21-4dbe-48de-8a29-4e01e9809623 tempest-GroupSnapshotsTest-801703735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c.3a0dd3aa-ec8a-4e3a-8a35-42bac6388031" returned: 0 in 0.594s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:03 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-a6dd0f21-4dbe-48de-8a29-4e01e9809623 tempest-GroupSnapshotsTest-801703735 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c.3a0dd3aa-ec8a-4e3a-8a35-42bac6388031 is being set with open permissions: ugo+rw: NotImplementedError Sep 03 14:23:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a6dd0f21-4dbe-48de-8a29-4e01e9809623 tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c.3a0dd3aa-ec8a-4e3a-8a35-42bac6388031 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:03 devstack sudo[94094]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9a0140b9-e795-4b12-a861-701d9bb2d37e tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755.58164875-3056-4fd4-911c-0f0b11b5d36d" returned: 0 in 0.691s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:03 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-9a0140b9-e795-4b12-a861-701d9bb2d37e tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:23:03 devstack sudo[94111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c.3a0dd3aa-ec8a-4e3a-8a35-42bac6388031 Sep 03 14:23:03 devstack sudo[94111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:03 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[03346e6f-3270-43d2-94bb-279e5a72563f]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:23:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9a0140b9-e795-4b12-a861-701d9bb2d37e tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:03 devstack sudo[94113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755 Sep 03 14:23:03 devstack sudo[94113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:04 devstack sudo[94111]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a6dd0f21-4dbe-48de-8a29-4e01e9809623 tempest-GroupSnapshotsTest-801703735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c.3a0dd3aa-ec8a-4e3a-8a35-42bac6388031" returned: 0 in 0.504s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a6dd0f21-4dbe-48de-8a29-4e01e9809623 tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:04 devstack sudo[94117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c.info Sep 03 14:23:04 devstack sudo[94117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:04 devstack sudo[94113]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9a0140b9-e795-4b12-a861-701d9bb2d37e tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755" returned: 0 in 0.747s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9a0140b9-e795-4b12-a861-701d9bb2d37e tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755.58164875-3056-4fd4-911c-0f0b11b5d36d {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:04 devstack sudo[94122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755.58164875-3056-4fd4-911c-0f0b11b5d36d Sep 03 14:23:04 devstack sudo[94122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:04 devstack sudo[94117]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a6dd0f21-4dbe-48de-8a29-4e01e9809623 tempest-GroupSnapshotsTest-801703735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c.info" returned: 0 in 0.356s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:04 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-a6dd0f21-4dbe-48de-8a29-4e01e9809623 tempest-GroupSnapshotsTest-801703735 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c.info is being set with open permissions: ugo+rw: NotImplementedError Sep 03 14:23:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a6dd0f21-4dbe-48de-8a29-4e01e9809623 tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:04 devstack sudo[94125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c.info Sep 03 14:23:04 devstack sudo[94125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:05 devstack sudo[94125]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a6dd0f21-4dbe-48de-8a29-4e01e9809623 tempest-GroupSnapshotsTest-801703735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c.info" returned: 0 in 0.459s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:05 devstack sudo[94122]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a6dd0f21-4dbe-48de-8a29-4e01e9809623 tempest-GroupSnapshotsTest-801703735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.559s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:23:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a6dd0f21-4dbe-48de-8a29-4e01e9809623 tempest-GroupSnapshotsTest-801703735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:23:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a6dd0f21-4dbe-48de-8a29-4e01e9809623 tempest-GroupSnapshotsTest-801703735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:23:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9a0140b9-e795-4b12-a861-701d9bb2d37e tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755.58164875-3056-4fd4-911c-0f0b11b5d36d" returned: 0 in 0.594s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9a0140b9-e795-4b12-a861-701d9bb2d37e tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755.58164875-3056-4fd4-911c-0f0b11b5d36d {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:05 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-a6dd0f21-4dbe-48de-8a29-4e01e9809623 tempest-GroupSnapshotsTest-801703735 None] Creating offline snapshot d1f71d2c-f7fa-43f3-9582-16415e8b8e24 of volume 2890ad24-8aaa-4486-bef6-82028eee1608 {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:23:05 devstack sudo[94131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755.58164875-3056-4fd4-911c-0f0b11b5d36d Sep 03 14:23:05 devstack sudo[94131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:05 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[588547b4-46f7-45e8-bbea-f5144b5535e9]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:23:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a6dd0f21-4dbe-48de-8a29-4e01e9809623 tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2890ad24-8aaa-4486-bef6-82028eee1608 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:05 devstack sudo[94133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2890ad24-8aaa-4486-bef6-82028eee1608 Sep 03 14:23:05 devstack sudo[94133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:05 devstack sudo[94131]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9a0140b9-e795-4b12-a861-701d9bb2d37e tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755.58164875-3056-4fd4-911c-0f0b11b5d36d" returned: 0 in 0.382s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:05 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9a0140b9-e795-4b12-a861-701d9bb2d37e tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Lock "cinder-quobyte-58164875-3056-4fd4-911c-0f0b11b5d36d" released by "_delete_snapshot" :: held 2.597s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:23:05 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9a0140b9-e795-4b12-a861-701d9bb2d37e tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Lock "cinder-quobyte-e21f3db5-70f8-4f2f-b52f-0d667be3a755" released by "delete_snapshot" :: held 2.651s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:23:05 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-9a0140b9-e795-4b12-a861-701d9bb2d37e tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Created reservations ['3ec3ed7e-984a-49d3-bb33-e54486046a5a', '60b81e73-f69c-4792-adc8-63338e4bb533', 'cc04f656-4eab-44ad-93ea-128b3bdbb3c8', '0d04fa03-acf1-4525-8670-50dc9aa1c8c4'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:23:05 devstack sudo[94133]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a6dd0f21-4dbe-48de-8a29-4e01e9809623 tempest-GroupSnapshotsTest-801703735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2890ad24-8aaa-4486-bef6-82028eee1608" returned: 0 in 0.528s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a6dd0f21-4dbe-48de-8a29-4e01e9809623 tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2890ad24-8aaa-4486-bef6-82028eee1608,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2890ad24-8aaa-4486-bef6-82028eee1608.d1f71d2c-f7fa-43f3-9582-16415e8b8e24 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:05 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-9a0140b9-e795-4b12-a861-701d9bb2d37e tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Delete snapshot completed successfully. Sep 03 14:23:05 devstack sudo[94140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2890ad24-8aaa-4486-bef6-82028eee1608,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2890ad24-8aaa-4486-bef6-82028eee1608.d1f71d2c-f7fa-43f3-9582-16415e8b8e24 1G Sep 03 14:23:05 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9a0140b9-e795-4b12-a861-701d9bb2d37e tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Lock "cinder-58164875-3056-4fd4-911c-0f0b11b5d36d-delete_snapshot" released by "delete_snapshot" :: held 2.874s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:23:05 devstack sudo[94140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:06 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2a50987d-c64c-4f56-88c7-4b5f5abf55c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Acquiring lock "cinder-e21f3db5-70f8-4f2f-b52f-0d667be3a755-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:23:06 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2a50987d-c64c-4f56-88c7-4b5f5abf55c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Lock "cinder-e21f3db5-70f8-4f2f-b52f-0d667be3a755-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:23:06 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2a50987d-c64c-4f56-88c7-4b5f5abf55c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Acquiring lock "cinder-quobyte-e21f3db5-70f8-4f2f-b52f-0d667be3a755" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:23:06 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2a50987d-c64c-4f56-88c7-4b5f5abf55c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Lock "cinder-quobyte-e21f3db5-70f8-4f2f-b52f-0d667be3a755" acquired by "delete_volume" :: waited 0.014s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:23:06 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d269b14d-4d90-4c16-85a0-2d0c8b1c631d]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:23:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2a50987d-c64c-4f56-88c7-4b5f5abf55c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:06 devstack sudo[94140]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a6dd0f21-4dbe-48de-8a29-4e01e9809623 tempest-GroupSnapshotsTest-801703735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2890ad24-8aaa-4486-bef6-82028eee1608,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2890ad24-8aaa-4486-bef6-82028eee1608.d1f71d2c-f7fa-43f3-9582-16415e8b8e24 1G" returned: 0 in 0.735s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a6dd0f21-4dbe-48de-8a29-4e01e9809623 tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2890ad24-8aaa-4486-bef6-82028eee1608 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2890ad24-8aaa-4486-bef6-82028eee1608.d1f71d2c-f7fa-43f3-9582-16415e8b8e24 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:06 devstack sudo[94149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2890ad24-8aaa-4486-bef6-82028eee1608 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2890ad24-8aaa-4486-bef6-82028eee1608.d1f71d2c-f7fa-43f3-9582-16415e8b8e24 Sep 03 14:23:06 devstack sudo[94149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:06 devstack sudo[94148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755 Sep 03 14:23:06 devstack sudo[94148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:07 devstack sudo[94149]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a6dd0f21-4dbe-48de-8a29-4e01e9809623 tempest-GroupSnapshotsTest-801703735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2890ad24-8aaa-4486-bef6-82028eee1608 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2890ad24-8aaa-4486-bef6-82028eee1608.d1f71d2c-f7fa-43f3-9582-16415e8b8e24" returned: 0 in 0.731s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:07 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-a6dd0f21-4dbe-48de-8a29-4e01e9809623 tempest-GroupSnapshotsTest-801703735 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2890ad24-8aaa-4486-bef6-82028eee1608.d1f71d2c-f7fa-43f3-9582-16415e8b8e24 is being set with open permissions: ugo+rw: NotImplementedError Sep 03 14:23:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a6dd0f21-4dbe-48de-8a29-4e01e9809623 tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2890ad24-8aaa-4486-bef6-82028eee1608.d1f71d2c-f7fa-43f3-9582-16415e8b8e24 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:07 devstack sudo[94197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2890ad24-8aaa-4486-bef6-82028eee1608.d1f71d2c-f7fa-43f3-9582-16415e8b8e24 Sep 03 14:23:07 devstack sudo[94197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:07 devstack sudo[94148]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2a50987d-c64c-4f56-88c7-4b5f5abf55c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755" returned: 0 in 0.934s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2a50987d-c64c-4f56-88c7-4b5f5abf55c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:07 devstack sudo[94212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755 Sep 03 14:23:07 devstack sudo[94212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:07 devstack sudo[94212]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2a50987d-c64c-4f56-88c7-4b5f5abf55c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e21f3db5-70f8-4f2f-b52f-0d667be3a755" returned: 0 in 0.416s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:07 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2a50987d-c64c-4f56-88c7-4b5f5abf55c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Lock "cinder-quobyte-e21f3db5-70f8-4f2f-b52f-0d667be3a755" released by "delete_volume" :: held 1.429s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:23:07 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-2a50987d-c64c-4f56-88c7-4b5f5abf55c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Created reservations ['b74f3a5f-3049-4538-9e48-0f3c0deb5626', 'ddd2e00f-451f-4a99-8c41-b9c363208a78', '6f24ee31-dba3-4c5e-a311-86104d7585c6', '95c0c732-8abe-4fe2-a671-847265c95c8e'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:23:07 devstack sudo[94197]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a6dd0f21-4dbe-48de-8a29-4e01e9809623 tempest-GroupSnapshotsTest-801703735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2890ad24-8aaa-4486-bef6-82028eee1608.d1f71d2c-f7fa-43f3-9582-16415e8b8e24" returned: 0 in 0.895s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a6dd0f21-4dbe-48de-8a29-4e01e9809623 tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2890ad24-8aaa-4486-bef6-82028eee1608.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:08 devstack sudo[94228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2890ad24-8aaa-4486-bef6-82028eee1608.info Sep 03 14:23:08 devstack sudo[94228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2a50987d-c64c-4f56-88c7-4b5f5abf55c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:23:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2a50987d-c64c-4f56-88c7-4b5f5abf55c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:23:08 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2a50987d-c64c-4f56-88c7-4b5f5abf55c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:23:08 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2a50987d-c64c-4f56-88c7-4b5f5abf55c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:23:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2a50987d-c64c-4f56-88c7-4b5f5abf55c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:23:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2a50987d-c64c-4f56-88c7-4b5f5abf55c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:08 devstack sudo[94231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:23:08 devstack sudo[94231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:08 devstack sudo[94228]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a6dd0f21-4dbe-48de-8a29-4e01e9809623 tempest-GroupSnapshotsTest-801703735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2890ad24-8aaa-4486-bef6-82028eee1608.info" returned: 0 in 0.492s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:08 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-a6dd0f21-4dbe-48de-8a29-4e01e9809623 tempest-GroupSnapshotsTest-801703735 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2890ad24-8aaa-4486-bef6-82028eee1608.info is being set with open permissions: ugo+rw: NotImplementedError Sep 03 14:23:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a6dd0f21-4dbe-48de-8a29-4e01e9809623 tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2890ad24-8aaa-4486-bef6-82028eee1608.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:08 devstack sudo[94238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2890ad24-8aaa-4486-bef6-82028eee1608.info Sep 03 14:23:08 devstack sudo[94238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:08 devstack sudo[94231]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2a50987d-c64c-4f56-88c7-4b5f5abf55c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.475s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:08 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-2a50987d-c64c-4f56-88c7-4b5f5abf55c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:23:08 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-2a50987d-c64c-4f56-88c7-4b5f5abf55c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Deleted volume successfully. Sep 03 14:23:08 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2a50987d-c64c-4f56-88c7-4b5f5abf55c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494274100 None] Lock "cinder-e21f3db5-70f8-4f2f-b52f-0d667be3a755-delete_volume" released by "delete_volume" :: held 2.677s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:23:09 devstack sudo[94238]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a6dd0f21-4dbe-48de-8a29-4e01e9809623 tempest-GroupSnapshotsTest-801703735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2890ad24-8aaa-4486-bef6-82028eee1608.info" returned: 0 in 0.553s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a6dd0f21-4dbe-48de-8a29-4e01e9809623 tempest-GroupSnapshotsTest-801703735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.218s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:23:09 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-a6dd0f21-4dbe-48de-8a29-4e01e9809623 tempest-GroupSnapshotsTest-801703735 None] group_snapshot f4e49325-d42a-42eb-8792-3ded8f4837e9: created successfully Sep 03 14:23:09 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-aa7a266c-0136-4929-ae1d-6c271bbd3ab2 tempest-GroupSnapshotsTest-801703735 None] group_snapshot f4e49325-d42a-42eb-8792-3ded8f4837e9: deleting Sep 03 14:23:09 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-aa7a266c-0136-4929-ae1d-6c271bbd3ab2 tempest-GroupSnapshotsTest-801703735 None] group_snapshot f4e49325-d42a-42eb-8792-3ded8f4837e9: deleting {{(pid=87007) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 03 14:23:10 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-aa7a266c-0136-4929-ae1d-6c271bbd3ab2 tempest-GroupSnapshotsTest-801703735 None] Acquiring lock "cinder-quobyte-6dfe970a-1f45-4246-b4fa-d8fcf197b17c" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:23:10 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-aa7a266c-0136-4929-ae1d-6c271bbd3ab2 tempest-GroupSnapshotsTest-801703735 None] Lock "cinder-quobyte-6dfe970a-1f45-4246-b4fa-d8fcf197b17c" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:23:10 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-aa7a266c-0136-4929-ae1d-6c271bbd3ab2 tempest-GroupSnapshotsTest-801703735 None] Acquiring lock "cinder-quobyte-3a0dd3aa-ec8a-4e3a-8a35-42bac6388031" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:23:10 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-aa7a266c-0136-4929-ae1d-6c271bbd3ab2 tempest-GroupSnapshotsTest-801703735 None] Lock "cinder-quobyte-3a0dd3aa-ec8a-4e3a-8a35-42bac6388031" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:23:10 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-aa7a266c-0136-4929-ae1d-6c271bbd3ab2 tempest-GroupSnapshotsTest-801703735 None] Deleting offline snapshot 3a0dd3aa-ec8a-4e3a-8a35-42bac6388031 of volume 6dfe970a-1f45-4246-b4fa-d8fcf197b17c {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:23:10 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-aa7a266c-0136-4929-ae1d-6c271bbd3ab2 tempest-GroupSnapshotsTest-801703735 None] snapshot_file for this snap is: volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c.3a0dd3aa-ec8a-4e3a-8a35-42bac6388031 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:23:10 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[41998fd6-1a3f-41a5-ae1d-a3711d27c955]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:23:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-aa7a266c-0136-4929-ae1d-6c271bbd3ab2 tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c.3a0dd3aa-ec8a-4e3a-8a35-42bac6388031 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:10 devstack sudo[94243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c.3a0dd3aa-ec8a-4e3a-8a35-42bac6388031 Sep 03 14:23:10 devstack sudo[94243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:10 devstack sudo[94243]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-aa7a266c-0136-4929-ae1d-6c271bbd3ab2 tempest-GroupSnapshotsTest-801703735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c.3a0dd3aa-ec8a-4e3a-8a35-42bac6388031" returned: 0 in 0.789s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:11 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-aa7a266c-0136-4929-ae1d-6c271bbd3ab2 tempest-GroupSnapshotsTest-801703735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:23:11 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a821e2f5-bb41-469f-97ad-0c6e30630c54]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:23:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-aa7a266c-0136-4929-ae1d-6c271bbd3ab2 tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:11 devstack sudo[94250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c Sep 03 14:23:11 devstack sudo[94250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:11 devstack sudo[94250]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-aa7a266c-0136-4929-ae1d-6c271bbd3ab2 tempest-GroupSnapshotsTest-801703735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c" returned: 0 in 0.775s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-aa7a266c-0136-4929-ae1d-6c271bbd3ab2 tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c.3a0dd3aa-ec8a-4e3a-8a35-42bac6388031 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:11 devstack sudo[94257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c.3a0dd3aa-ec8a-4e3a-8a35-42bac6388031 Sep 03 14:23:11 devstack sudo[94257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:12 devstack sudo[94257]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-aa7a266c-0136-4929-ae1d-6c271bbd3ab2 tempest-GroupSnapshotsTest-801703735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c.3a0dd3aa-ec8a-4e3a-8a35-42bac6388031" returned: 0 in 0.624s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-aa7a266c-0136-4929-ae1d-6c271bbd3ab2 tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c.3a0dd3aa-ec8a-4e3a-8a35-42bac6388031 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:12 devstack sudo[94264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c.3a0dd3aa-ec8a-4e3a-8a35-42bac6388031 Sep 03 14:23:12 devstack sudo[94264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:12 devstack sudo[94264]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-aa7a266c-0136-4929-ae1d-6c271bbd3ab2 tempest-GroupSnapshotsTest-801703735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c.3a0dd3aa-ec8a-4e3a-8a35-42bac6388031" returned: 0 in 0.334s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:12 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-aa7a266c-0136-4929-ae1d-6c271bbd3ab2 tempest-GroupSnapshotsTest-801703735 None] Lock "cinder-quobyte-3a0dd3aa-ec8a-4e3a-8a35-42bac6388031" released by "_delete_snapshot" :: held 2.731s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:23:12 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-aa7a266c-0136-4929-ae1d-6c271bbd3ab2 tempest-GroupSnapshotsTest-801703735 None] Lock "cinder-quobyte-6dfe970a-1f45-4246-b4fa-d8fcf197b17c" released by "delete_snapshot" :: held 2.784s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:23:12 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-aa7a266c-0136-4929-ae1d-6c271bbd3ab2 tempest-GroupSnapshotsTest-801703735 None] Acquiring lock "cinder-quobyte-2890ad24-8aaa-4486-bef6-82028eee1608" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:23:12 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-aa7a266c-0136-4929-ae1d-6c271bbd3ab2 tempest-GroupSnapshotsTest-801703735 None] Lock "cinder-quobyte-2890ad24-8aaa-4486-bef6-82028eee1608" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:23:12 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-aa7a266c-0136-4929-ae1d-6c271bbd3ab2 tempest-GroupSnapshotsTest-801703735 None] Acquiring lock "cinder-quobyte-d1f71d2c-f7fa-43f3-9582-16415e8b8e24" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:23:12 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-aa7a266c-0136-4929-ae1d-6c271bbd3ab2 tempest-GroupSnapshotsTest-801703735 None] Lock "cinder-quobyte-d1f71d2c-f7fa-43f3-9582-16415e8b8e24" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:23:12 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-aa7a266c-0136-4929-ae1d-6c271bbd3ab2 tempest-GroupSnapshotsTest-801703735 None] Deleting offline snapshot d1f71d2c-f7fa-43f3-9582-16415e8b8e24 of volume 2890ad24-8aaa-4486-bef6-82028eee1608 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:23:13 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-aa7a266c-0136-4929-ae1d-6c271bbd3ab2 tempest-GroupSnapshotsTest-801703735 None] snapshot_file for this snap is: volume-2890ad24-8aaa-4486-bef6-82028eee1608.d1f71d2c-f7fa-43f3-9582-16415e8b8e24 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:23:13 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1105de-a2ff-4f5a-b5e9-d656f13e7aa5]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:23:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-aa7a266c-0136-4929-ae1d-6c271bbd3ab2 tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2890ad24-8aaa-4486-bef6-82028eee1608.d1f71d2c-f7fa-43f3-9582-16415e8b8e24 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:13 devstack sudo[94267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2890ad24-8aaa-4486-bef6-82028eee1608.d1f71d2c-f7fa-43f3-9582-16415e8b8e24 Sep 03 14:23:13 devstack sudo[94267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:13 devstack sudo[94267]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-aa7a266c-0136-4929-ae1d-6c271bbd3ab2 tempest-GroupSnapshotsTest-801703735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2890ad24-8aaa-4486-bef6-82028eee1608.d1f71d2c-f7fa-43f3-9582-16415e8b8e24" returned: 0 in 0.628s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:13 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-aa7a266c-0136-4929-ae1d-6c271bbd3ab2 tempest-GroupSnapshotsTest-801703735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2890ad24-8aaa-4486-bef6-82028eee1608(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:23:13 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23891db-3957-4e8f-ab31-2142d404d94b]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:23:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-aa7a266c-0136-4929-ae1d-6c271bbd3ab2 tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2890ad24-8aaa-4486-bef6-82028eee1608 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:13 devstack sudo[94272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2890ad24-8aaa-4486-bef6-82028eee1608 Sep 03 14:23:13 devstack sudo[94272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:14 devstack sudo[94272]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-aa7a266c-0136-4929-ae1d-6c271bbd3ab2 tempest-GroupSnapshotsTest-801703735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2890ad24-8aaa-4486-bef6-82028eee1608" returned: 0 in 0.591s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-aa7a266c-0136-4929-ae1d-6c271bbd3ab2 tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2890ad24-8aaa-4486-bef6-82028eee1608.d1f71d2c-f7fa-43f3-9582-16415e8b8e24 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:14 devstack sudo[94284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2890ad24-8aaa-4486-bef6-82028eee1608.d1f71d2c-f7fa-43f3-9582-16415e8b8e24 Sep 03 14:23:14 devstack sudo[94284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:14 devstack sudo[94284]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-aa7a266c-0136-4929-ae1d-6c271bbd3ab2 tempest-GroupSnapshotsTest-801703735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2890ad24-8aaa-4486-bef6-82028eee1608.d1f71d2c-f7fa-43f3-9582-16415e8b8e24" returned: 0 in 0.528s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-aa7a266c-0136-4929-ae1d-6c271bbd3ab2 tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2890ad24-8aaa-4486-bef6-82028eee1608.d1f71d2c-f7fa-43f3-9582-16415e8b8e24 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:14 devstack sudo[94295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2890ad24-8aaa-4486-bef6-82028eee1608.d1f71d2c-f7fa-43f3-9582-16415e8b8e24 Sep 03 14:23:14 devstack sudo[94295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:15 devstack sudo[94295]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-aa7a266c-0136-4929-ae1d-6c271bbd3ab2 tempest-GroupSnapshotsTest-801703735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2890ad24-8aaa-4486-bef6-82028eee1608.d1f71d2c-f7fa-43f3-9582-16415e8b8e24" returned: 0 in 0.442s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:15 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-aa7a266c-0136-4929-ae1d-6c271bbd3ab2 tempest-GroupSnapshotsTest-801703735 None] Lock "cinder-quobyte-d1f71d2c-f7fa-43f3-9582-16415e8b8e24" released by "_delete_snapshot" :: held 2.394s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:23:15 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-aa7a266c-0136-4929-ae1d-6c271bbd3ab2 tempest-GroupSnapshotsTest-801703735 None] Lock "cinder-quobyte-2890ad24-8aaa-4486-bef6-82028eee1608" released by "delete_snapshot" :: held 2.446s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:23:15 devstack cinder-volume[87007]: WARNING cinder.quota [None req-aa7a266c-0136-4929-ae1d-6c271bbd3ab2 tempest-GroupSnapshotsTest-801703735 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1957878608 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1957878608, it is now deprecated. Please use the default quota class for default quota. Sep 03 14:23:15 devstack cinder-volume[87007]: WARNING cinder.quota [None req-aa7a266c-0136-4929-ae1d-6c271bbd3ab2 tempest-GroupSnapshotsTest-801703735 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1957878608 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1957878608, it is now deprecated. Please use the default quota class for default quota. Sep 03 14:23:15 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-aa7a266c-0136-4929-ae1d-6c271bbd3ab2 tempest-GroupSnapshotsTest-801703735 None] Created reservations ['40684cbe-45b7-4c9e-9e59-fc93297cfa49', '4eb550df-c7bd-41be-bf42-43d27d08f8a2', '883da379-2b6d-4587-bb61-c29d7e2d3fea', '43fe64e4-9a79-465c-b8c9-3aa62c0f2339'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:23:15 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-aa7a266c-0136-4929-ae1d-6c271bbd3ab2 tempest-GroupSnapshotsTest-801703735 None] Created reservations ['db6af4f4-554f-48cd-a4eb-88d498cfbb2e', '8d54be14-53ac-484d-b50c-e0c7cf843b8a', 'dc9c15e0-b2de-4339-9f9b-a92dc29d3ae7', '233e7979-419a-464f-a0f5-ab119d263a3d'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:23:15 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-aa7a266c-0136-4929-ae1d-6c271bbd3ab2 tempest-GroupSnapshotsTest-801703735 None] group_snapshot f4e49325-d42a-42eb-8792-3ded8f4837e9: deleted successfully Sep 03 14:23:16 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b4d427b6-048d-4d76-93a9-529fe4a2cb44 tempest-GroupSnapshotsTest-801703735 None] Acquiring lock "cinder-quobyte-2890ad24-8aaa-4486-bef6-82028eee1608" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:23:16 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b4d427b6-048d-4d76-93a9-529fe4a2cb44 tempest-GroupSnapshotsTest-801703735 None] Lock "cinder-quobyte-2890ad24-8aaa-4486-bef6-82028eee1608" acquired by "delete_volume" :: waited 0.022s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:23:16 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a970b56-c07c-4ee0-abf4-7ad9404c7c97]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:23:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b4d427b6-048d-4d76-93a9-529fe4a2cb44 tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2890ad24-8aaa-4486-bef6-82028eee1608 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:16 devstack sudo[94304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2890ad24-8aaa-4486-bef6-82028eee1608 Sep 03 14:23:16 devstack sudo[94304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:17 devstack sudo[94304]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b4d427b6-048d-4d76-93a9-529fe4a2cb44 tempest-GroupSnapshotsTest-801703735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2890ad24-8aaa-4486-bef6-82028eee1608" returned: 0 in 0.413s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b4d427b6-048d-4d76-93a9-529fe4a2cb44 tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2890ad24-8aaa-4486-bef6-82028eee1608 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:17 devstack sudo[94309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2890ad24-8aaa-4486-bef6-82028eee1608 Sep 03 14:23:17 devstack sudo[94309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:17 devstack sudo[94309]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b4d427b6-048d-4d76-93a9-529fe4a2cb44 tempest-GroupSnapshotsTest-801703735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2890ad24-8aaa-4486-bef6-82028eee1608" returned: 0 in 0.259s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:17 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b4d427b6-048d-4d76-93a9-529fe4a2cb44 tempest-GroupSnapshotsTest-801703735 None] Lock "cinder-quobyte-2890ad24-8aaa-4486-bef6-82028eee1608" released by "delete_volume" :: held 0.768s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:23:17 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b4d427b6-048d-4d76-93a9-529fe4a2cb44 tempest-GroupSnapshotsTest-801703735 None] Acquiring lock "cinder-quobyte-6dfe970a-1f45-4246-b4fa-d8fcf197b17c" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:23:17 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b4d427b6-048d-4d76-93a9-529fe4a2cb44 tempest-GroupSnapshotsTest-801703735 None] Lock "cinder-quobyte-6dfe970a-1f45-4246-b4fa-d8fcf197b17c" acquired by "delete_volume" :: waited 0.017s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:23:17 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6e925b-1faf-4734-a5ec-5f8baed4d8c3]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:23:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b4d427b6-048d-4d76-93a9-529fe4a2cb44 tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:17 devstack sudo[94312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c Sep 03 14:23:17 devstack sudo[94312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:18 devstack sudo[94312]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b4d427b6-048d-4d76-93a9-529fe4a2cb44 tempest-GroupSnapshotsTest-801703735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c" returned: 0 in 0.439s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b4d427b6-048d-4d76-93a9-529fe4a2cb44 tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:18 devstack sudo[94318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c Sep 03 14:23:18 devstack sudo[94318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:18 devstack sudo[94318]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b4d427b6-048d-4d76-93a9-529fe4a2cb44 tempest-GroupSnapshotsTest-801703735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6dfe970a-1f45-4246-b4fa-d8fcf197b17c" returned: 0 in 0.262s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:18 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b4d427b6-048d-4d76-93a9-529fe4a2cb44 tempest-GroupSnapshotsTest-801703735 None] Lock "cinder-quobyte-6dfe970a-1f45-4246-b4fa-d8fcf197b17c" released by "delete_volume" :: held 0.769s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:23:18 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-b4d427b6-048d-4d76-93a9-529fe4a2cb44 tempest-GroupSnapshotsTest-801703735 None] Created reservations ['076bd88c-2feb-4bf3-895a-e1db8c32523f'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:23:18 devstack cinder-volume[87007]: WARNING cinder.quota [None req-b4d427b6-048d-4d76-93a9-529fe4a2cb44 tempest-GroupSnapshotsTest-801703735 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1957878608 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1957878608, it is now deprecated. Please use the default quota class for default quota. Sep 03 14:23:18 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-b4d427b6-048d-4d76-93a9-529fe4a2cb44 tempest-GroupSnapshotsTest-801703735 None] Created reservations ['8780e7a8-8c67-46b7-af08-443d68bba5e7', '335da0a9-4e59-4b5f-9bd4-4bd64b2b5af7', '19928684-1bf3-485c-842b-0a7e373f57bf', '133de0af-dca7-4aa1-bd0f-71990d017991'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:23:18 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-b4d427b6-048d-4d76-93a9-529fe4a2cb44 tempest-GroupSnapshotsTest-801703735 None] Created reservations ['f9f48f25-ef45-460c-9ff3-e0d4d41bc12e', 'ff9447b1-d4f8-48a2-a0f5-afe385edf7f2', 'e71e01a8-6d26-4270-9627-6f692835795e', 'f4d5be1a-c936-42ef-b84d-bbd3520698df'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:23:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b4d427b6-048d-4d76-93a9-529fe4a2cb44 tempest-GroupSnapshotsTest-801703735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:23:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b4d427b6-048d-4d76-93a9-529fe4a2cb44 tempest-GroupSnapshotsTest-801703735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:23:18 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b4d427b6-048d-4d76-93a9-529fe4a2cb44 tempest-GroupSnapshotsTest-801703735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:23:18 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b4d427b6-048d-4d76-93a9-529fe4a2cb44 tempest-GroupSnapshotsTest-801703735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:23:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b4d427b6-048d-4d76-93a9-529fe4a2cb44 tempest-GroupSnapshotsTest-801703735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:23:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b4d427b6-048d-4d76-93a9-529fe4a2cb44 tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:18 devstack sudo[94321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:23:18 devstack sudo[94321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:18 devstack sudo[94321]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b4d427b6-048d-4d76-93a9-529fe4a2cb44 tempest-GroupSnapshotsTest-801703735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.268s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:18 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-b4d427b6-048d-4d76-93a9-529fe4a2cb44 tempest-GroupSnapshotsTest-801703735 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:23:18 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-b4d427b6-048d-4d76-93a9-529fe4a2cb44 tempest-GroupSnapshotsTest-801703735 None] Delete group completed successfully. Sep 03 14:23:19 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-80cff9e3-70f5-4610-accd-1f32bdcaa1f2 tempest-GroupSnapshotsTest-801703735 None] Group tempest-GroupSnapshotsTest-Group-1457207436: creating Sep 03 14:23:19 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-80cff9e3-70f5-4610-accd-1f32bdcaa1f2 tempest-GroupSnapshotsTest-801703735 None] Group tempest-GroupSnapshotsTest-Group-1457207436: created successfully Sep 03 14:23:19 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-80cff9e3-70f5-4610-accd-1f32bdcaa1f2 tempest-GroupSnapshotsTest-801703735 None] Create group completed successfully. Sep 03 14:23:21 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-b27de6fe-190c-43ed-bcfa-a6e5825b1d99 tempest-GroupSnapshotsTest-801703735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:23:21 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b27de6fe-190c-43ed-bcfa-a6e5825b1d99 tempest-GroupSnapshotsTest-801703735 None] Flow 'volume_create_manager' (24109ac3-44d2-431d-a59a-91bf1718c33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:23:21 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b27de6fe-190c-43ed-bcfa-a6e5825b1d99 tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3903181e-4f37-4b16-804e-3fefc8962811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:23:21 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b27de6fe-190c-43ed-bcfa-a6e5825b1d99 tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3903181e-4f37-4b16-804e-3fefc8962811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1828094556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ef9dac97-393c-4c3f-8006-e43c61a1d01a,host='devstack@QuobyteHD#QuobyteHD',id=5c611d0b-c358-4b0d-b4af-5af1666e5752,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f1cf5b0021e4dcda66d166da40bcd1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:23:21Z,use_quota=True,user_id='773b6757a7aa43e39b1dd5179e480f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8d12d12-4fff-4daf-a8f1-fb665cc18068),volume_type_id=f8d12d12-4fff-4daf-a8f1-fb665cc18068)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:23:21 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b27de6fe-190c-43ed-bcfa-a6e5825b1d99 tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88ef1450-5612-4c16-abae-7b4db7fbd5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:23:21 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b27de6fe-190c-43ed-bcfa-a6e5825b1d99 tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88ef1450-5612-4c16-abae-7b4db7fbd5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:23:21 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b27de6fe-190c-43ed-bcfa-a6e5825b1d99 tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cc660ad-7b14-4a6c-9d2f-b43ceb04a1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:23:21 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b27de6fe-190c-43ed-bcfa-a6e5825b1d99 tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cc660ad-7b14-4a6c-9d2f-b43ceb04a1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c611d0b-c358-4b0d-b4af-5af1666e5752', 'volume_name': 'volume-5c611d0b-c358-4b0d-b4af-5af1666e5752', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:23:21 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b27de6fe-190c-43ed-bcfa-a6e5825b1d99 tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (412fa15b-8afb-40a2-b87b-a5202f0f244f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:23:21 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b27de6fe-190c-43ed-bcfa-a6e5825b1d99 tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (412fa15b-8afb-40a2-b87b-a5202f0f244f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:23:21 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b27de6fe-190c-43ed-bcfa-a6e5825b1d99 tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2935fcb-f37c-4195-a5d0-b302789f0367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:23:21 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-b27de6fe-190c-43ed-bcfa-a6e5825b1d99 tempest-GroupSnapshotsTest-801703735 None] Volume 5c611d0b-c358-4b0d-b4af-5af1666e5752: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c611d0b-c358-4b0d-b4af-5af1666e5752', 'volume_size': 1} Sep 03 14:23:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b27de6fe-190c-43ed-bcfa-a6e5825b1d99 tempest-GroupSnapshotsTest-801703735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:23:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b27de6fe-190c-43ed-bcfa-a6e5825b1d99 tempest-GroupSnapshotsTest-801703735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:23:21 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b27de6fe-190c-43ed-bcfa-a6e5825b1d99 tempest-GroupSnapshotsTest-801703735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ef9dac97-393c-4c3f-8006-e43c61a1d01a,created_at=2026-09-03T12:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1828094556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ef9dac97-393c-4c3f-8006-e43c61a1d01a,host='devstack@QuobyteHD#QuobyteHD',id=5c611d0b-c358-4b0d-b4af-5af1666e5752,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f1cf5b0021e4dcda66d166da40bcd1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:23:21Z,use_quota=True,user_id='773b6757a7aa43e39b1dd5179e480f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8d12d12-4fff-4daf-a8f1-fb665cc18068),volume_type_id=f8d12d12-4fff-4daf-a8f1-fb665cc18068)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:23:21 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-b27de6fe-190c-43ed-bcfa-a6e5825b1d99 tempest-GroupSnapshotsTest-801703735 None] Creating volume 5c611d0b-c358-4b0d-b4af-5af1666e5752 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:23:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b27de6fe-190c-43ed-bcfa-a6e5825b1d99 tempest-GroupSnapshotsTest-801703735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:23:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b27de6fe-190c-43ed-bcfa-a6e5825b1d99 tempest-GroupSnapshotsTest-801703735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:23:21 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b27de6fe-190c-43ed-bcfa-a6e5825b1d99 tempest-GroupSnapshotsTest-801703735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:23:21 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b27de6fe-190c-43ed-bcfa-a6e5825b1d99 tempest-GroupSnapshotsTest-801703735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:23:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b27de6fe-190c-43ed-bcfa-a6e5825b1d99 tempest-GroupSnapshotsTest-801703735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:23:21 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b27de6fe-190c-43ed-bcfa-a6e5825b1d99 tempest-GroupSnapshotsTest-801703735 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:23:21 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-b27de6fe-190c-43ed-bcfa-a6e5825b1d99 tempest-GroupSnapshotsTest-801703735 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:23:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b27de6fe-190c-43ed-bcfa-a6e5825b1d99 tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c611d0b-c358-4b0d-b4af-5af1666e5752 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:21 devstack sudo[94324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c611d0b-c358-4b0d-b4af-5af1666e5752 1073741824 Sep 03 14:23:21 devstack sudo[94324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:22 devstack sudo[94324]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b27de6fe-190c-43ed-bcfa-a6e5825b1d99 tempest-GroupSnapshotsTest-801703735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c611d0b-c358-4b0d-b4af-5af1666e5752 1073741824" returned: 0 in 0.471s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b27de6fe-190c-43ed-bcfa-a6e5825b1d99 tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c611d0b-c358-4b0d-b4af-5af1666e5752 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:22 devstack sudo[94329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c611d0b-c358-4b0d-b4af-5af1666e5752 Sep 03 14:23:22 devstack sudo[94329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:22 devstack sudo[94329]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b27de6fe-190c-43ed-bcfa-a6e5825b1d99 tempest-GroupSnapshotsTest-801703735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c611d0b-c358-4b0d-b4af-5af1666e5752" returned: 0 in 0.279s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:22 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b27de6fe-190c-43ed-bcfa-a6e5825b1d99 tempest-GroupSnapshotsTest-801703735 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:23:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b27de6fe-190c-43ed-bcfa-a6e5825b1d99 tempest-GroupSnapshotsTest-801703735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:23:22 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b27de6fe-190c-43ed-bcfa-a6e5825b1d99 tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2935fcb-f37c-4195-a5d0-b302789f0367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c611d0b-c358-4b0d-b4af-5af1666e5752', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:23:22 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b27de6fe-190c-43ed-bcfa-a6e5825b1d99 tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b494544-c4e1-48a1-afbd-d25d407b8785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:23:22 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-b27de6fe-190c-43ed-bcfa-a6e5825b1d99 tempest-GroupSnapshotsTest-801703735 None] Volume volume-5c611d0b-c358-4b0d-b4af-5af1666e5752 (5c611d0b-c358-4b0d-b4af-5af1666e5752): created successfully Sep 03 14:23:22 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b27de6fe-190c-43ed-bcfa-a6e5825b1d99 tempest-GroupSnapshotsTest-801703735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b494544-c4e1-48a1-afbd-d25d407b8785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:23:22 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b27de6fe-190c-43ed-bcfa-a6e5825b1d99 tempest-GroupSnapshotsTest-801703735 None] Flow 'volume_create_manager' (24109ac3-44d2-431d-a59a-91bf1718c33f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:23:22 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-b27de6fe-190c-43ed-bcfa-a6e5825b1d99 tempest-GroupSnapshotsTest-801703735 None] Created volume successfully. Sep 03 14:23:22 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-24902343-2c87-42de-9fa2-f4503346425e tempest-GroupSnapshotsTest-801703735 None] GroupSnapshot b0049fa2-df86-4a60-9e0f-39294a4db292: creating. Sep 03 14:23:22 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-24902343-2c87-42de-9fa2-f4503346425e tempest-GroupSnapshotsTest-801703735 None] Group snapshot b0049fa2-df86-4a60-9e0f-39294a4db292: creating. {{(pid=87007) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 03 14:23:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-24902343-2c87-42de-9fa2-f4503346425e tempest-GroupSnapshotsTest-801703735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:23:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-24902343-2c87-42de-9fa2-f4503346425e tempest-GroupSnapshotsTest-801703735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:23:22 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-24902343-2c87-42de-9fa2-f4503346425e tempest-GroupSnapshotsTest-801703735 None] Creating offline snapshot 1923181d-7a7f-4c6f-8b99-d36bea2776e9 of volume 5c611d0b-c358-4b0d-b4af-5af1666e5752 {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:23:22 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd79f063-e90f-4f16-95d7-a979f442f118]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:23:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-24902343-2c87-42de-9fa2-f4503346425e tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c611d0b-c358-4b0d-b4af-5af1666e5752 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:23 devstack sudo[94349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c611d0b-c358-4b0d-b4af-5af1666e5752 Sep 03 14:23:23 devstack sudo[94349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:23 devstack sudo[94349]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-24902343-2c87-42de-9fa2-f4503346425e tempest-GroupSnapshotsTest-801703735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c611d0b-c358-4b0d-b4af-5af1666e5752" returned: 0 in 0.363s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-24902343-2c87-42de-9fa2-f4503346425e tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c611d0b-c358-4b0d-b4af-5af1666e5752,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c611d0b-c358-4b0d-b4af-5af1666e5752.1923181d-7a7f-4c6f-8b99-d36bea2776e9 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:23 devstack sudo[94354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c611d0b-c358-4b0d-b4af-5af1666e5752,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c611d0b-c358-4b0d-b4af-5af1666e5752.1923181d-7a7f-4c6f-8b99-d36bea2776e9 1G Sep 03 14:23:23 devstack sudo[94354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:23 devstack sudo[94354]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-24902343-2c87-42de-9fa2-f4503346425e tempest-GroupSnapshotsTest-801703735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c611d0b-c358-4b0d-b4af-5af1666e5752,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c611d0b-c358-4b0d-b4af-5af1666e5752.1923181d-7a7f-4c6f-8b99-d36bea2776e9 1G" returned: 0 in 0.446s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-24902343-2c87-42de-9fa2-f4503346425e tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c611d0b-c358-4b0d-b4af-5af1666e5752 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c611d0b-c358-4b0d-b4af-5af1666e5752.1923181d-7a7f-4c6f-8b99-d36bea2776e9 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:23 devstack sudo[94367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c611d0b-c358-4b0d-b4af-5af1666e5752 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c611d0b-c358-4b0d-b4af-5af1666e5752.1923181d-7a7f-4c6f-8b99-d36bea2776e9 Sep 03 14:23:23 devstack sudo[94367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:24 devstack sudo[94367]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-24902343-2c87-42de-9fa2-f4503346425e tempest-GroupSnapshotsTest-801703735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c611d0b-c358-4b0d-b4af-5af1666e5752 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c611d0b-c358-4b0d-b4af-5af1666e5752.1923181d-7a7f-4c6f-8b99-d36bea2776e9" returned: 0 in 0.354s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:24 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-24902343-2c87-42de-9fa2-f4503346425e tempest-GroupSnapshotsTest-801703735 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c611d0b-c358-4b0d-b4af-5af1666e5752.1923181d-7a7f-4c6f-8b99-d36bea2776e9 is being set with open permissions: ugo+rw: NotImplementedError Sep 03 14:23:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-24902343-2c87-42de-9fa2-f4503346425e tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c611d0b-c358-4b0d-b4af-5af1666e5752.1923181d-7a7f-4c6f-8b99-d36bea2776e9 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:24 devstack sudo[94372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c611d0b-c358-4b0d-b4af-5af1666e5752.1923181d-7a7f-4c6f-8b99-d36bea2776e9 Sep 03 14:23:24 devstack sudo[94372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:24 devstack sudo[94372]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-24902343-2c87-42de-9fa2-f4503346425e tempest-GroupSnapshotsTest-801703735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c611d0b-c358-4b0d-b4af-5af1666e5752.1923181d-7a7f-4c6f-8b99-d36bea2776e9" returned: 0 in 0.282s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-24902343-2c87-42de-9fa2-f4503346425e tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c611d0b-c358-4b0d-b4af-5af1666e5752.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:24 devstack sudo[94375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c611d0b-c358-4b0d-b4af-5af1666e5752.info Sep 03 14:23:24 devstack sudo[94375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:24 devstack sudo[94375]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-24902343-2c87-42de-9fa2-f4503346425e tempest-GroupSnapshotsTest-801703735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c611d0b-c358-4b0d-b4af-5af1666e5752.info" returned: 0 in 0.308s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:24 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-24902343-2c87-42de-9fa2-f4503346425e tempest-GroupSnapshotsTest-801703735 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c611d0b-c358-4b0d-b4af-5af1666e5752.info is being set with open permissions: ugo+rw: NotImplementedError Sep 03 14:23:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-24902343-2c87-42de-9fa2-f4503346425e tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c611d0b-c358-4b0d-b4af-5af1666e5752.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:24 devstack sudo[94378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c611d0b-c358-4b0d-b4af-5af1666e5752.info Sep 03 14:23:24 devstack sudo[94378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:25 devstack sudo[94378]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-24902343-2c87-42de-9fa2-f4503346425e tempest-GroupSnapshotsTest-801703735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c611d0b-c358-4b0d-b4af-5af1666e5752.info" returned: 0 in 0.287s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-24902343-2c87-42de-9fa2-f4503346425e tempest-GroupSnapshotsTest-801703735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.146s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:23:25 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-24902343-2c87-42de-9fa2-f4503346425e tempest-GroupSnapshotsTest-801703735 None] group_snapshot b0049fa2-df86-4a60-9e0f-39294a4db292: created successfully Sep 03 14:23:25 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-b5294157-a7cc-48f8-b59c-790024a4e58e tempest-GroupSnapshotsTest-801703735 None] group_snapshot b0049fa2-df86-4a60-9e0f-39294a4db292: deleting Sep 03 14:23:25 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b5294157-a7cc-48f8-b59c-790024a4e58e tempest-GroupSnapshotsTest-801703735 None] group_snapshot b0049fa2-df86-4a60-9e0f-39294a4db292: deleting {{(pid=87007) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 03 14:23:25 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b5294157-a7cc-48f8-b59c-790024a4e58e tempest-GroupSnapshotsTest-801703735 None] Acquiring lock "cinder-quobyte-5c611d0b-c358-4b0d-b4af-5af1666e5752" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:23:25 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b5294157-a7cc-48f8-b59c-790024a4e58e tempest-GroupSnapshotsTest-801703735 None] Lock "cinder-quobyte-5c611d0b-c358-4b0d-b4af-5af1666e5752" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:23:25 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b5294157-a7cc-48f8-b59c-790024a4e58e tempest-GroupSnapshotsTest-801703735 None] Acquiring lock "cinder-quobyte-1923181d-7a7f-4c6f-8b99-d36bea2776e9" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:23:25 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b5294157-a7cc-48f8-b59c-790024a4e58e tempest-GroupSnapshotsTest-801703735 None] Lock "cinder-quobyte-1923181d-7a7f-4c6f-8b99-d36bea2776e9" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:23:25 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-b5294157-a7cc-48f8-b59c-790024a4e58e tempest-GroupSnapshotsTest-801703735 None] Deleting offline snapshot 1923181d-7a7f-4c6f-8b99-d36bea2776e9 of volume 5c611d0b-c358-4b0d-b4af-5af1666e5752 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:23:25 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-b5294157-a7cc-48f8-b59c-790024a4e58e tempest-GroupSnapshotsTest-801703735 None] snapshot_file for this snap is: volume-5c611d0b-c358-4b0d-b4af-5af1666e5752.1923181d-7a7f-4c6f-8b99-d36bea2776e9 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:23:25 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f26501-6327-47ae-9d66-ec3bd1289f32]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:23:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b5294157-a7cc-48f8-b59c-790024a4e58e tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c611d0b-c358-4b0d-b4af-5af1666e5752.1923181d-7a7f-4c6f-8b99-d36bea2776e9 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:25 devstack sudo[94381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c611d0b-c358-4b0d-b4af-5af1666e5752.1923181d-7a7f-4c6f-8b99-d36bea2776e9 Sep 03 14:23:25 devstack sudo[94381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:26 devstack sudo[94381]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b5294157-a7cc-48f8-b59c-790024a4e58e tempest-GroupSnapshotsTest-801703735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c611d0b-c358-4b0d-b4af-5af1666e5752.1923181d-7a7f-4c6f-8b99-d36bea2776e9" returned: 0 in 0.395s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:26 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-b5294157-a7cc-48f8-b59c-790024a4e58e tempest-GroupSnapshotsTest-801703735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c611d0b-c358-4b0d-b4af-5af1666e5752(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:23:26 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f5db13-c27f-4ccd-b316-0aecbdb109ec]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:23:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b5294157-a7cc-48f8-b59c-790024a4e58e tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c611d0b-c358-4b0d-b4af-5af1666e5752 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:26 devstack sudo[94388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c611d0b-c358-4b0d-b4af-5af1666e5752 Sep 03 14:23:26 devstack sudo[94388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:26 devstack sudo[94388]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b5294157-a7cc-48f8-b59c-790024a4e58e tempest-GroupSnapshotsTest-801703735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c611d0b-c358-4b0d-b4af-5af1666e5752" returned: 0 in 0.373s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b5294157-a7cc-48f8-b59c-790024a4e58e tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c611d0b-c358-4b0d-b4af-5af1666e5752.1923181d-7a7f-4c6f-8b99-d36bea2776e9 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:26 devstack sudo[94393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c611d0b-c358-4b0d-b4af-5af1666e5752.1923181d-7a7f-4c6f-8b99-d36bea2776e9 Sep 03 14:23:26 devstack sudo[94393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:26 devstack sudo[94393]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b5294157-a7cc-48f8-b59c-790024a4e58e tempest-GroupSnapshotsTest-801703735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c611d0b-c358-4b0d-b4af-5af1666e5752.1923181d-7a7f-4c6f-8b99-d36bea2776e9" returned: 0 in 0.368s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b5294157-a7cc-48f8-b59c-790024a4e58e tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c611d0b-c358-4b0d-b4af-5af1666e5752.1923181d-7a7f-4c6f-8b99-d36bea2776e9 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:26 devstack sudo[94399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c611d0b-c358-4b0d-b4af-5af1666e5752.1923181d-7a7f-4c6f-8b99-d36bea2776e9 Sep 03 14:23:26 devstack sudo[94399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:27 devstack sudo[94399]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b5294157-a7cc-48f8-b59c-790024a4e58e tempest-GroupSnapshotsTest-801703735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c611d0b-c358-4b0d-b4af-5af1666e5752.1923181d-7a7f-4c6f-8b99-d36bea2776e9" returned: 0 in 0.275s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:27 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b5294157-a7cc-48f8-b59c-790024a4e58e tempest-GroupSnapshotsTest-801703735 None] Lock "cinder-quobyte-1923181d-7a7f-4c6f-8b99-d36bea2776e9" released by "_delete_snapshot" :: held 1.520s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:23:27 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b5294157-a7cc-48f8-b59c-790024a4e58e tempest-GroupSnapshotsTest-801703735 None] Lock "cinder-quobyte-5c611d0b-c358-4b0d-b4af-5af1666e5752" released by "delete_snapshot" :: held 1.543s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:23:27 devstack cinder-volume[87007]: WARNING cinder.quota [None req-b5294157-a7cc-48f8-b59c-790024a4e58e tempest-GroupSnapshotsTest-801703735 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-767647027 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-767647027, it is now deprecated. Please use the default quota class for default quota. Sep 03 14:23:27 devstack cinder-volume[87007]: WARNING cinder.quota [None req-b5294157-a7cc-48f8-b59c-790024a4e58e tempest-GroupSnapshotsTest-801703735 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-767647027 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-767647027, it is now deprecated. Please use the default quota class for default quota. Sep 03 14:23:27 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-b5294157-a7cc-48f8-b59c-790024a4e58e tempest-GroupSnapshotsTest-801703735 None] Created reservations ['4e68726d-7117-4fa9-b257-f780d74b69f8', '061da439-478f-48c7-8248-1cf17bf4d2f7', 'b69a08c8-e4e9-46c9-9b1b-911f81566326', '11a82c75-2112-474a-bfec-ee0e20d813e0'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:23:27 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-b5294157-a7cc-48f8-b59c-790024a4e58e tempest-GroupSnapshotsTest-801703735 None] group_snapshot b0049fa2-df86-4a60-9e0f-39294a4db292: deleted successfully Sep 03 14:23:28 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-fc97999f-ed24-4bd6-badf-92cd26be0dad tempest-GroupSnapshotsTest-801703735 None] Acquiring lock "cinder-quobyte-5c611d0b-c358-4b0d-b4af-5af1666e5752" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:23:28 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-fc97999f-ed24-4bd6-badf-92cd26be0dad tempest-GroupSnapshotsTest-801703735 None] Lock "cinder-quobyte-5c611d0b-c358-4b0d-b4af-5af1666e5752" acquired by "delete_volume" :: waited 0.025s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:23:28 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbdc981-e0df-4491-b908-2404b250174c]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:23:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fc97999f-ed24-4bd6-badf-92cd26be0dad tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c611d0b-c358-4b0d-b4af-5af1666e5752 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:28 devstack sudo[94402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c611d0b-c358-4b0d-b4af-5af1666e5752 Sep 03 14:23:28 devstack sudo[94402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:28 devstack sudo[94402]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fc97999f-ed24-4bd6-badf-92cd26be0dad tempest-GroupSnapshotsTest-801703735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c611d0b-c358-4b0d-b4af-5af1666e5752" returned: 0 in 0.474s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fc97999f-ed24-4bd6-badf-92cd26be0dad tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c611d0b-c358-4b0d-b4af-5af1666e5752 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:28 devstack sudo[94408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c611d0b-c358-4b0d-b4af-5af1666e5752 Sep 03 14:23:28 devstack sudo[94408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:29 devstack sudo[94408]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fc97999f-ed24-4bd6-badf-92cd26be0dad tempest-GroupSnapshotsTest-801703735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c611d0b-c358-4b0d-b4af-5af1666e5752" returned: 0 in 0.323s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:29 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-fc97999f-ed24-4bd6-badf-92cd26be0dad tempest-GroupSnapshotsTest-801703735 None] Lock "cinder-quobyte-5c611d0b-c358-4b0d-b4af-5af1666e5752" released by "delete_volume" :: held 0.895s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:23:29 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-fc97999f-ed24-4bd6-badf-92cd26be0dad tempest-GroupSnapshotsTest-801703735 None] Created reservations ['a7fc422d-6138-4d18-9ad2-c743b81efdb7'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:23:29 devstack cinder-volume[87007]: WARNING cinder.quota [None req-fc97999f-ed24-4bd6-badf-92cd26be0dad tempest-GroupSnapshotsTest-801703735 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-767647027 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-767647027, it is now deprecated. Please use the default quota class for default quota. Sep 03 14:23:29 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-fc97999f-ed24-4bd6-badf-92cd26be0dad tempest-GroupSnapshotsTest-801703735 None] Created reservations ['9ba2822a-c5ec-405a-a5eb-261f343d22b1', '25f0752c-22e0-4a16-b9a0-41585823f5bc', '2d3111be-bebc-4358-9554-4959232e1291', 'b3c8398c-ff1d-40db-967c-4ab970e31c18'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:23:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-fc97999f-ed24-4bd6-badf-92cd26be0dad tempest-GroupSnapshotsTest-801703735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:23:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-fc97999f-ed24-4bd6-badf-92cd26be0dad tempest-GroupSnapshotsTest-801703735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:23:29 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-fc97999f-ed24-4bd6-badf-92cd26be0dad tempest-GroupSnapshotsTest-801703735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:23:29 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-fc97999f-ed24-4bd6-badf-92cd26be0dad tempest-GroupSnapshotsTest-801703735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:23:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-fc97999f-ed24-4bd6-badf-92cd26be0dad tempest-GroupSnapshotsTest-801703735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:23:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fc97999f-ed24-4bd6-badf-92cd26be0dad tempest-GroupSnapshotsTest-801703735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:29 devstack sudo[94411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:23:29 devstack sudo[94411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:29 devstack sudo[94411]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fc97999f-ed24-4bd6-badf-92cd26be0dad tempest-GroupSnapshotsTest-801703735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.255s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:29 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-fc97999f-ed24-4bd6-badf-92cd26be0dad tempest-GroupSnapshotsTest-801703735 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:23:29 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-fc97999f-ed24-4bd6-badf-92cd26be0dad tempest-GroupSnapshotsTest-801703735 None] Delete group completed successfully. Sep 03 14:23:32 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0a9a7ad-1c15-48f7-bc92-b7734ea5cfb9 tempest-AttachVolumeNegativeTest-1835626697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:23:33 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f0a9a7ad-1c15-48f7-bc92-b7734ea5cfb9 tempest-AttachVolumeNegativeTest-1835626697 None] Flow 'volume_create_manager' (23c15f5c-d189-4249-9ea6-8bbb960f1c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:23:33 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f0a9a7ad-1c15-48f7-bc92-b7734ea5cfb9 tempest-AttachVolumeNegativeTest-1835626697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11751cfa-2076-465e-b654-f2fbd3d53c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:23:33 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f0a9a7ad-1c15-48f7-bc92-b7734ea5cfb9 tempest-AttachVolumeNegativeTest-1835626697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11751cfa-2076-465e-b654-f2fbd3d53c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1011719724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08c84741-c587-421e-a584-52b6a6c4b0b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd1be5ab58fa4aa09e854306dcc6bbe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:23:33Z,use_quota=True,user_id='337e93cf223a488fa18dcadbd42fbcd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:23:33 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f0a9a7ad-1c15-48f7-bc92-b7734ea5cfb9 tempest-AttachVolumeNegativeTest-1835626697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc3d576a-2c5b-4664-b630-0b2df5e29033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:23:33 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f0a9a7ad-1c15-48f7-bc92-b7734ea5cfb9 tempest-AttachVolumeNegativeTest-1835626697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc3d576a-2c5b-4664-b630-0b2df5e29033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:23:33 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f0a9a7ad-1c15-48f7-bc92-b7734ea5cfb9 tempest-AttachVolumeNegativeTest-1835626697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79b7918f-f1d3-4a95-983f-cc4fe09e4fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:23:33 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f0a9a7ad-1c15-48f7-bc92-b7734ea5cfb9 tempest-AttachVolumeNegativeTest-1835626697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79b7918f-f1d3-4a95-983f-cc4fe09e4fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08c84741-c587-421e-a584-52b6a6c4b0b6', 'volume_name': 'volume-08c84741-c587-421e-a584-52b6a6c4b0b6', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:23:33 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f0a9a7ad-1c15-48f7-bc92-b7734ea5cfb9 tempest-AttachVolumeNegativeTest-1835626697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f23c4d8f-7622-4ca8-bd51-284130ea4767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:23:33 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f0a9a7ad-1c15-48f7-bc92-b7734ea5cfb9 tempest-AttachVolumeNegativeTest-1835626697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f23c4d8f-7622-4ca8-bd51-284130ea4767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:23:33 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f0a9a7ad-1c15-48f7-bc92-b7734ea5cfb9 tempest-AttachVolumeNegativeTest-1835626697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a683fea4-6035-4d17-a979-7dd813c87acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:23:33 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-f0a9a7ad-1c15-48f7-bc92-b7734ea5cfb9 tempest-AttachVolumeNegativeTest-1835626697 None] Volume 08c84741-c587-421e-a584-52b6a6c4b0b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08c84741-c587-421e-a584-52b6a6c4b0b6', 'volume_size': 1} Sep 03 14:23:33 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f0a9a7ad-1c15-48f7-bc92-b7734ea5cfb9 tempest-AttachVolumeNegativeTest-1835626697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:23:33 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f0a9a7ad-1c15-48f7-bc92-b7734ea5cfb9 tempest-AttachVolumeNegativeTest-1835626697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:23:33 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f0a9a7ad-1c15-48f7-bc92-b7734ea5cfb9 tempest-AttachVolumeNegativeTest-1835626697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1011719724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08c84741-c587-421e-a584-52b6a6c4b0b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd1be5ab58fa4aa09e854306dcc6bbe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:23:33Z,use_quota=True,user_id='337e93cf223a488fa18dcadbd42fbcd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:23:33 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-f0a9a7ad-1c15-48f7-bc92-b7734ea5cfb9 tempest-AttachVolumeNegativeTest-1835626697 None] Creating volume 08c84741-c587-421e-a584-52b6a6c4b0b6 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:23:33 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f0a9a7ad-1c15-48f7-bc92-b7734ea5cfb9 tempest-AttachVolumeNegativeTest-1835626697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:23:33 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f0a9a7ad-1c15-48f7-bc92-b7734ea5cfb9 tempest-AttachVolumeNegativeTest-1835626697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:23:33 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f0a9a7ad-1c15-48f7-bc92-b7734ea5cfb9 tempest-AttachVolumeNegativeTest-1835626697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:23:33 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f0a9a7ad-1c15-48f7-bc92-b7734ea5cfb9 tempest-AttachVolumeNegativeTest-1835626697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:23:33 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f0a9a7ad-1c15-48f7-bc92-b7734ea5cfb9 tempest-AttachVolumeNegativeTest-1835626697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:23:33 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f0a9a7ad-1c15-48f7-bc92-b7734ea5cfb9 tempest-AttachVolumeNegativeTest-1835626697 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:23:33 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-f0a9a7ad-1c15-48f7-bc92-b7734ea5cfb9 tempest-AttachVolumeNegativeTest-1835626697 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:23:33 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f0a9a7ad-1c15-48f7-bc92-b7734ea5cfb9 tempest-AttachVolumeNegativeTest-1835626697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-08c84741-c587-421e-a584-52b6a6c4b0b6 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:33 devstack sudo[94416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-08c84741-c587-421e-a584-52b6a6c4b0b6 1073741824 Sep 03 14:23:33 devstack sudo[94416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:33 devstack sudo[94416]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:33 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f0a9a7ad-1c15-48f7-bc92-b7734ea5cfb9 tempest-AttachVolumeNegativeTest-1835626697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-08c84741-c587-421e-a584-52b6a6c4b0b6 1073741824" returned: 0 in 0.576s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:33 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f0a9a7ad-1c15-48f7-bc92-b7734ea5cfb9 tempest-AttachVolumeNegativeTest-1835626697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-08c84741-c587-421e-a584-52b6a6c4b0b6 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:33 devstack sudo[94422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-08c84741-c587-421e-a584-52b6a6c4b0b6 Sep 03 14:23:33 devstack sudo[94422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:34 devstack sudo[94422]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f0a9a7ad-1c15-48f7-bc92-b7734ea5cfb9 tempest-AttachVolumeNegativeTest-1835626697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-08c84741-c587-421e-a584-52b6a6c4b0b6" returned: 0 in 0.315s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:34 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f0a9a7ad-1c15-48f7-bc92-b7734ea5cfb9 tempest-AttachVolumeNegativeTest-1835626697 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:23:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f0a9a7ad-1c15-48f7-bc92-b7734ea5cfb9 tempest-AttachVolumeNegativeTest-1835626697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:23:34 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f0a9a7ad-1c15-48f7-bc92-b7734ea5cfb9 tempest-AttachVolumeNegativeTest-1835626697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a683fea4-6035-4d17-a979-7dd813c87acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08c84741-c587-421e-a584-52b6a6c4b0b6', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:23:34 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f0a9a7ad-1c15-48f7-bc92-b7734ea5cfb9 tempest-AttachVolumeNegativeTest-1835626697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27d900c6-7417-410c-9d12-7afdc3b9e73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:23:34 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-f0a9a7ad-1c15-48f7-bc92-b7734ea5cfb9 tempest-AttachVolumeNegativeTest-1835626697 None] Volume volume-08c84741-c587-421e-a584-52b6a6c4b0b6 (08c84741-c587-421e-a584-52b6a6c4b0b6): created successfully Sep 03 14:23:34 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f0a9a7ad-1c15-48f7-bc92-b7734ea5cfb9 tempest-AttachVolumeNegativeTest-1835626697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27d900c6-7417-410c-9d12-7afdc3b9e73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:23:34 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f0a9a7ad-1c15-48f7-bc92-b7734ea5cfb9 tempest-AttachVolumeNegativeTest-1835626697 None] Flow 'volume_create_manager' (23c15f5c-d189-4249-9ea6-8bbb960f1c75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:23:34 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-f0a9a7ad-1c15-48f7-bc92-b7734ea5cfb9 tempest-AttachVolumeNegativeTest-1835626697 None] Created volume successfully. Sep 03 14:23:35 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-8429d543-1c96-4952-aa57-2a26dac66f6f tempest-SnapshotsActionsTest-1231480978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:23:35 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8429d543-1c96-4952-aa57-2a26dac66f6f tempest-SnapshotsActionsTest-1231480978 None] Flow 'volume_create_manager' (26b49e01-429e-437f-9db2-35ee13acdb82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:23:35 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8429d543-1c96-4952-aa57-2a26dac66f6f tempest-SnapshotsActionsTest-1231480978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e340f4e-25df-4f12-a176-6cd9bd6de517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:23:35 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8429d543-1c96-4952-aa57-2a26dac66f6f tempest-SnapshotsActionsTest-1231480978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e340f4e-25df-4f12-a176-6cd9bd6de517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1482534167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7acb89b-4d63-46b9-91fb-70796af75018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='946b8b1675d2483b85708a1bdcb37a76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:23:35Z,use_quota=True,user_id='104ecd22704b4855a476f0c9edd32d1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:23:35 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8429d543-1c96-4952-aa57-2a26dac66f6f tempest-SnapshotsActionsTest-1231480978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76a30776-716a-47c2-9b51-26d23d620c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:23:35 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8429d543-1c96-4952-aa57-2a26dac66f6f tempest-SnapshotsActionsTest-1231480978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76a30776-716a-47c2-9b51-26d23d620c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:23:35 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8429d543-1c96-4952-aa57-2a26dac66f6f tempest-SnapshotsActionsTest-1231480978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9210f71-4622-410d-a17a-afe7312636fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:23:35 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8429d543-1c96-4952-aa57-2a26dac66f6f tempest-SnapshotsActionsTest-1231480978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9210f71-4622-410d-a17a-afe7312636fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7acb89b-4d63-46b9-91fb-70796af75018', 'volume_name': 'volume-a7acb89b-4d63-46b9-91fb-70796af75018', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:23:35 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8429d543-1c96-4952-aa57-2a26dac66f6f tempest-SnapshotsActionsTest-1231480978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cb86f8f-5278-4468-8a1e-939a7a40a617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:23:35 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8429d543-1c96-4952-aa57-2a26dac66f6f tempest-SnapshotsActionsTest-1231480978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cb86f8f-5278-4468-8a1e-939a7a40a617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:23:35 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8429d543-1c96-4952-aa57-2a26dac66f6f tempest-SnapshotsActionsTest-1231480978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa470b9c-4254-42a9-84c8-7b98d5856184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:23:35 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-8429d543-1c96-4952-aa57-2a26dac66f6f tempest-SnapshotsActionsTest-1231480978 None] Volume a7acb89b-4d63-46b9-91fb-70796af75018: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7acb89b-4d63-46b9-91fb-70796af75018', 'volume_size': 1} Sep 03 14:23:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8429d543-1c96-4952-aa57-2a26dac66f6f tempest-SnapshotsActionsTest-1231480978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:23:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8429d543-1c96-4952-aa57-2a26dac66f6f tempest-SnapshotsActionsTest-1231480978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:23:35 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-8429d543-1c96-4952-aa57-2a26dac66f6f tempest-SnapshotsActionsTest-1231480978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1482534167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7acb89b-4d63-46b9-91fb-70796af75018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='946b8b1675d2483b85708a1bdcb37a76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:23:35Z,use_quota=True,user_id='104ecd22704b4855a476f0c9edd32d1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:23:35 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-8429d543-1c96-4952-aa57-2a26dac66f6f tempest-SnapshotsActionsTest-1231480978 None] Creating volume a7acb89b-4d63-46b9-91fb-70796af75018 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:23:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8429d543-1c96-4952-aa57-2a26dac66f6f tempest-SnapshotsActionsTest-1231480978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:23:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8429d543-1c96-4952-aa57-2a26dac66f6f tempest-SnapshotsActionsTest-1231480978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:23:35 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-8429d543-1c96-4952-aa57-2a26dac66f6f tempest-SnapshotsActionsTest-1231480978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:23:35 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-8429d543-1c96-4952-aa57-2a26dac66f6f tempest-SnapshotsActionsTest-1231480978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:23:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8429d543-1c96-4952-aa57-2a26dac66f6f tempest-SnapshotsActionsTest-1231480978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:23:35 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-8429d543-1c96-4952-aa57-2a26dac66f6f tempest-SnapshotsActionsTest-1231480978 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:23:35 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-8429d543-1c96-4952-aa57-2a26dac66f6f tempest-SnapshotsActionsTest-1231480978 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:23:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8429d543-1c96-4952-aa57-2a26dac66f6f tempest-SnapshotsActionsTest-1231480978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:35 devstack sudo[94430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018 1073741824 Sep 03 14:23:35 devstack sudo[94430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-ad851fed-eac4-4f95-988c-06d9d4ad6b1a req-317ff4b8-f93a-40e6-bcfb-4b87698cf183 tempest-AttachVolumeNegativeTest-1835626697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:23:36 devstack sudo[94430]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8429d543-1c96-4952-aa57-2a26dac66f6f tempest-SnapshotsActionsTest-1231480978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018 1073741824" returned: 0 in 0.599s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8429d543-1c96-4952-aa57-2a26dac66f6f tempest-SnapshotsActionsTest-1231480978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:36 devstack sudo[94446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018 Sep 03 14:23:36 devstack sudo[94446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:36 devstack sudo[94446]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8429d543-1c96-4952-aa57-2a26dac66f6f tempest-SnapshotsActionsTest-1231480978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018" returned: 0 in 0.254s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:36 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-8429d543-1c96-4952-aa57-2a26dac66f6f tempest-SnapshotsActionsTest-1231480978 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:23:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8429d543-1c96-4952-aa57-2a26dac66f6f tempest-SnapshotsActionsTest-1231480978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:23:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-ad851fed-eac4-4f95-988c-06d9d4ad6b1a req-317ff4b8-f93a-40e6-bcfb-4b87698cf183 tempest-AttachVolumeNegativeTest-1835626697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.342s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:23:36 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8429d543-1c96-4952-aa57-2a26dac66f6f tempest-SnapshotsActionsTest-1231480978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa470b9c-4254-42a9-84c8-7b98d5856184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7acb89b-4d63-46b9-91fb-70796af75018', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:23:36 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8429d543-1c96-4952-aa57-2a26dac66f6f tempest-SnapshotsActionsTest-1231480978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c939c16-e0c9-4350-bdac-e087ddc8e029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:23:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-ad851fed-eac4-4f95-988c-06d9d4ad6b1a req-317ff4b8-f93a-40e6-bcfb-4b87698cf183 tempest-AttachVolumeNegativeTest-1835626697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:23:36 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-8429d543-1c96-4952-aa57-2a26dac66f6f tempest-SnapshotsActionsTest-1231480978 None] Volume volume-a7acb89b-4d63-46b9-91fb-70796af75018 (a7acb89b-4d63-46b9-91fb-70796af75018): created successfully Sep 03 14:23:36 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8429d543-1c96-4952-aa57-2a26dac66f6f tempest-SnapshotsActionsTest-1231480978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c939c16-e0c9-4350-bdac-e087ddc8e029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:23:36 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8429d543-1c96-4952-aa57-2a26dac66f6f tempest-SnapshotsActionsTest-1231480978 None] Flow 'volume_create_manager' (26b49e01-429e-437f-9db2-35ee13acdb82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:23:36 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-8429d543-1c96-4952-aa57-2a26dac66f6f tempest-SnapshotsActionsTest-1231480978 None] Created volume successfully. Sep 03 14:23:36 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-ad851fed-eac4-4f95-988c-06d9d4ad6b1a req-317ff4b8-f93a-40e6-bcfb-4b87698cf183 tempest-AttachVolumeNegativeTest-1835626697 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713', 'name': 'volume-08c84741-c587-421e-a584-52b6a6c4b0b6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3f7a674f-d501-4cbb-89fc-8198cd004f80', 'enforce_multipath': True} {{(pid=87007) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 14:23:36 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-ad851fed-eac4-4f95-988c-06d9d4ad6b1a req-317ff4b8-f93a-40e6-bcfb-4b87698cf183 tempest-AttachVolumeNegativeTest-1835626697 None] attachment_update completed successfully. Sep 03 14:23:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-532cbe55-523d-4b9c-a60b-8c99e344c5c6 tempest-SnapshotsActionsTest-1231480978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:23:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-532cbe55-523d-4b9c-a60b-8c99e344c5c6 tempest-SnapshotsActionsTest-1231480978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:23:37 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-532cbe55-523d-4b9c-a60b-8c99e344c5c6 tempest-SnapshotsActionsTest-1231480978 None] Creating offline snapshot cd9f7979-ca3d-4076-b24a-65075410c2d9 of volume a7acb89b-4d63-46b9-91fb-70796af75018 {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:23:37 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[768eff5c-7a13-4aad-b80f-c29778ce0076]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:23:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-532cbe55-523d-4b9c-a60b-8c99e344c5c6 tempest-SnapshotsActionsTest-1231480978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:37 devstack sudo[94833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018 Sep 03 14:23:37 devstack sudo[94833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:38 devstack sudo[94833]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-532cbe55-523d-4b9c-a60b-8c99e344c5c6 tempest-SnapshotsActionsTest-1231480978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018" returned: 0 in 0.444s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-532cbe55-523d-4b9c-a60b-8c99e344c5c6 tempest-SnapshotsActionsTest-1231480978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:38 devstack sudo[94838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9 1G Sep 03 14:23:38 devstack sudo[94838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:38 devstack sudo[94838]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-532cbe55-523d-4b9c-a60b-8c99e344c5c6 tempest-SnapshotsActionsTest-1231480978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9 1G" returned: 0 in 0.477s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-532cbe55-523d-4b9c-a60b-8c99e344c5c6 tempest-SnapshotsActionsTest-1231480978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7acb89b-4d63-46b9-91fb-70796af75018 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:38 devstack sudo[94844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7acb89b-4d63-46b9-91fb-70796af75018 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9 Sep 03 14:23:38 devstack sudo[94844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:38 devstack sudo[94844]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-532cbe55-523d-4b9c-a60b-8c99e344c5c6 tempest-SnapshotsActionsTest-1231480978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7acb89b-4d63-46b9-91fb-70796af75018 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9" returned: 0 in 0.354s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:38 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-532cbe55-523d-4b9c-a60b-8c99e344c5c6 tempest-SnapshotsActionsTest-1231480978 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9 is being set with open permissions: ugo+rw Sep 03 14:23:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-532cbe55-523d-4b9c-a60b-8c99e344c5c6 tempest-SnapshotsActionsTest-1231480978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:39 devstack sudo[94854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9 Sep 03 14:23:39 devstack sudo[94854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:39 devstack sudo[94854]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-532cbe55-523d-4b9c-a60b-8c99e344c5c6 tempest-SnapshotsActionsTest-1231480978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9" returned: 0 in 0.257s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-532cbe55-523d-4b9c-a60b-8c99e344c5c6 tempest-SnapshotsActionsTest-1231480978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:39 devstack sudo[94857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.info Sep 03 14:23:39 devstack sudo[94857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:39 devstack sudo[94857]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-532cbe55-523d-4b9c-a60b-8c99e344c5c6 tempest-SnapshotsActionsTest-1231480978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.info" returned: 0 in 0.313s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:39 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-532cbe55-523d-4b9c-a60b-8c99e344c5c6 tempest-SnapshotsActionsTest-1231480978 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.info is being set with open permissions: ugo+rw Sep 03 14:23:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-532cbe55-523d-4b9c-a60b-8c99e344c5c6 tempest-SnapshotsActionsTest-1231480978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:39 devstack sudo[94860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.info Sep 03 14:23:39 devstack sudo[94860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:39 devstack sudo[94860]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-532cbe55-523d-4b9c-a60b-8c99e344c5c6 tempest-SnapshotsActionsTest-1231480978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.info" returned: 0 in 0.298s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-532cbe55-523d-4b9c-a60b-8c99e344c5c6 tempest-SnapshotsActionsTest-1231480978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.259s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:23:39 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-532cbe55-523d-4b9c-a60b-8c99e344c5c6 tempest-SnapshotsActionsTest-1231480978 None] Create snapshot completed successfully Sep 03 14:23:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-936ac8e1-17e0-4260-aa5d-584428d722aa tempest-SnapshotsActionsTest-1231480978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:23:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-936ac8e1-17e0-4260-aa5d-584428d722aa tempest-SnapshotsActionsTest-1231480978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:23:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-936ac8e1-17e0-4260-aa5d-584428d722aa tempest-SnapshotsActionsTest-1231480978 None] Creating offline snapshot d39c7859-1d0a-4a20-ac86-366b6ae555f7 of volume a7acb89b-4d63-46b9-91fb-70796af75018 {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:23:42 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[628f693e-575a-4429-afe4-3b3e5b25adb4]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:23:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-936ac8e1-17e0-4260-aa5d-584428d722aa tempest-SnapshotsActionsTest-1231480978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:42 devstack sudo[94887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9 Sep 03 14:23:42 devstack sudo[94887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:42 devstack sudo[94887]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-936ac8e1-17e0-4260-aa5d-584428d722aa tempest-SnapshotsActionsTest-1231480978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9" returned: 0 in 0.435s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:42 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-936ac8e1-17e0-4260-aa5d-584428d722aa tempest-SnapshotsActionsTest-1231480978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7acb89b-4d63-46b9-91fb-70796af75018(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:23:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-936ac8e1-17e0-4260-aa5d-584428d722aa tempest-SnapshotsActionsTest-1231480978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.d39c7859-1d0a-4a20-ac86-366b6ae555f7 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:42 devstack sudo[94894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.d39c7859-1d0a-4a20-ac86-366b6ae555f7 1G Sep 03 14:23:42 devstack sudo[94894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:43 devstack sudo[94894]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-936ac8e1-17e0-4260-aa5d-584428d722aa tempest-SnapshotsActionsTest-1231480978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.d39c7859-1d0a-4a20-ac86-366b6ae555f7 1G" returned: 0 in 0.649s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-936ac8e1-17e0-4260-aa5d-584428d722aa tempest-SnapshotsActionsTest-1231480978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.d39c7859-1d0a-4a20-ac86-366b6ae555f7 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:43 devstack sudo[94901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.d39c7859-1d0a-4a20-ac86-366b6ae555f7 Sep 03 14:23:43 devstack sudo[94901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:43 devstack sudo[94901]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-936ac8e1-17e0-4260-aa5d-584428d722aa tempest-SnapshotsActionsTest-1231480978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.d39c7859-1d0a-4a20-ac86-366b6ae555f7" returned: 0 in 0.437s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:43 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-936ac8e1-17e0-4260-aa5d-584428d722aa tempest-SnapshotsActionsTest-1231480978 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.d39c7859-1d0a-4a20-ac86-366b6ae555f7 is being set with open permissions: ugo+rw Sep 03 14:23:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-936ac8e1-17e0-4260-aa5d-584428d722aa tempest-SnapshotsActionsTest-1231480978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.d39c7859-1d0a-4a20-ac86-366b6ae555f7 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:43 devstack sudo[94909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.d39c7859-1d0a-4a20-ac86-366b6ae555f7 Sep 03 14:23:43 devstack sudo[94909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:43 devstack sudo[94909]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-936ac8e1-17e0-4260-aa5d-584428d722aa tempest-SnapshotsActionsTest-1231480978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.d39c7859-1d0a-4a20-ac86-366b6ae555f7" returned: 0 in 0.311s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-936ac8e1-17e0-4260-aa5d-584428d722aa tempest-SnapshotsActionsTest-1231480978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.983s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:23:43 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-936ac8e1-17e0-4260-aa5d-584428d722aa tempest-SnapshotsActionsTest-1231480978 None] Create snapshot completed successfully Sep 03 14:23:44 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a3c7e5b9-919f-415e-8393-4be9d72ab513 tempest-SnapshotsActionsTest-319339418 None] Acquiring lock "cinder-d39c7859-1d0a-4a20-ac86-366b6ae555f7-delete_snapshot" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:23:44 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a3c7e5b9-919f-415e-8393-4be9d72ab513 tempest-SnapshotsActionsTest-319339418 None] Lock "cinder-d39c7859-1d0a-4a20-ac86-366b6ae555f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:23:44 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a3c7e5b9-919f-415e-8393-4be9d72ab513 tempest-SnapshotsActionsTest-319339418 None] Acquiring lock "cinder-quobyte-a7acb89b-4d63-46b9-91fb-70796af75018" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:23:44 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a3c7e5b9-919f-415e-8393-4be9d72ab513 tempest-SnapshotsActionsTest-319339418 None] Lock "cinder-quobyte-a7acb89b-4d63-46b9-91fb-70796af75018" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:23:44 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a3c7e5b9-919f-415e-8393-4be9d72ab513 tempest-SnapshotsActionsTest-319339418 None] Acquiring lock "cinder-quobyte-d39c7859-1d0a-4a20-ac86-366b6ae555f7" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:23:44 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a3c7e5b9-919f-415e-8393-4be9d72ab513 tempest-SnapshotsActionsTest-319339418 None] Lock "cinder-quobyte-d39c7859-1d0a-4a20-ac86-366b6ae555f7" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:23:44 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-a3c7e5b9-919f-415e-8393-4be9d72ab513 tempest-SnapshotsActionsTest-319339418 None] Deleting offline snapshot d39c7859-1d0a-4a20-ac86-366b6ae555f7 of volume a7acb89b-4d63-46b9-91fb-70796af75018 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:23:44 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-a3c7e5b9-919f-415e-8393-4be9d72ab513 tempest-SnapshotsActionsTest-319339418 None] snapshot_file for this snap is: volume-a7acb89b-4d63-46b9-91fb-70796af75018.d39c7859-1d0a-4a20-ac86-366b6ae555f7 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:23:44 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3c4a25-ccdb-425f-ac82-a4fbf3b73721]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:23:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a3c7e5b9-919f-415e-8393-4be9d72ab513 tempest-SnapshotsActionsTest-319339418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.d39c7859-1d0a-4a20-ac86-366b6ae555f7 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:44 devstack sudo[94913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.d39c7859-1d0a-4a20-ac86-366b6ae555f7 Sep 03 14:23:44 devstack sudo[94913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:45 devstack sudo[94913]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a3c7e5b9-919f-415e-8393-4be9d72ab513 tempest-SnapshotsActionsTest-319339418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.d39c7859-1d0a-4a20-ac86-366b6ae555f7" returned: 0 in 0.681s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:45 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-a3c7e5b9-919f-415e-8393-4be9d72ab513 tempest-SnapshotsActionsTest-319339418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7acb89b-4d63-46b9-91fb-70796af75018(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:23:45 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bcfe34-e6d9-47bc-b7bd-682d6e7e04f3]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:23:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a3c7e5b9-919f-415e-8393-4be9d72ab513 tempest-SnapshotsActionsTest-319339418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:45 devstack sudo[94919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9 Sep 03 14:23:45 devstack sudo[94919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:45 devstack sudo[94919]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a3c7e5b9-919f-415e-8393-4be9d72ab513 tempest-SnapshotsActionsTest-319339418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9" returned: 0 in 0.617s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:45 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-a3c7e5b9-919f-415e-8393-4be9d72ab513 tempest-SnapshotsActionsTest-319339418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7acb89b-4d63-46b9-91fb-70796af75018(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:23:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a3c7e5b9-919f-415e-8393-4be9d72ab513 tempest-SnapshotsActionsTest-319339418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.d39c7859-1d0a-4a20-ac86-366b6ae555f7 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:45 devstack sudo[94936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.d39c7859-1d0a-4a20-ac86-366b6ae555f7 Sep 03 14:23:45 devstack sudo[94936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:46 devstack sudo[94936]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a3c7e5b9-919f-415e-8393-4be9d72ab513 tempest-SnapshotsActionsTest-319339418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.d39c7859-1d0a-4a20-ac86-366b6ae555f7" returned: 0 in 0.448s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a3c7e5b9-919f-415e-8393-4be9d72ab513 tempest-SnapshotsActionsTest-319339418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.d39c7859-1d0a-4a20-ac86-366b6ae555f7 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:46 devstack sudo[94945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.d39c7859-1d0a-4a20-ac86-366b6ae555f7 Sep 03 14:23:46 devstack sudo[94945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:46 devstack sudo[94945]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a3c7e5b9-919f-415e-8393-4be9d72ab513 tempest-SnapshotsActionsTest-319339418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.d39c7859-1d0a-4a20-ac86-366b6ae555f7" returned: 0 in 0.265s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:46 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a3c7e5b9-919f-415e-8393-4be9d72ab513 tempest-SnapshotsActionsTest-319339418 None] Lock "cinder-quobyte-d39c7859-1d0a-4a20-ac86-366b6ae555f7" released by "_delete_snapshot" :: held 2.173s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:23:46 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a3c7e5b9-919f-415e-8393-4be9d72ab513 tempest-SnapshotsActionsTest-319339418 None] Lock "cinder-quobyte-a7acb89b-4d63-46b9-91fb-70796af75018" released by "delete_snapshot" :: held 2.209s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:23:46 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-a3c7e5b9-919f-415e-8393-4be9d72ab513 tempest-SnapshotsActionsTest-319339418 None] Created reservations ['abec7c60-f074-41b7-b2b1-f2a4b83d7f7c', 'befa15e6-8538-47ad-ad36-26fc767d4370', 'd510bc32-2e9c-4069-86cc-8789553eef15', '0fc695b9-bdac-44c7-8084-bdc091cd2eb7'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:23:46 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-a3c7e5b9-919f-415e-8393-4be9d72ab513 tempest-SnapshotsActionsTest-319339418 None] Delete snapshot completed successfully. Sep 03 14:23:46 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a3c7e5b9-919f-415e-8393-4be9d72ab513 tempest-SnapshotsActionsTest-319339418 None] Lock "cinder-d39c7859-1d0a-4a20-ac86-366b6ae555f7-delete_snapshot" released by "delete_snapshot" :: held 2.403s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:23:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b3ef762f-8c6f-45a0-896b-656aa4531a45 tempest-SnapshotsActionsTest-1231480978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:23:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b3ef762f-8c6f-45a0-896b-656aa4531a45 tempest-SnapshotsActionsTest-1231480978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:23:47 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-b3ef762f-8c6f-45a0-896b-656aa4531a45 tempest-SnapshotsActionsTest-1231480978 None] Creating offline snapshot 7492bdc3-6d39-4bde-84ac-de332769618c of volume a7acb89b-4d63-46b9-91fb-70796af75018 {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:23:47 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9fe6e0-bdbc-485c-b247-67e93da4949b]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:23:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b3ef762f-8c6f-45a0-896b-656aa4531a45 tempest-SnapshotsActionsTest-1231480978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:48 devstack sudo[94948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9 Sep 03 14:23:48 devstack sudo[94948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:48 devstack sudo[94948]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b3ef762f-8c6f-45a0-896b-656aa4531a45 tempest-SnapshotsActionsTest-1231480978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9" returned: 0 in 0.467s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:48 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-b3ef762f-8c6f-45a0-896b-656aa4531a45 tempest-SnapshotsActionsTest-1231480978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7acb89b-4d63-46b9-91fb-70796af75018(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:23:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b3ef762f-8c6f-45a0-896b-656aa4531a45 tempest-SnapshotsActionsTest-1231480978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.7492bdc3-6d39-4bde-84ac-de332769618c 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:48 devstack sudo[94953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.7492bdc3-6d39-4bde-84ac-de332769618c 1G Sep 03 14:23:48 devstack sudo[94953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:48 devstack sudo[94953]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b3ef762f-8c6f-45a0-896b-656aa4531a45 tempest-SnapshotsActionsTest-1231480978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.7492bdc3-6d39-4bde-84ac-de332769618c 1G" returned: 0 in 0.536s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b3ef762f-8c6f-45a0-896b-656aa4531a45 tempest-SnapshotsActionsTest-1231480978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.7492bdc3-6d39-4bde-84ac-de332769618c {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:48 devstack sudo[94958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.7492bdc3-6d39-4bde-84ac-de332769618c Sep 03 14:23:48 devstack sudo[94958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:49 devstack sudo[94958]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b3ef762f-8c6f-45a0-896b-656aa4531a45 tempest-SnapshotsActionsTest-1231480978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.7492bdc3-6d39-4bde-84ac-de332769618c" returned: 0 in 0.358s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:49 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-b3ef762f-8c6f-45a0-896b-656aa4531a45 tempest-SnapshotsActionsTest-1231480978 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.7492bdc3-6d39-4bde-84ac-de332769618c is being set with open permissions: ugo+rw Sep 03 14:23:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b3ef762f-8c6f-45a0-896b-656aa4531a45 tempest-SnapshotsActionsTest-1231480978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.7492bdc3-6d39-4bde-84ac-de332769618c {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:49 devstack sudo[94964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.7492bdc3-6d39-4bde-84ac-de332769618c Sep 03 14:23:49 devstack sudo[94964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:49 devstack sudo[94964]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b3ef762f-8c6f-45a0-896b-656aa4531a45 tempest-SnapshotsActionsTest-1231480978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.7492bdc3-6d39-4bde-84ac-de332769618c" returned: 0 in 0.335s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b3ef762f-8c6f-45a0-896b-656aa4531a45 tempest-SnapshotsActionsTest-1231480978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.840s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:23:49 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-b3ef762f-8c6f-45a0-896b-656aa4531a45 tempest-SnapshotsActionsTest-1231480978 None] Create snapshot completed successfully Sep 03 14:23:50 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ec772269-c0b5-4cdc-9dc1-cfdbae590e05 tempest-SnapshotsActionsTest-319339418 None] Acquiring lock "cinder-7492bdc3-6d39-4bde-84ac-de332769618c-delete_snapshot" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:23:50 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ec772269-c0b5-4cdc-9dc1-cfdbae590e05 tempest-SnapshotsActionsTest-319339418 None] Lock "cinder-7492bdc3-6d39-4bde-84ac-de332769618c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:23:50 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ec772269-c0b5-4cdc-9dc1-cfdbae590e05 tempest-SnapshotsActionsTest-319339418 None] Acquiring lock "cinder-quobyte-a7acb89b-4d63-46b9-91fb-70796af75018" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:23:50 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ec772269-c0b5-4cdc-9dc1-cfdbae590e05 tempest-SnapshotsActionsTest-319339418 None] Lock "cinder-quobyte-a7acb89b-4d63-46b9-91fb-70796af75018" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:23:50 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ec772269-c0b5-4cdc-9dc1-cfdbae590e05 tempest-SnapshotsActionsTest-319339418 None] Acquiring lock "cinder-quobyte-7492bdc3-6d39-4bde-84ac-de332769618c" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:23:50 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ec772269-c0b5-4cdc-9dc1-cfdbae590e05 tempest-SnapshotsActionsTest-319339418 None] Lock "cinder-quobyte-7492bdc3-6d39-4bde-84ac-de332769618c" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:23:50 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-ec772269-c0b5-4cdc-9dc1-cfdbae590e05 tempest-SnapshotsActionsTest-319339418 None] Deleting offline snapshot 7492bdc3-6d39-4bde-84ac-de332769618c of volume a7acb89b-4d63-46b9-91fb-70796af75018 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:23:50 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-ec772269-c0b5-4cdc-9dc1-cfdbae590e05 tempest-SnapshotsActionsTest-319339418 None] snapshot_file for this snap is: volume-a7acb89b-4d63-46b9-91fb-70796af75018.7492bdc3-6d39-4bde-84ac-de332769618c {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:23:50 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9778cbfc-f4ae-47e5-9340-45c6ea749fcc]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:23:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ec772269-c0b5-4cdc-9dc1-cfdbae590e05 tempest-SnapshotsActionsTest-319339418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.7492bdc3-6d39-4bde-84ac-de332769618c {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:50 devstack sudo[94967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.7492bdc3-6d39-4bde-84ac-de332769618c Sep 03 14:23:50 devstack sudo[94967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:50 devstack sudo[94967]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ec772269-c0b5-4cdc-9dc1-cfdbae590e05 tempest-SnapshotsActionsTest-319339418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.7492bdc3-6d39-4bde-84ac-de332769618c" returned: 0 in 0.628s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:50 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-ec772269-c0b5-4cdc-9dc1-cfdbae590e05 tempest-SnapshotsActionsTest-319339418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7acb89b-4d63-46b9-91fb-70796af75018(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:23:50 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcbfc6fb-4fe8-4dd1-bf43-145fac02ef35]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:23:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ec772269-c0b5-4cdc-9dc1-cfdbae590e05 tempest-SnapshotsActionsTest-319339418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:51 devstack sudo[94973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9 Sep 03 14:23:51 devstack sudo[94973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:51 devstack sudo[94973]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ec772269-c0b5-4cdc-9dc1-cfdbae590e05 tempest-SnapshotsActionsTest-319339418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9" returned: 0 in 0.594s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-ec772269-c0b5-4cdc-9dc1-cfdbae590e05 tempest-SnapshotsActionsTest-319339418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7acb89b-4d63-46b9-91fb-70796af75018(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:23:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ec772269-c0b5-4cdc-9dc1-cfdbae590e05 tempest-SnapshotsActionsTest-319339418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.7492bdc3-6d39-4bde-84ac-de332769618c {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:51 devstack sudo[94998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.7492bdc3-6d39-4bde-84ac-de332769618c Sep 03 14:23:51 devstack sudo[94998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:51 devstack cinder-volume[87007]: DEBUG oslo_service.periodic_task [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87007) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 14:23:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:23:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:23:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:23:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:23:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:23:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:51 devstack sudo[95007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:23:51 devstack sudo[95007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:52 devstack sudo[95007]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.442s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:52 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:23:52 devstack cinder-volume[87007]: DEBUG oslo_service.periodic_task [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running periodic task VolumeManager._thread_info {{(pid=87007) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 14:23:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] thread count: 28 {{(pid=87007) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 14:23:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] thread info: [<_MainThread(MainThread, started 123689171054720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87007) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 14:23:52 devstack sudo[94998]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ec772269-c0b5-4cdc-9dc1-cfdbae590e05 tempest-SnapshotsActionsTest-319339418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.7492bdc3-6d39-4bde-84ac-de332769618c" returned: 0 in 0.697s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ec772269-c0b5-4cdc-9dc1-cfdbae590e05 tempest-SnapshotsActionsTest-319339418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.7492bdc3-6d39-4bde-84ac-de332769618c {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:52 devstack sudo[95026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.7492bdc3-6d39-4bde-84ac-de332769618c Sep 03 14:23:52 devstack sudo[95026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:52 devstack sudo[95026]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ec772269-c0b5-4cdc-9dc1-cfdbae590e05 tempest-SnapshotsActionsTest-319339418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.7492bdc3-6d39-4bde-84ac-de332769618c" returned: 0 in 0.602s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:52 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ec772269-c0b5-4cdc-9dc1-cfdbae590e05 tempest-SnapshotsActionsTest-319339418 None] Lock "cinder-quobyte-7492bdc3-6d39-4bde-84ac-de332769618c" released by "_delete_snapshot" :: held 2.695s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:23:52 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ec772269-c0b5-4cdc-9dc1-cfdbae590e05 tempest-SnapshotsActionsTest-319339418 None] Lock "cinder-quobyte-a7acb89b-4d63-46b9-91fb-70796af75018" released by "delete_snapshot" :: held 2.738s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:23:53 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-ec772269-c0b5-4cdc-9dc1-cfdbae590e05 tempest-SnapshotsActionsTest-319339418 None] Created reservations ['be6bd5fc-5db4-4f1a-9f6c-dea7afbefbf4', '2660e648-856a-4f96-89e0-d90b40d1d6ee', '18349bb1-5568-42d7-b16b-5e71a852a7ef', '932b0e0a-3d7b-40d5-9ab6-9ab6295304f6'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:23:53 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-ec772269-c0b5-4cdc-9dc1-cfdbae590e05 tempest-SnapshotsActionsTest-319339418 None] Delete snapshot completed successfully. Sep 03 14:23:53 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ec772269-c0b5-4cdc-9dc1-cfdbae590e05 tempest-SnapshotsActionsTest-319339418 None] Lock "cinder-7492bdc3-6d39-4bde-84ac-de332769618c-delete_snapshot" released by "delete_snapshot" :: held 3.238s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:23:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-dfeaf42d-2dbe-45c3-9f80-fa0037f57d08 tempest-SnapshotsActionsTest-1231480978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:23:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-dfeaf42d-2dbe-45c3-9f80-fa0037f57d08 tempest-SnapshotsActionsTest-1231480978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:23:54 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-dfeaf42d-2dbe-45c3-9f80-fa0037f57d08 tempest-SnapshotsActionsTest-1231480978 None] Creating offline snapshot 8467bf47-623f-46ce-b81e-9f4fdeda6f82 of volume a7acb89b-4d63-46b9-91fb-70796af75018 {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:23:54 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8242c9-5ae0-4595-bc39-5934eaee0834]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:23:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dfeaf42d-2dbe-45c3-9f80-fa0037f57d08 tempest-SnapshotsActionsTest-1231480978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:54 devstack sudo[95036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9 Sep 03 14:23:54 devstack sudo[95036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:54 devstack sudo[95036]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dfeaf42d-2dbe-45c3-9f80-fa0037f57d08 tempest-SnapshotsActionsTest-1231480978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9" returned: 0 in 0.464s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:54 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-dfeaf42d-2dbe-45c3-9f80-fa0037f57d08 tempest-SnapshotsActionsTest-1231480978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7acb89b-4d63-46b9-91fb-70796af75018(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:23:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dfeaf42d-2dbe-45c3-9f80-fa0037f57d08 tempest-SnapshotsActionsTest-1231480978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.8467bf47-623f-46ce-b81e-9f4fdeda6f82 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:54 devstack sudo[95041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.8467bf47-623f-46ce-b81e-9f4fdeda6f82 1G Sep 03 14:23:54 devstack sudo[95041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:55 devstack sudo[95041]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dfeaf42d-2dbe-45c3-9f80-fa0037f57d08 tempest-SnapshotsActionsTest-1231480978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.8467bf47-623f-46ce-b81e-9f4fdeda6f82 1G" returned: 0 in 1.068s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dfeaf42d-2dbe-45c3-9f80-fa0037f57d08 tempest-SnapshotsActionsTest-1231480978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.8467bf47-623f-46ce-b81e-9f4fdeda6f82 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:55 devstack sudo[95054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.8467bf47-623f-46ce-b81e-9f4fdeda6f82 Sep 03 14:23:55 devstack sudo[95054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:56 devstack sudo[95054]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dfeaf42d-2dbe-45c3-9f80-fa0037f57d08 tempest-SnapshotsActionsTest-1231480978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.8467bf47-623f-46ce-b81e-9f4fdeda6f82" returned: 0 in 0.738s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:56 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-dfeaf42d-2dbe-45c3-9f80-fa0037f57d08 tempest-SnapshotsActionsTest-1231480978 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.8467bf47-623f-46ce-b81e-9f4fdeda6f82 is being set with open permissions: ugo+rw Sep 03 14:23:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dfeaf42d-2dbe-45c3-9f80-fa0037f57d08 tempest-SnapshotsActionsTest-1231480978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.8467bf47-623f-46ce-b81e-9f4fdeda6f82 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:56 devstack sudo[95071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.8467bf47-623f-46ce-b81e-9f4fdeda6f82 Sep 03 14:23:56 devstack sudo[95071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:56 devstack sudo[95071]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dfeaf42d-2dbe-45c3-9f80-fa0037f57d08 tempest-SnapshotsActionsTest-1231480978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.8467bf47-623f-46ce-b81e-9f4fdeda6f82" returned: 0 in 0.544s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:56 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:SELECT=110,cinder:UPDATE=99,cinder:INSERT=23,cinder:DELETE=4 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:23:57 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:SELECT=99,cinder:INSERT=28,cinder:UPDATE=98,cinder:DELETE=5 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:23:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-dfeaf42d-2dbe-45c3-9f80-fa0037f57d08 tempest-SnapshotsActionsTest-1231480978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.014s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:23:57 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-dfeaf42d-2dbe-45c3-9f80-fa0037f57d08 tempest-SnapshotsActionsTest-1231480978 None] Create snapshot completed successfully Sep 03 14:23:57 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2d08ff21-b9cc-4c24-adfe-2fd39afb6bf8 tempest-SnapshotsActionsTest-319339418 None] Acquiring lock "cinder-8467bf47-623f-46ce-b81e-9f4fdeda6f82-delete_snapshot" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:23:57 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2d08ff21-b9cc-4c24-adfe-2fd39afb6bf8 tempest-SnapshotsActionsTest-319339418 None] Lock "cinder-8467bf47-623f-46ce-b81e-9f4fdeda6f82-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:23:57 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2d08ff21-b9cc-4c24-adfe-2fd39afb6bf8 tempest-SnapshotsActionsTest-319339418 None] Acquiring lock "cinder-quobyte-a7acb89b-4d63-46b9-91fb-70796af75018" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:23:57 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2d08ff21-b9cc-4c24-adfe-2fd39afb6bf8 tempest-SnapshotsActionsTest-319339418 None] Lock "cinder-quobyte-a7acb89b-4d63-46b9-91fb-70796af75018" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:23:57 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2d08ff21-b9cc-4c24-adfe-2fd39afb6bf8 tempest-SnapshotsActionsTest-319339418 None] Acquiring lock "cinder-quobyte-8467bf47-623f-46ce-b81e-9f4fdeda6f82" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:23:57 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2d08ff21-b9cc-4c24-adfe-2fd39afb6bf8 tempest-SnapshotsActionsTest-319339418 None] Lock "cinder-quobyte-8467bf47-623f-46ce-b81e-9f4fdeda6f82" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:23:57 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-2d08ff21-b9cc-4c24-adfe-2fd39afb6bf8 tempest-SnapshotsActionsTest-319339418 None] Deleting offline snapshot 8467bf47-623f-46ce-b81e-9f4fdeda6f82 of volume a7acb89b-4d63-46b9-91fb-70796af75018 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:23:57 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-2d08ff21-b9cc-4c24-adfe-2fd39afb6bf8 tempest-SnapshotsActionsTest-319339418 None] snapshot_file for this snap is: volume-a7acb89b-4d63-46b9-91fb-70796af75018.8467bf47-623f-46ce-b81e-9f4fdeda6f82 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:23:57 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4996449b-c481-4606-a1a5-0a420097de49]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:23:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2d08ff21-b9cc-4c24-adfe-2fd39afb6bf8 tempest-SnapshotsActionsTest-319339418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.8467bf47-623f-46ce-b81e-9f4fdeda6f82 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:57 devstack sudo[95106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.8467bf47-623f-46ce-b81e-9f4fdeda6f82 Sep 03 14:23:57 devstack sudo[95106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:58 devstack sudo[95106]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2d08ff21-b9cc-4c24-adfe-2fd39afb6bf8 tempest-SnapshotsActionsTest-319339418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.8467bf47-623f-46ce-b81e-9f4fdeda6f82" returned: 0 in 0.599s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:58 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-2d08ff21-b9cc-4c24-adfe-2fd39afb6bf8 tempest-SnapshotsActionsTest-319339418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7acb89b-4d63-46b9-91fb-70796af75018(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:23:58 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38f2320-2839-4b7d-9608-3929ac783186]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:23:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2d08ff21-b9cc-4c24-adfe-2fd39afb6bf8 tempest-SnapshotsActionsTest-319339418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:58 devstack sudo[95121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9 Sep 03 14:23:58 devstack sudo[95121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:59 devstack sudo[95121]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2d08ff21-b9cc-4c24-adfe-2fd39afb6bf8 tempest-SnapshotsActionsTest-319339418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9" returned: 0 in 0.697s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:59 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-2d08ff21-b9cc-4c24-adfe-2fd39afb6bf8 tempest-SnapshotsActionsTest-319339418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7acb89b-4d63-46b9-91fb-70796af75018(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:23:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2d08ff21-b9cc-4c24-adfe-2fd39afb6bf8 tempest-SnapshotsActionsTest-319339418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.8467bf47-623f-46ce-b81e-9f4fdeda6f82 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:59 devstack sudo[95133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.8467bf47-623f-46ce-b81e-9f4fdeda6f82 Sep 03 14:23:59 devstack sudo[95133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:23:59 devstack sudo[95133]: pam_unix(sudo:session): session closed for user root Sep 03 14:23:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2d08ff21-b9cc-4c24-adfe-2fd39afb6bf8 tempest-SnapshotsActionsTest-319339418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.8467bf47-623f-46ce-b81e-9f4fdeda6f82" returned: 0 in 0.654s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:23:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2d08ff21-b9cc-4c24-adfe-2fd39afb6bf8 tempest-SnapshotsActionsTest-319339418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.8467bf47-623f-46ce-b81e-9f4fdeda6f82 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:23:59 devstack sudo[95139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.8467bf47-623f-46ce-b81e-9f4fdeda6f82 Sep 03 14:23:59 devstack sudo[95139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:00 devstack sudo[95139]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2d08ff21-b9cc-4c24-adfe-2fd39afb6bf8 tempest-SnapshotsActionsTest-319339418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.8467bf47-623f-46ce-b81e-9f4fdeda6f82" returned: 0 in 0.450s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:00 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2d08ff21-b9cc-4c24-adfe-2fd39afb6bf8 tempest-SnapshotsActionsTest-319339418 None] Lock "cinder-quobyte-8467bf47-623f-46ce-b81e-9f4fdeda6f82" released by "_delete_snapshot" :: held 2.598s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:24:00 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2d08ff21-b9cc-4c24-adfe-2fd39afb6bf8 tempest-SnapshotsActionsTest-319339418 None] Lock "cinder-quobyte-a7acb89b-4d63-46b9-91fb-70796af75018" released by "delete_snapshot" :: held 2.634s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:24:00 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-2d08ff21-b9cc-4c24-adfe-2fd39afb6bf8 tempest-SnapshotsActionsTest-319339418 None] Created reservations ['de17f3b3-3b2b-4d1e-8788-0dfe61a39e30', '3b59ba7e-087d-4ba0-8dd4-43e57f97f615', 'e57653bb-b517-44a5-8d7c-7b1efe90000a', '13444c7e-443f-4a4c-9c38-fe691e2886cd'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:24:00 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-2d08ff21-b9cc-4c24-adfe-2fd39afb6bf8 tempest-SnapshotsActionsTest-319339418 None] Delete snapshot completed successfully. Sep 03 14:24:00 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2d08ff21-b9cc-4c24-adfe-2fd39afb6bf8 tempest-SnapshotsActionsTest-319339418 None] Lock "cinder-8467bf47-623f-46ce-b81e-9f4fdeda6f82-delete_snapshot" released by "delete_snapshot" :: held 3.167s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:24:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-e92aadfa-138b-41d9-ad6b-813f5f3353fd tempest-SnapshotsActionsTest-1231480978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:24:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-e92aadfa-138b-41d9-ad6b-813f5f3353fd tempest-SnapshotsActionsTest-1231480978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.031s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:24:02 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-e92aadfa-138b-41d9-ad6b-813f5f3353fd tempest-SnapshotsActionsTest-1231480978 None] Creating offline snapshot aa9e5a68-e707-40be-8298-c1f17382dc1f of volume a7acb89b-4d63-46b9-91fb-70796af75018 {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:24:02 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c3957e-3cd9-4175-be29-5ca8e473d3ac]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:24:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e92aadfa-138b-41d9-ad6b-813f5f3353fd tempest-SnapshotsActionsTest-1231480978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:02 devstack sudo[95244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9 Sep 03 14:24:02 devstack sudo[95244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:03 devstack sudo[95244]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e92aadfa-138b-41d9-ad6b-813f5f3353fd tempest-SnapshotsActionsTest-1231480978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9" returned: 0 in 0.921s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:03 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-e92aadfa-138b-41d9-ad6b-813f5f3353fd tempest-SnapshotsActionsTest-1231480978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7acb89b-4d63-46b9-91fb-70796af75018(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:24:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e92aadfa-138b-41d9-ad6b-813f5f3353fd tempest-SnapshotsActionsTest-1231480978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.aa9e5a68-e707-40be-8298-c1f17382dc1f 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:03 devstack sudo[95252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.aa9e5a68-e707-40be-8298-c1f17382dc1f 1G Sep 03 14:24:03 devstack sudo[95252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:04 devstack sudo[95252]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e92aadfa-138b-41d9-ad6b-813f5f3353fd tempest-SnapshotsActionsTest-1231480978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.aa9e5a68-e707-40be-8298-c1f17382dc1f 1G" returned: 0 in 0.966s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e92aadfa-138b-41d9-ad6b-813f5f3353fd tempest-SnapshotsActionsTest-1231480978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.aa9e5a68-e707-40be-8298-c1f17382dc1f {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:04 devstack sudo[95258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.aa9e5a68-e707-40be-8298-c1f17382dc1f Sep 03 14:24:04 devstack sudo[95258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:04 devstack sudo[95258]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e92aadfa-138b-41d9-ad6b-813f5f3353fd tempest-SnapshotsActionsTest-1231480978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.aa9e5a68-e707-40be-8298-c1f17382dc1f" returned: 0 in 0.506s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:04 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-e92aadfa-138b-41d9-ad6b-813f5f3353fd tempest-SnapshotsActionsTest-1231480978 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.aa9e5a68-e707-40be-8298-c1f17382dc1f is being set with open permissions: ugo+rw Sep 03 14:24:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e92aadfa-138b-41d9-ad6b-813f5f3353fd tempest-SnapshotsActionsTest-1231480978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.aa9e5a68-e707-40be-8298-c1f17382dc1f {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:04 devstack sudo[95264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.aa9e5a68-e707-40be-8298-c1f17382dc1f Sep 03 14:24:04 devstack sudo[95264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:05 devstack sudo[95264]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e92aadfa-138b-41d9-ad6b-813f5f3353fd tempest-SnapshotsActionsTest-1231480978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.aa9e5a68-e707-40be-8298-c1f17382dc1f" returned: 0 in 0.789s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-e92aadfa-138b-41d9-ad6b-813f5f3353fd tempest-SnapshotsActionsTest-1231480978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.472s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:24:05 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b052d15-2e0e-4596-8f3d-080db8ccb6d4 tempest-VolumesActionsTest-637900353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:24:05 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2b052d15-2e0e-4596-8f3d-080db8ccb6d4 tempest-VolumesActionsTest-637900353 None] Flow 'volume_create_manager' (fa620733-1d72-4a9b-bbd3-ecc890bac607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:24:05 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2b052d15-2e0e-4596-8f3d-080db8ccb6d4 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80d449e9-bd78-42c9-9c3c-df871b8daed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:05 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2b052d15-2e0e-4596-8f3d-080db8ccb6d4 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80d449e9-bd78-42c9-9c3c-df871b8daed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-526088791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29e994d9-8cf0-4010-8540-36d40a4f6078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0bb90fbedf4d30a33ab1ba1ecc6a6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:24:05Z,use_quota=True,user_id='a37e5511bcff4c8a8013a0408401e475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:05 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2b052d15-2e0e-4596-8f3d-080db8ccb6d4 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d26e8072-79dd-401b-afa8-5032ac7ede77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:05 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2b052d15-2e0e-4596-8f3d-080db8ccb6d4 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d26e8072-79dd-401b-afa8-5032ac7ede77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:05 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2b052d15-2e0e-4596-8f3d-080db8ccb6d4 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e830e87e-20a8-49ca-8e86-fa187c097891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:05 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2b052d15-2e0e-4596-8f3d-080db8ccb6d4 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e830e87e-20a8-49ca-8e86-fa187c097891) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29e994d9-8cf0-4010-8540-36d40a4f6078', 'volume_name': 'volume-29e994d9-8cf0-4010-8540-36d40a4f6078', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:05 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2b052d15-2e0e-4596-8f3d-080db8ccb6d4 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6702962-f413-429f-9f86-8b879c712730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:05 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2b052d15-2e0e-4596-8f3d-080db8ccb6d4 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6702962-f413-429f-9f86-8b879c712730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:05 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2b052d15-2e0e-4596-8f3d-080db8ccb6d4 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f908173-d4b9-4e61-b2ee-a3e3b5a291ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:05 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-2b052d15-2e0e-4596-8f3d-080db8ccb6d4 tempest-VolumesActionsTest-637900353 None] Volume 29e994d9-8cf0-4010-8540-36d40a4f6078: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29e994d9-8cf0-4010-8540-36d40a4f6078', 'volume_size': 1} Sep 03 14:24:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2b052d15-2e0e-4596-8f3d-080db8ccb6d4 tempest-VolumesActionsTest-637900353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:24:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2b052d15-2e0e-4596-8f3d-080db8ccb6d4 tempest-VolumesActionsTest-637900353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:24:05 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2b052d15-2e0e-4596-8f3d-080db8ccb6d4 tempest-VolumesActionsTest-637900353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-526088791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29e994d9-8cf0-4010-8540-36d40a4f6078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0bb90fbedf4d30a33ab1ba1ecc6a6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:24:05Z,use_quota=True,user_id='a37e5511bcff4c8a8013a0408401e475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:24:05 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-2b052d15-2e0e-4596-8f3d-080db8ccb6d4 tempest-VolumesActionsTest-637900353 None] Creating volume 29e994d9-8cf0-4010-8540-36d40a4f6078 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:24:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2b052d15-2e0e-4596-8f3d-080db8ccb6d4 tempest-VolumesActionsTest-637900353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:24:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2b052d15-2e0e-4596-8f3d-080db8ccb6d4 tempest-VolumesActionsTest-637900353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:24:05 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2b052d15-2e0e-4596-8f3d-080db8ccb6d4 tempest-VolumesActionsTest-637900353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:24:05 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2b052d15-2e0e-4596-8f3d-080db8ccb6d4 tempest-VolumesActionsTest-637900353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:24:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2b052d15-2e0e-4596-8f3d-080db8ccb6d4 tempest-VolumesActionsTest-637900353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:24:05 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2b052d15-2e0e-4596-8f3d-080db8ccb6d4 tempest-VolumesActionsTest-637900353 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:24:05 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-2b052d15-2e0e-4596-8f3d-080db8ccb6d4 tempest-VolumesActionsTest-637900353 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:24:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2b052d15-2e0e-4596-8f3d-080db8ccb6d4 tempest-VolumesActionsTest-637900353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-29e994d9-8cf0-4010-8540-36d40a4f6078 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:05 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-e92aadfa-138b-41d9-ad6b-813f5f3353fd tempest-SnapshotsActionsTest-1231480978 None] Create snapshot completed successfully Sep 03 14:24:05 devstack sudo[95267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-29e994d9-8cf0-4010-8540-36d40a4f6078 1073741824 Sep 03 14:24:05 devstack sudo[95267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:06 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a8ea4a1c-0c8d-4620-aee9-ad4e80d29bc6 tempest-SnapshotsActionsTest-319339418 None] Acquiring lock "cinder-aa9e5a68-e707-40be-8298-c1f17382dc1f-delete_snapshot" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:24:06 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a8ea4a1c-0c8d-4620-aee9-ad4e80d29bc6 tempest-SnapshotsActionsTest-319339418 None] Lock "cinder-aa9e5a68-e707-40be-8298-c1f17382dc1f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.103s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:24:06 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a8ea4a1c-0c8d-4620-aee9-ad4e80d29bc6 tempest-SnapshotsActionsTest-319339418 None] Acquiring lock "cinder-quobyte-a7acb89b-4d63-46b9-91fb-70796af75018" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:24:06 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a8ea4a1c-0c8d-4620-aee9-ad4e80d29bc6 tempest-SnapshotsActionsTest-319339418 None] Lock "cinder-quobyte-a7acb89b-4d63-46b9-91fb-70796af75018" acquired by "delete_snapshot" :: waited 0.059s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:24:07 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a8ea4a1c-0c8d-4620-aee9-ad4e80d29bc6 tempest-SnapshotsActionsTest-319339418 None] Acquiring lock "cinder-quobyte-aa9e5a68-e707-40be-8298-c1f17382dc1f" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:24:07 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a8ea4a1c-0c8d-4620-aee9-ad4e80d29bc6 tempest-SnapshotsActionsTest-319339418 None] Lock "cinder-quobyte-aa9e5a68-e707-40be-8298-c1f17382dc1f" acquired by "_delete_snapshot" :: waited 0.053s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:24:07 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-a8ea4a1c-0c8d-4620-aee9-ad4e80d29bc6 tempest-SnapshotsActionsTest-319339418 None] Deleting offline snapshot aa9e5a68-e707-40be-8298-c1f17382dc1f of volume a7acb89b-4d63-46b9-91fb-70796af75018 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:24:07 devstack sudo[95267]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:07 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-a8ea4a1c-0c8d-4620-aee9-ad4e80d29bc6 tempest-SnapshotsActionsTest-319339418 None] snapshot_file for this snap is: volume-a7acb89b-4d63-46b9-91fb-70796af75018.aa9e5a68-e707-40be-8298-c1f17382dc1f {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:24:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2b052d15-2e0e-4596-8f3d-080db8ccb6d4 tempest-VolumesActionsTest-637900353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-29e994d9-8cf0-4010-8540-36d40a4f6078 1073741824" returned: 0 in 1.485s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:07 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[28dd9b53-ec6b-49f1-b78d-77af8ff044ba]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:24:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a8ea4a1c-0c8d-4620-aee9-ad4e80d29bc6 tempest-SnapshotsActionsTest-319339418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.aa9e5a68-e707-40be-8298-c1f17382dc1f {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2b052d15-2e0e-4596-8f3d-080db8ccb6d4 tempest-VolumesActionsTest-637900353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-29e994d9-8cf0-4010-8540-36d40a4f6078 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:07 devstack sudo[95358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-29e994d9-8cf0-4010-8540-36d40a4f6078 Sep 03 14:24:07 devstack sudo[95358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:07 devstack sudo[95355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.aa9e5a68-e707-40be-8298-c1f17382dc1f Sep 03 14:24:07 devstack sudo[95355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:07 devstack sudo[95358]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2b052d15-2e0e-4596-8f3d-080db8ccb6d4 tempest-VolumesActionsTest-637900353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-29e994d9-8cf0-4010-8540-36d40a4f6078" returned: 0 in 0.711s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:07 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2b052d15-2e0e-4596-8f3d-080db8ccb6d4 tempest-VolumesActionsTest-637900353 None] <== create_volume: return (2317ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:24:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2b052d15-2e0e-4596-8f3d-080db8ccb6d4 tempest-VolumesActionsTest-637900353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.321s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:24:07 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2b052d15-2e0e-4596-8f3d-080db8ccb6d4 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f908173-d4b9-4e61-b2ee-a3e3b5a291ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29e994d9-8cf0-4010-8540-36d40a4f6078', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:07 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2b052d15-2e0e-4596-8f3d-080db8ccb6d4 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d7aa71d-2664-4179-969c-c98087836698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:08 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-2b052d15-2e0e-4596-8f3d-080db8ccb6d4 tempest-VolumesActionsTest-637900353 None] Volume volume-29e994d9-8cf0-4010-8540-36d40a4f6078 (29e994d9-8cf0-4010-8540-36d40a4f6078): created successfully Sep 03 14:24:08 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2b052d15-2e0e-4596-8f3d-080db8ccb6d4 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d7aa71d-2664-4179-969c-c98087836698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:08 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2b052d15-2e0e-4596-8f3d-080db8ccb6d4 tempest-VolumesActionsTest-637900353 None] Flow 'volume_create_manager' (fa620733-1d72-4a9b-bbd3-ecc890bac607) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:24:08 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-2b052d15-2e0e-4596-8f3d-080db8ccb6d4 tempest-VolumesActionsTest-637900353 None] Created volume successfully. Sep 03 14:24:08 devstack sudo[95355]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a8ea4a1c-0c8d-4620-aee9-ad4e80d29bc6 tempest-SnapshotsActionsTest-319339418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.aa9e5a68-e707-40be-8298-c1f17382dc1f" returned: 0 in 0.924s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:08 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-a8ea4a1c-0c8d-4620-aee9-ad4e80d29bc6 tempest-SnapshotsActionsTest-319339418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7acb89b-4d63-46b9-91fb-70796af75018(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:24:08 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2a324e-180d-403b-b72a-f7d786668436]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:24:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a8ea4a1c-0c8d-4620-aee9-ad4e80d29bc6 tempest-SnapshotsActionsTest-319339418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:08 devstack sudo[95371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9 Sep 03 14:24:08 devstack sudo[95371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:08 devstack sudo[95371]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a8ea4a1c-0c8d-4620-aee9-ad4e80d29bc6 tempest-SnapshotsActionsTest-319339418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9" returned: 0 in 0.443s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:08 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-a8ea4a1c-0c8d-4620-aee9-ad4e80d29bc6 tempest-SnapshotsActionsTest-319339418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7acb89b-4d63-46b9-91fb-70796af75018(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:24:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a8ea4a1c-0c8d-4620-aee9-ad4e80d29bc6 tempest-SnapshotsActionsTest-319339418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.aa9e5a68-e707-40be-8298-c1f17382dc1f {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:08 devstack sudo[95380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.aa9e5a68-e707-40be-8298-c1f17382dc1f Sep 03 14:24:08 devstack sudo[95380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:08 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a238abec-39cb-49a8-950b-69b613edc4d6 tempest-VolumesActionsTest-637900353 None] Acquiring lock "cinder-29e994d9-8cf0-4010-8540-36d40a4f6078" by "attach_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:24:08 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a238abec-39cb-49a8-950b-69b613edc4d6 tempest-VolumesActionsTest-637900353 None] Lock "cinder-29e994d9-8cf0-4010-8540-36d40a4f6078" acquired by "attach_volume" :: waited 0.036s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:24:09 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-a238abec-39cb-49a8-950b-69b613edc4d6 tempest-VolumesActionsTest-637900353 None] Attaching volume 29e994d9-8cf0-4010-8540-36d40a4f6078 to instance e1731dac-ef18-4e88-8acc-2daaae84ac44 at mountpoint /dev/vdb on host None. Sep 03 14:24:09 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-a238abec-39cb-49a8-950b-69b613edc4d6 tempest-VolumesActionsTest-637900353 None] Attach volume completed successfully. Sep 03 14:24:09 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a238abec-39cb-49a8-950b-69b613edc4d6 tempest-VolumesActionsTest-637900353 None] Lock "cinder-29e994d9-8cf0-4010-8540-36d40a4f6078" released by "attach_volume" :: held 0.173s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:24:09 devstack sudo[95380]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a8ea4a1c-0c8d-4620-aee9-ad4e80d29bc6 tempest-SnapshotsActionsTest-319339418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.aa9e5a68-e707-40be-8298-c1f17382dc1f" returned: 0 in 0.863s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a8ea4a1c-0c8d-4620-aee9-ad4e80d29bc6 tempest-SnapshotsActionsTest-319339418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.aa9e5a68-e707-40be-8298-c1f17382dc1f {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:09 devstack sudo[95385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.aa9e5a68-e707-40be-8298-c1f17382dc1f Sep 03 14:24:09 devstack sudo[95385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:09 devstack sudo[95385]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a8ea4a1c-0c8d-4620-aee9-ad4e80d29bc6 tempest-SnapshotsActionsTest-319339418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.aa9e5a68-e707-40be-8298-c1f17382dc1f" returned: 0 in 0.441s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:09 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a8ea4a1c-0c8d-4620-aee9-ad4e80d29bc6 tempest-SnapshotsActionsTest-319339418 None] Lock "cinder-quobyte-aa9e5a68-e707-40be-8298-c1f17382dc1f" released by "_delete_snapshot" :: held 2.848s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:24:09 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a8ea4a1c-0c8d-4620-aee9-ad4e80d29bc6 tempest-SnapshotsActionsTest-319339418 None] Lock "cinder-quobyte-a7acb89b-4d63-46b9-91fb-70796af75018" released by "delete_snapshot" :: held 2.930s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:24:09 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-04a6d588-f13f-4499-a7b5-011e0d74d8d3 tempest-VolumesActionsTest-2038702324 None] Terminate volume connection completed successfully. Sep 03 14:24:10 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-04a6d588-f13f-4499-a7b5-011e0d74d8d3 tempest-VolumesActionsTest-2038702324 None] Acquiring lock "cinder-29e994d9-8cf0-4010-8540-36d40a4f6078-detach_volume" by "detach_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:24:10 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-a8ea4a1c-0c8d-4620-aee9-ad4e80d29bc6 tempest-SnapshotsActionsTest-319339418 None] Created reservations ['5867d609-dac8-4145-a4bf-3f9b648bbbc9', 'd2814046-c41f-45c7-bc52-900148f81127', '231e44cb-15e7-414f-b499-8d9170793a10', '8a8b04e5-a9b3-45fa-a704-1bf553dfb2ac'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:24:10 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-04a6d588-f13f-4499-a7b5-011e0d74d8d3 tempest-VolumesActionsTest-2038702324 None] Lock "cinder-29e994d9-8cf0-4010-8540-36d40a4f6078-detach_volume" acquired by "detach_volume" :: waited 0.047s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:24:10 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-04a6d588-f13f-4499-a7b5-011e0d74d8d3 tempest-VolumesActionsTest-2038702324 None] Detaching volume 29e994d9-8cf0-4010-8540-36d40a4f6078 from instance e1731dac-ef18-4e88-8acc-2daaae84ac44. Sep 03 14:24:10 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-04a6d588-f13f-4499-a7b5-011e0d74d8d3 tempest-VolumesActionsTest-2038702324 None] Detach volume completed successfully. Sep 03 14:24:10 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-a8ea4a1c-0c8d-4620-aee9-ad4e80d29bc6 tempest-SnapshotsActionsTest-319339418 None] Delete snapshot completed successfully. Sep 03 14:24:10 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-04a6d588-f13f-4499-a7b5-011e0d74d8d3 tempest-VolumesActionsTest-2038702324 None] Lock "cinder-29e994d9-8cf0-4010-8540-36d40a4f6078-detach_volume" released by "detach_volume" :: held 0.133s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:24:10 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a8ea4a1c-0c8d-4620-aee9-ad4e80d29bc6 tempest-SnapshotsActionsTest-319339418 None] Lock "cinder-aa9e5a68-e707-40be-8298-c1f17382dc1f-delete_snapshot" released by "delete_snapshot" :: held 3.317s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:24:10 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7d001ef2-5ac7-4efc-9260-78e955f20569 tempest-VolumesActionsTest-637900353 None] Acquiring lock "cinder-29e994d9-8cf0-4010-8540-36d40a4f6078-detach_volume" by "detach_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:24:10 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7d001ef2-5ac7-4efc-9260-78e955f20569 tempest-VolumesActionsTest-637900353 None] Lock "cinder-29e994d9-8cf0-4010-8540-36d40a4f6078-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:24:10 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-7d001ef2-5ac7-4efc-9260-78e955f20569 tempest-VolumesActionsTest-637900353 None] Volume detach called, but volume not attached. Sep 03 14:24:10 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7d001ef2-5ac7-4efc-9260-78e955f20569 tempest-VolumesActionsTest-637900353 None] Lock "cinder-29e994d9-8cf0-4010-8540-36d40a4f6078-detach_volume" released by "detach_volume" :: held 0.047s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:24:10 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-03b4bec9-fb81-4c03-8b16-c734028ebc0b tempest-VolumesActionsTest-637900353 None] Acquiring lock "cinder-29e994d9-8cf0-4010-8540-36d40a4f6078-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:24:10 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-03b4bec9-fb81-4c03-8b16-c734028ebc0b tempest-VolumesActionsTest-637900353 None] Lock "cinder-29e994d9-8cf0-4010-8540-36d40a4f6078-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:24:11 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-03b4bec9-fb81-4c03-8b16-c734028ebc0b tempest-VolumesActionsTest-637900353 None] Acquiring lock "cinder-quobyte-29e994d9-8cf0-4010-8540-36d40a4f6078" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:24:11 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-03b4bec9-fb81-4c03-8b16-c734028ebc0b tempest-VolumesActionsTest-637900353 None] Lock "cinder-quobyte-29e994d9-8cf0-4010-8540-36d40a4f6078" acquired by "delete_volume" :: waited 0.027s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:24:11 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b99546-9a1f-4cca-b508-a721b7771e3e]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:24:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-03b4bec9-fb81-4c03-8b16-c734028ebc0b tempest-VolumesActionsTest-637900353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-29e994d9-8cf0-4010-8540-36d40a4f6078 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:11 devstack sudo[95391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-29e994d9-8cf0-4010-8540-36d40a4f6078 Sep 03 14:24:11 devstack sudo[95391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:11 devstack sudo[95391]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-03b4bec9-fb81-4c03-8b16-c734028ebc0b tempest-VolumesActionsTest-637900353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-29e994d9-8cf0-4010-8540-36d40a4f6078" returned: 0 in 0.766s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-03b4bec9-fb81-4c03-8b16-c734028ebc0b tempest-VolumesActionsTest-637900353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-29e994d9-8cf0-4010-8540-36d40a4f6078 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:11 devstack sudo[95398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-29e994d9-8cf0-4010-8540-36d40a4f6078 Sep 03 14:24:11 devstack sudo[95398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:12 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-de1ca7c6-5842-4678-ac18-22e1c1a3775d tempest-SnapshotsActionsTest-1231480978 None] Acquiring lock "cinder-cd9f7979-ca3d-4076-b24a-65075410c2d9-delete_snapshot" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:24:12 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-de1ca7c6-5842-4678-ac18-22e1c1a3775d tempest-SnapshotsActionsTest-1231480978 None] Lock "cinder-cd9f7979-ca3d-4076-b24a-65075410c2d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:24:12 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-de1ca7c6-5842-4678-ac18-22e1c1a3775d tempest-SnapshotsActionsTest-1231480978 None] Acquiring lock "cinder-quobyte-a7acb89b-4d63-46b9-91fb-70796af75018" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:24:12 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-de1ca7c6-5842-4678-ac18-22e1c1a3775d tempest-SnapshotsActionsTest-1231480978 None] Lock "cinder-quobyte-a7acb89b-4d63-46b9-91fb-70796af75018" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:24:12 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-de1ca7c6-5842-4678-ac18-22e1c1a3775d tempest-SnapshotsActionsTest-1231480978 None] Acquiring lock "cinder-quobyte-cd9f7979-ca3d-4076-b24a-65075410c2d9" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:24:12 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-de1ca7c6-5842-4678-ac18-22e1c1a3775d tempest-SnapshotsActionsTest-1231480978 None] Lock "cinder-quobyte-cd9f7979-ca3d-4076-b24a-65075410c2d9" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:24:12 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-de1ca7c6-5842-4678-ac18-22e1c1a3775d tempest-SnapshotsActionsTest-1231480978 None] Deleting offline snapshot cd9f7979-ca3d-4076-b24a-65075410c2d9 of volume a7acb89b-4d63-46b9-91fb-70796af75018 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:24:12 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-de1ca7c6-5842-4678-ac18-22e1c1a3775d tempest-SnapshotsActionsTest-1231480978 None] snapshot_file for this snap is: volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:24:12 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63b7867-62c1-4541-887d-c065c14037e0]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:24:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-de1ca7c6-5842-4678-ac18-22e1c1a3775d tempest-SnapshotsActionsTest-1231480978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:12 devstack sudo[95398]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-03b4bec9-fb81-4c03-8b16-c734028ebc0b tempest-VolumesActionsTest-637900353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-29e994d9-8cf0-4010-8540-36d40a4f6078" returned: 0 in 0.371s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:12 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-03b4bec9-fb81-4c03-8b16-c734028ebc0b tempest-VolumesActionsTest-637900353 None] Lock "cinder-quobyte-29e994d9-8cf0-4010-8540-36d40a4f6078" released by "delete_volume" :: held 1.207s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:24:12 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-03b4bec9-fb81-4c03-8b16-c734028ebc0b tempest-VolumesActionsTest-637900353 None] Created reservations ['3278d43c-7093-4e4b-aa80-24d89fee3cc3', 'ebcd97e2-6a9b-4d4b-a3d4-a12aacd49143', 'ab486023-5d23-4a5a-a3de-898319f6b1f3', 'a4df9d2f-0456-4a74-95c8-221f27568524'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:24:12 devstack sudo[95401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9 Sep 03 14:24:12 devstack sudo[95401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-03b4bec9-fb81-4c03-8b16-c734028ebc0b tempest-VolumesActionsTest-637900353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:24:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-03b4bec9-fb81-4c03-8b16-c734028ebc0b tempest-VolumesActionsTest-637900353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:24:12 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-03b4bec9-fb81-4c03-8b16-c734028ebc0b tempest-VolumesActionsTest-637900353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:24:12 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-03b4bec9-fb81-4c03-8b16-c734028ebc0b tempest-VolumesActionsTest-637900353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:24:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-03b4bec9-fb81-4c03-8b16-c734028ebc0b tempest-VolumesActionsTest-637900353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:24:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-03b4bec9-fb81-4c03-8b16-c734028ebc0b tempest-VolumesActionsTest-637900353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:12 devstack sudo[95403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:24:12 devstack sudo[95403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:12 devstack sudo[95401]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-de1ca7c6-5842-4678-ac18-22e1c1a3775d tempest-SnapshotsActionsTest-1231480978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9" returned: 0 in 0.563s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:12 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-de1ca7c6-5842-4678-ac18-22e1c1a3775d tempest-SnapshotsActionsTest-1231480978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7acb89b-4d63-46b9-91fb-70796af75018(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:24:12 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1373c76c-09c2-46c7-9942-592bccbcc0b9]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:24:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-de1ca7c6-5842-4678-ac18-22e1c1a3775d tempest-SnapshotsActionsTest-1231480978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:12 devstack sudo[95403]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-03b4bec9-fb81-4c03-8b16-c734028ebc0b tempest-VolumesActionsTest-637900353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.394s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:12 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-03b4bec9-fb81-4c03-8b16-c734028ebc0b tempest-VolumesActionsTest-637900353 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:24:12 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-03b4bec9-fb81-4c03-8b16-c734028ebc0b tempest-VolumesActionsTest-637900353 None] Deleted volume successfully. Sep 03 14:24:12 devstack sudo[95408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018 Sep 03 14:24:12 devstack sudo[95408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:12 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-03b4bec9-fb81-4c03-8b16-c734028ebc0b tempest-VolumesActionsTest-637900353 None] Lock "cinder-29e994d9-8cf0-4010-8540-36d40a4f6078-delete_volume" released by "delete_volume" :: held 2.031s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:24:13 devstack sudo[95408]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-de1ca7c6-5842-4678-ac18-22e1c1a3775d tempest-SnapshotsActionsTest-1231480978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018" returned: 0 in 0.436s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-de1ca7c6-5842-4678-ac18-22e1c1a3775d tempest-SnapshotsActionsTest-1231480978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:13 devstack sudo[95414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9 Sep 03 14:24:13 devstack sudo[95414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:13 devstack sudo[95414]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-de1ca7c6-5842-4678-ac18-22e1c1a3775d tempest-SnapshotsActionsTest-1231480978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9" returned: 0 in 0.638s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-de1ca7c6-5842-4678-ac18-22e1c1a3775d tempest-SnapshotsActionsTest-1231480978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:13 devstack sudo[95425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9 Sep 03 14:24:13 devstack sudo[95425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:14 devstack sudo[95425]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-de1ca7c6-5842-4678-ac18-22e1c1a3775d tempest-SnapshotsActionsTest-1231480978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018.cd9f7979-ca3d-4076-b24a-65075410c2d9" returned: 0 in 0.507s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:14 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-de1ca7c6-5842-4678-ac18-22e1c1a3775d tempest-SnapshotsActionsTest-1231480978 None] Lock "cinder-quobyte-cd9f7979-ca3d-4076-b24a-65075410c2d9" released by "_delete_snapshot" :: held 2.314s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:24:14 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-de1ca7c6-5842-4678-ac18-22e1c1a3775d tempest-SnapshotsActionsTest-1231480978 None] Lock "cinder-quobyte-a7acb89b-4d63-46b9-91fb-70796af75018" released by "delete_snapshot" :: held 2.363s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:24:14 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-de1ca7c6-5842-4678-ac18-22e1c1a3775d tempest-SnapshotsActionsTest-1231480978 None] Created reservations ['ecc9f1e9-f239-4e48-a164-cea0541e111f', '73f76873-4fe4-400a-b2a5-52b110812394', 'e4c4e2c5-ce71-437f-95d7-d62108ada460', '39226a2c-1c85-45c2-ba64-bdf91cf39468'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:24:14 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-de1ca7c6-5842-4678-ac18-22e1c1a3775d tempest-SnapshotsActionsTest-1231480978 None] Delete snapshot completed successfully. Sep 03 14:24:14 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-de1ca7c6-5842-4678-ac18-22e1c1a3775d tempest-SnapshotsActionsTest-1231480978 None] Lock "cinder-cd9f7979-ca3d-4076-b24a-65075410c2d9-delete_snapshot" released by "delete_snapshot" :: held 2.668s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:24:15 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-6564f47f-8220-414a-966b-88e21992050b tempest-SnapshotsActionsTest-1231480978 None] Acquiring lock "cinder-a7acb89b-4d63-46b9-91fb-70796af75018-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:24:15 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-6564f47f-8220-414a-966b-88e21992050b tempest-SnapshotsActionsTest-1231480978 None] Lock "cinder-a7acb89b-4d63-46b9-91fb-70796af75018-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:24:15 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-6564f47f-8220-414a-966b-88e21992050b tempest-SnapshotsActionsTest-1231480978 None] Acquiring lock "cinder-quobyte-a7acb89b-4d63-46b9-91fb-70796af75018" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:24:15 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-6564f47f-8220-414a-966b-88e21992050b tempest-SnapshotsActionsTest-1231480978 None] Lock "cinder-quobyte-a7acb89b-4d63-46b9-91fb-70796af75018" acquired by "delete_volume" :: waited 0.049s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:24:15 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5813bf2-7f07-4687-b6d0-a909577424ec]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:24:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6564f47f-8220-414a-966b-88e21992050b tempest-SnapshotsActionsTest-1231480978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:15 devstack sudo[95463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018 Sep 03 14:24:15 devstack sudo[95463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:16 devstack sudo[95463]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6564f47f-8220-414a-966b-88e21992050b tempest-SnapshotsActionsTest-1231480978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018" returned: 0 in 0.476s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6564f47f-8220-414a-966b-88e21992050b tempest-SnapshotsActionsTest-1231480978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:16 devstack sudo[95473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018 Sep 03 14:24:16 devstack sudo[95473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:16 devstack sudo[95473]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6564f47f-8220-414a-966b-88e21992050b tempest-SnapshotsActionsTest-1231480978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a7acb89b-4d63-46b9-91fb-70796af75018" returned: 0 in 0.460s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:16 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-6564f47f-8220-414a-966b-88e21992050b tempest-SnapshotsActionsTest-1231480978 None] Lock "cinder-quobyte-a7acb89b-4d63-46b9-91fb-70796af75018" released by "delete_volume" :: held 1.095s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:24:16 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-6564f47f-8220-414a-966b-88e21992050b tempest-SnapshotsActionsTest-1231480978 None] Created reservations ['7fc5ea00-91e0-4a6a-a918-0cc507e2f7f0', 'f1721896-6b15-4132-bdf9-32610b475fee', '6f6f7878-5b96-4460-9389-1c1ccaff01b7', 'faee7281-1108-411f-a977-5f1a030ea65a'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:24:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6564f47f-8220-414a-966b-88e21992050b tempest-SnapshotsActionsTest-1231480978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:24:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6564f47f-8220-414a-966b-88e21992050b tempest-SnapshotsActionsTest-1231480978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:24:16 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-6564f47f-8220-414a-966b-88e21992050b tempest-SnapshotsActionsTest-1231480978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:24:16 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-6564f47f-8220-414a-966b-88e21992050b tempest-SnapshotsActionsTest-1231480978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:24:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6564f47f-8220-414a-966b-88e21992050b tempest-SnapshotsActionsTest-1231480978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:24:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6564f47f-8220-414a-966b-88e21992050b tempest-SnapshotsActionsTest-1231480978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:16 devstack sudo[95482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:24:16 devstack sudo[95482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:17 devstack sudo[95482]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6564f47f-8220-414a-966b-88e21992050b tempest-SnapshotsActionsTest-1231480978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.260s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:17 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-6564f47f-8220-414a-966b-88e21992050b tempest-SnapshotsActionsTest-1231480978 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:24:17 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-6564f47f-8220-414a-966b-88e21992050b tempest-SnapshotsActionsTest-1231480978 None] Deleted volume successfully. Sep 03 14:24:17 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-6564f47f-8220-414a-966b-88e21992050b tempest-SnapshotsActionsTest-1231480978 None] Lock "cinder-a7acb89b-4d63-46b9-91fb-70796af75018-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:24:18 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-e75a2265-ab5e-431a-ba2c-87fd43602d2b tempest-VolumesActionsTest-637900353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:24:18 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e75a2265-ab5e-431a-ba2c-87fd43602d2b tempest-VolumesActionsTest-637900353 None] Flow 'volume_create_manager' (d453f6bf-44a8-4213-89c2-f829ee063b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:24:18 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e75a2265-ab5e-431a-ba2c-87fd43602d2b tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (329b01a2-fadd-4169-8ca8-a5e1967a8bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:18 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e75a2265-ab5e-431a-ba2c-87fd43602d2b tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (329b01a2-fadd-4169-8ca8-a5e1967a8bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-672223316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e77f9556-bc18-4c94-a784-5342c253df35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0bb90fbedf4d30a33ab1ba1ecc6a6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:24:18Z,use_quota=True,user_id='a37e5511bcff4c8a8013a0408401e475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:18 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e75a2265-ab5e-431a-ba2c-87fd43602d2b tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edd787f0-87c7-4f50-80c6-656496bbee1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:18 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e75a2265-ab5e-431a-ba2c-87fd43602d2b tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edd787f0-87c7-4f50-80c6-656496bbee1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:18 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e75a2265-ab5e-431a-ba2c-87fd43602d2b tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4857448d-e794-4658-96b8-b58c702a4f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:18 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e75a2265-ab5e-431a-ba2c-87fd43602d2b tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4857448d-e794-4658-96b8-b58c702a4f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e77f9556-bc18-4c94-a784-5342c253df35', 'volume_name': 'volume-e77f9556-bc18-4c94-a784-5342c253df35', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:18 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e75a2265-ab5e-431a-ba2c-87fd43602d2b tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72b05bd3-6ae5-4740-9b17-ab5e04db7f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:18 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e75a2265-ab5e-431a-ba2c-87fd43602d2b tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72b05bd3-6ae5-4740-9b17-ab5e04db7f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:18 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e75a2265-ab5e-431a-ba2c-87fd43602d2b tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9db204e-db42-483e-a4cd-4e4a1d0e8f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:18 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-e75a2265-ab5e-431a-ba2c-87fd43602d2b tempest-VolumesActionsTest-637900353 None] Volume e77f9556-bc18-4c94-a784-5342c253df35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e77f9556-bc18-4c94-a784-5342c253df35', 'volume_size': 1} Sep 03 14:24:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-e75a2265-ab5e-431a-ba2c-87fd43602d2b tempest-VolumesActionsTest-637900353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:24:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-e75a2265-ab5e-431a-ba2c-87fd43602d2b tempest-VolumesActionsTest-637900353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:24:18 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-e75a2265-ab5e-431a-ba2c-87fd43602d2b tempest-VolumesActionsTest-637900353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-672223316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e77f9556-bc18-4c94-a784-5342c253df35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0bb90fbedf4d30a33ab1ba1ecc6a6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:24:18Z,use_quota=True,user_id='a37e5511bcff4c8a8013a0408401e475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:24:18 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-e75a2265-ab5e-431a-ba2c-87fd43602d2b tempest-VolumesActionsTest-637900353 None] Creating volume e77f9556-bc18-4c94-a784-5342c253df35 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:24:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-e75a2265-ab5e-431a-ba2c-87fd43602d2b tempest-VolumesActionsTest-637900353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:24:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-e75a2265-ab5e-431a-ba2c-87fd43602d2b tempest-VolumesActionsTest-637900353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:24:18 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-e75a2265-ab5e-431a-ba2c-87fd43602d2b tempest-VolumesActionsTest-637900353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:24:18 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-e75a2265-ab5e-431a-ba2c-87fd43602d2b tempest-VolumesActionsTest-637900353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:24:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-e75a2265-ab5e-431a-ba2c-87fd43602d2b tempest-VolumesActionsTest-637900353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:24:18 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-e75a2265-ab5e-431a-ba2c-87fd43602d2b tempest-VolumesActionsTest-637900353 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:24:18 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-e75a2265-ab5e-431a-ba2c-87fd43602d2b tempest-VolumesActionsTest-637900353 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:24:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e75a2265-ab5e-431a-ba2c-87fd43602d2b tempest-VolumesActionsTest-637900353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e77f9556-bc18-4c94-a784-5342c253df35 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:18 devstack sudo[95485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e77f9556-bc18-4c94-a784-5342c253df35 1073741824 Sep 03 14:24:18 devstack sudo[95485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:19 devstack sudo[95485]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e75a2265-ab5e-431a-ba2c-87fd43602d2b tempest-VolumesActionsTest-637900353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e77f9556-bc18-4c94-a784-5342c253df35 1073741824" returned: 0 in 0.559s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e75a2265-ab5e-431a-ba2c-87fd43602d2b tempest-VolumesActionsTest-637900353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e77f9556-bc18-4c94-a784-5342c253df35 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:19 devstack sudo[95493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e77f9556-bc18-4c94-a784-5342c253df35 Sep 03 14:24:19 devstack sudo[95493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:19 devstack sudo[95493]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e75a2265-ab5e-431a-ba2c-87fd43602d2b tempest-VolumesActionsTest-637900353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e77f9556-bc18-4c94-a784-5342c253df35" returned: 0 in 0.407s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:19 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-e75a2265-ab5e-431a-ba2c-87fd43602d2b tempest-VolumesActionsTest-637900353 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:24:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-e75a2265-ab5e-431a-ba2c-87fd43602d2b tempest-VolumesActionsTest-637900353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:24:19 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e75a2265-ab5e-431a-ba2c-87fd43602d2b tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9db204e-db42-483e-a4cd-4e4a1d0e8f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e77f9556-bc18-4c94-a784-5342c253df35', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:19 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e75a2265-ab5e-431a-ba2c-87fd43602d2b tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea97f8a5-7a7a-4673-90e3-535806fe5ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:19 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-e75a2265-ab5e-431a-ba2c-87fd43602d2b tempest-VolumesActionsTest-637900353 None] Volume volume-e77f9556-bc18-4c94-a784-5342c253df35 (e77f9556-bc18-4c94-a784-5342c253df35): created successfully Sep 03 14:24:19 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e75a2265-ab5e-431a-ba2c-87fd43602d2b tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea97f8a5-7a7a-4673-90e3-535806fe5ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:19 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e75a2265-ab5e-431a-ba2c-87fd43602d2b tempest-VolumesActionsTest-637900353 None] Flow 'volume_create_manager' (d453f6bf-44a8-4213-89c2-f829ee063b82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:24:19 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-e75a2265-ab5e-431a-ba2c-87fd43602d2b tempest-VolumesActionsTest-637900353 None] Created volume successfully. Sep 03 14:24:20 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7687f6d9-bac6-4f74-b496-c9ea639c6903 tempest-VolumesActionsTest-2038702324 None] Acquiring lock "cinder-e77f9556-bc18-4c94-a784-5342c253df35-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:24:20 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7687f6d9-bac6-4f74-b496-c9ea639c6903 tempest-VolumesActionsTest-2038702324 None] Lock "cinder-e77f9556-bc18-4c94-a784-5342c253df35-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:24:21 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7687f6d9-bac6-4f74-b496-c9ea639c6903 tempest-VolumesActionsTest-2038702324 None] Acquiring lock "cinder-quobyte-e77f9556-bc18-4c94-a784-5342c253df35" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:24:21 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7687f6d9-bac6-4f74-b496-c9ea639c6903 tempest-VolumesActionsTest-2038702324 None] Lock "cinder-quobyte-e77f9556-bc18-4c94-a784-5342c253df35" acquired by "delete_volume" :: waited 0.022s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:24:21 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d594986-1d7a-4ef2-b5e4-b2c7f907b5aa]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:24:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7687f6d9-bac6-4f74-b496-c9ea639c6903 tempest-VolumesActionsTest-2038702324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e77f9556-bc18-4c94-a784-5342c253df35 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:21 devstack sudo[95522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e77f9556-bc18-4c94-a784-5342c253df35 Sep 03 14:24:21 devstack sudo[95522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:21 devstack sudo[95522]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7687f6d9-bac6-4f74-b496-c9ea639c6903 tempest-VolumesActionsTest-2038702324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e77f9556-bc18-4c94-a784-5342c253df35" returned: 0 in 0.655s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7687f6d9-bac6-4f74-b496-c9ea639c6903 tempest-VolumesActionsTest-2038702324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e77f9556-bc18-4c94-a784-5342c253df35 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:21 devstack sudo[95529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e77f9556-bc18-4c94-a784-5342c253df35 Sep 03 14:24:21 devstack sudo[95529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:22 devstack sudo[95529]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7687f6d9-bac6-4f74-b496-c9ea639c6903 tempest-VolumesActionsTest-2038702324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-e77f9556-bc18-4c94-a784-5342c253df35" returned: 0 in 0.384s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7687f6d9-bac6-4f74-b496-c9ea639c6903 tempest-VolumesActionsTest-2038702324 None] Lock "cinder-quobyte-e77f9556-bc18-4c94-a784-5342c253df35" released by "delete_volume" :: held 1.136s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:24:22 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-7687f6d9-bac6-4f74-b496-c9ea639c6903 tempest-VolumesActionsTest-2038702324 None] Created reservations ['ce29d7dc-bb91-4d15-a123-2e6c8707676e', 'a451b6a6-04ce-4103-bbb4-35969c7a52ec', '2ccf0a76-3396-4c3d-98c4-c803903f7989', '07700deb-1b96-4984-887e-6cd0a8e2424b'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:24:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7687f6d9-bac6-4f74-b496-c9ea639c6903 tempest-VolumesActionsTest-2038702324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:24:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7687f6d9-bac6-4f74-b496-c9ea639c6903 tempest-VolumesActionsTest-2038702324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:24:22 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-7687f6d9-bac6-4f74-b496-c9ea639c6903 tempest-VolumesActionsTest-2038702324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:24:22 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-7687f6d9-bac6-4f74-b496-c9ea639c6903 tempest-VolumesActionsTest-2038702324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:24:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7687f6d9-bac6-4f74-b496-c9ea639c6903 tempest-VolumesActionsTest-2038702324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:24:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7687f6d9-bac6-4f74-b496-c9ea639c6903 tempest-VolumesActionsTest-2038702324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:22 devstack sudo[95549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:24:22 devstack sudo[95549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:22 devstack sudo[95549]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7687f6d9-bac6-4f74-b496-c9ea639c6903 tempest-VolumesActionsTest-2038702324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.287s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:22 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-7687f6d9-bac6-4f74-b496-c9ea639c6903 tempest-VolumesActionsTest-2038702324 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:24:22 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-7687f6d9-bac6-4f74-b496-c9ea639c6903 tempest-VolumesActionsTest-2038702324 None] Deleted volume successfully. Sep 03 14:24:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7687f6d9-bac6-4f74-b496-c9ea639c6903 tempest-VolumesActionsTest-2038702324 None] Lock "cinder-e77f9556-bc18-4c94-a784-5342c253df35-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:24:23 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6328b1f-1bef-4ff4-951e-b157cade7a96 tempest-VolumesActionsTest-637900353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:24:23 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f6328b1f-1bef-4ff4-951e-b157cade7a96 tempest-VolumesActionsTest-637900353 None] Flow 'volume_create_manager' (3729e88e-af19-44b5-9bca-9275de3629c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:24:23 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f6328b1f-1bef-4ff4-951e-b157cade7a96 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70e0bdb1-8c9d-4bc7-99bf-92232bf2a315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:23 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f6328b1f-1bef-4ff4-951e-b157cade7a96 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70e0bdb1-8c9d-4bc7-99bf-92232bf2a315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1377385055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d32cb0a-c41a-460a-b5e6-85b25f408620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0bb90fbedf4d30a33ab1ba1ecc6a6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:24:24Z,use_quota=True,user_id='a37e5511bcff4c8a8013a0408401e475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:23 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f6328b1f-1bef-4ff4-951e-b157cade7a96 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63228d89-f067-4d9e-b70f-84f6b0e8b9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:23 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f6328b1f-1bef-4ff4-951e-b157cade7a96 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63228d89-f067-4d9e-b70f-84f6b0e8b9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:23 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f6328b1f-1bef-4ff4-951e-b157cade7a96 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38848b2c-b47d-411f-b29b-a39ef0b7f852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:23 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f6328b1f-1bef-4ff4-951e-b157cade7a96 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38848b2c-b47d-411f-b29b-a39ef0b7f852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d32cb0a-c41a-460a-b5e6-85b25f408620', 'volume_name': 'volume-0d32cb0a-c41a-460a-b5e6-85b25f408620', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:23 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f6328b1f-1bef-4ff4-951e-b157cade7a96 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc462e70-287e-422e-8e94-15ba1a1cddb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:23 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f6328b1f-1bef-4ff4-951e-b157cade7a96 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc462e70-287e-422e-8e94-15ba1a1cddb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:24 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f6328b1f-1bef-4ff4-951e-b157cade7a96 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55c7b612-6ad7-4c30-b627-cae628ac7de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:24 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-f6328b1f-1bef-4ff4-951e-b157cade7a96 tempest-VolumesActionsTest-637900353 None] Volume 0d32cb0a-c41a-460a-b5e6-85b25f408620: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d32cb0a-c41a-460a-b5e6-85b25f408620', 'volume_size': 1} Sep 03 14:24:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f6328b1f-1bef-4ff4-951e-b157cade7a96 tempest-VolumesActionsTest-637900353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:24:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f6328b1f-1bef-4ff4-951e-b157cade7a96 tempest-VolumesActionsTest-637900353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:24:24 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f6328b1f-1bef-4ff4-951e-b157cade7a96 tempest-VolumesActionsTest-637900353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1377385055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d32cb0a-c41a-460a-b5e6-85b25f408620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0bb90fbedf4d30a33ab1ba1ecc6a6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:24:24Z,use_quota=True,user_id='a37e5511bcff4c8a8013a0408401e475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:24:24 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-f6328b1f-1bef-4ff4-951e-b157cade7a96 tempest-VolumesActionsTest-637900353 None] Creating volume 0d32cb0a-c41a-460a-b5e6-85b25f408620 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:24:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f6328b1f-1bef-4ff4-951e-b157cade7a96 tempest-VolumesActionsTest-637900353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:24:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f6328b1f-1bef-4ff4-951e-b157cade7a96 tempest-VolumesActionsTest-637900353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:24:24 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f6328b1f-1bef-4ff4-951e-b157cade7a96 tempest-VolumesActionsTest-637900353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:24:24 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f6328b1f-1bef-4ff4-951e-b157cade7a96 tempest-VolumesActionsTest-637900353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:24:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f6328b1f-1bef-4ff4-951e-b157cade7a96 tempest-VolumesActionsTest-637900353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:24:24 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f6328b1f-1bef-4ff4-951e-b157cade7a96 tempest-VolumesActionsTest-637900353 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:24:24 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-f6328b1f-1bef-4ff4-951e-b157cade7a96 tempest-VolumesActionsTest-637900353 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:24:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f6328b1f-1bef-4ff4-951e-b157cade7a96 tempest-VolumesActionsTest-637900353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-0d32cb0a-c41a-460a-b5e6-85b25f408620 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:24 devstack sudo[95558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-0d32cb0a-c41a-460a-b5e6-85b25f408620 1073741824 Sep 03 14:24:24 devstack sudo[95558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:24 devstack sudo[95558]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f6328b1f-1bef-4ff4-951e-b157cade7a96 tempest-VolumesActionsTest-637900353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-0d32cb0a-c41a-460a-b5e6-85b25f408620 1073741824" returned: 0 in 0.512s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f6328b1f-1bef-4ff4-951e-b157cade7a96 tempest-VolumesActionsTest-637900353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-0d32cb0a-c41a-460a-b5e6-85b25f408620 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:24 devstack sudo[95566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-0d32cb0a-c41a-460a-b5e6-85b25f408620 Sep 03 14:24:24 devstack sudo[95566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:24 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-a9bfea84-9a9f-4081-837b-1beabd3b668c req-3767f3b3-0e62-4fef-b1be-00847154145b tempest-AttachVolumeNegativeTest-1835626697 None] Terminate volume connection completed successfully. Sep 03 14:24:24 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-a9bfea84-9a9f-4081-837b-1beabd3b668c req-3767f3b3-0e62-4fef-b1be-00847154145b tempest-AttachVolumeNegativeTest-1835626697 None] Deleting attachment 3f7a674f-d501-4cbb-89fc-8198cd004f80. {{(pid=87007) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 14:24:24 devstack sudo[95566]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f6328b1f-1bef-4ff4-951e-b157cade7a96 tempest-VolumesActionsTest-637900353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-0d32cb0a-c41a-460a-b5e6-85b25f408620" returned: 0 in 0.294s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:24 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f6328b1f-1bef-4ff4-951e-b157cade7a96 tempest-VolumesActionsTest-637900353 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:24:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f6328b1f-1bef-4ff4-951e-b157cade7a96 tempest-VolumesActionsTest-637900353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:24:24 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f6328b1f-1bef-4ff4-951e-b157cade7a96 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55c7b612-6ad7-4c30-b627-cae628ac7de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d32cb0a-c41a-460a-b5e6-85b25f408620', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:24 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f6328b1f-1bef-4ff4-951e-b157cade7a96 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b67c2132-6848-45fc-8563-3cd7f06a8ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:24 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-f6328b1f-1bef-4ff4-951e-b157cade7a96 tempest-VolumesActionsTest-637900353 None] Volume volume-0d32cb0a-c41a-460a-b5e6-85b25f408620 (0d32cb0a-c41a-460a-b5e6-85b25f408620): created successfully Sep 03 14:24:24 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f6328b1f-1bef-4ff4-951e-b157cade7a96 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b67c2132-6848-45fc-8563-3cd7f06a8ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:24 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f6328b1f-1bef-4ff4-951e-b157cade7a96 tempest-VolumesActionsTest-637900353 None] Flow 'volume_create_manager' (3729e88e-af19-44b5-9bca-9275de3629c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:24:24 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-f6328b1f-1bef-4ff4-951e-b157cade7a96 tempest-VolumesActionsTest-637900353 None] Created volume successfully. Sep 03 14:24:26 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2c0b8d52-662c-45e7-8587-0a483a3520b8 tempest-VolumesActionsTest-2038702324 None] Acquiring lock "cinder-0d32cb0a-c41a-460a-b5e6-85b25f408620-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:24:26 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2c0b8d52-662c-45e7-8587-0a483a3520b8 tempest-VolumesActionsTest-2038702324 None] Lock "cinder-0d32cb0a-c41a-460a-b5e6-85b25f408620-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:24:26 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2c0b8d52-662c-45e7-8587-0a483a3520b8 tempest-VolumesActionsTest-2038702324 None] Acquiring lock "cinder-quobyte-0d32cb0a-c41a-460a-b5e6-85b25f408620" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:24:26 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2c0b8d52-662c-45e7-8587-0a483a3520b8 tempest-VolumesActionsTest-2038702324 None] Lock "cinder-quobyte-0d32cb0a-c41a-460a-b5e6-85b25f408620" acquired by "delete_volume" :: waited 0.034s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:24:26 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de5e693-fe08-407d-895f-4fac8e2611d8]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:24:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2c0b8d52-662c-45e7-8587-0a483a3520b8 tempest-VolumesActionsTest-2038702324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-0d32cb0a-c41a-460a-b5e6-85b25f408620 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:26 devstack sudo[95593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-0d32cb0a-c41a-460a-b5e6-85b25f408620 Sep 03 14:24:26 devstack sudo[95593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:26 devstack sudo[95593]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2c0b8d52-662c-45e7-8587-0a483a3520b8 tempest-VolumesActionsTest-2038702324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-0d32cb0a-c41a-460a-b5e6-85b25f408620" returned: 0 in 0.464s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2c0b8d52-662c-45e7-8587-0a483a3520b8 tempest-VolumesActionsTest-2038702324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-0d32cb0a-c41a-460a-b5e6-85b25f408620 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:26 devstack sudo[95600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-0d32cb0a-c41a-460a-b5e6-85b25f408620 Sep 03 14:24:26 devstack sudo[95600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:27 devstack sudo[95600]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2c0b8d52-662c-45e7-8587-0a483a3520b8 tempest-VolumesActionsTest-2038702324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-0d32cb0a-c41a-460a-b5e6-85b25f408620" returned: 0 in 0.293s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:27 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2c0b8d52-662c-45e7-8587-0a483a3520b8 tempest-VolumesActionsTest-2038702324 None] Lock "cinder-quobyte-0d32cb0a-c41a-460a-b5e6-85b25f408620" released by "delete_volume" :: held 0.834s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:24:27 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-2c0b8d52-662c-45e7-8587-0a483a3520b8 tempest-VolumesActionsTest-2038702324 None] Created reservations ['261ef6b0-fc31-4055-b837-ef1af6caea13', '4fcc8d0c-8162-4471-9d7f-5e3a5f88d517', '41a7d0f0-1e19-4270-9fbd-a826da1d1320', '2e49b929-1965-4a37-ad59-427d57d6625c'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:24:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2c0b8d52-662c-45e7-8587-0a483a3520b8 tempest-VolumesActionsTest-2038702324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:24:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2c0b8d52-662c-45e7-8587-0a483a3520b8 tempest-VolumesActionsTest-2038702324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:24:27 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2c0b8d52-662c-45e7-8587-0a483a3520b8 tempest-VolumesActionsTest-2038702324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:24:27 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2c0b8d52-662c-45e7-8587-0a483a3520b8 tempest-VolumesActionsTest-2038702324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:24:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2c0b8d52-662c-45e7-8587-0a483a3520b8 tempest-VolumesActionsTest-2038702324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:24:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2c0b8d52-662c-45e7-8587-0a483a3520b8 tempest-VolumesActionsTest-2038702324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:27 devstack sudo[95605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:24:27 devstack sudo[95605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:27 devstack sudo[95605]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2c0b8d52-662c-45e7-8587-0a483a3520b8 tempest-VolumesActionsTest-2038702324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.268s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:27 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-2c0b8d52-662c-45e7-8587-0a483a3520b8 tempest-VolumesActionsTest-2038702324 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:24:27 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-2c0b8d52-662c-45e7-8587-0a483a3520b8 tempest-VolumesActionsTest-2038702324 None] Deleted volume successfully. Sep 03 14:24:27 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2c0b8d52-662c-45e7-8587-0a483a3520b8 tempest-VolumesActionsTest-2038702324 None] Lock "cinder-0d32cb0a-c41a-460a-b5e6-85b25f408620-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:24:28 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-757770a7-1c57-484b-9354-e062d60207a0 tempest-VolumesActionsTest-637900353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:24:28 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-757770a7-1c57-484b-9354-e062d60207a0 tempest-VolumesActionsTest-637900353 None] Flow 'volume_create_manager' (5b66ce88-a380-483a-be8a-b8cbebe63060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:24:28 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-757770a7-1c57-484b-9354-e062d60207a0 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eda6d0eb-7ad7-430d-8824-235e1eac1983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:28 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-757770a7-1c57-484b-9354-e062d60207a0 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eda6d0eb-7ad7-430d-8824-235e1eac1983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1707469336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a19d7e1a-7bb9-4af1-8643-35e3e5e22a61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0bb90fbedf4d30a33ab1ba1ecc6a6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:24:28Z,use_quota=True,user_id='a37e5511bcff4c8a8013a0408401e475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:28 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-757770a7-1c57-484b-9354-e062d60207a0 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (662699d1-e448-4bc1-aca2-88803fdf260a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:28 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-757770a7-1c57-484b-9354-e062d60207a0 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (662699d1-e448-4bc1-aca2-88803fdf260a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:28 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-757770a7-1c57-484b-9354-e062d60207a0 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (295c6eda-1ede-4118-9169-c29d7610c56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:28 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-757770a7-1c57-484b-9354-e062d60207a0 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (295c6eda-1ede-4118-9169-c29d7610c56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a19d7e1a-7bb9-4af1-8643-35e3e5e22a61', 'volume_name': 'volume-a19d7e1a-7bb9-4af1-8643-35e3e5e22a61', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:28 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-757770a7-1c57-484b-9354-e062d60207a0 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4641d966-5aa5-46f3-92f3-cc44849f15b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:28 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-757770a7-1c57-484b-9354-e062d60207a0 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4641d966-5aa5-46f3-92f3-cc44849f15b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:28 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-757770a7-1c57-484b-9354-e062d60207a0 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18510c84-06a0-4e4b-a2ac-7e45170af50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:28 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-757770a7-1c57-484b-9354-e062d60207a0 tempest-VolumesActionsTest-637900353 None] Volume a19d7e1a-7bb9-4af1-8643-35e3e5e22a61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a19d7e1a-7bb9-4af1-8643-35e3e5e22a61', 'volume_size': 1} Sep 03 14:24:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-757770a7-1c57-484b-9354-e062d60207a0 tempest-VolumesActionsTest-637900353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:24:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-757770a7-1c57-484b-9354-e062d60207a0 tempest-VolumesActionsTest-637900353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:24:28 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-757770a7-1c57-484b-9354-e062d60207a0 tempest-VolumesActionsTest-637900353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1707469336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a19d7e1a-7bb9-4af1-8643-35e3e5e22a61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0bb90fbedf4d30a33ab1ba1ecc6a6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:24:28Z,use_quota=True,user_id='a37e5511bcff4c8a8013a0408401e475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:24:28 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-757770a7-1c57-484b-9354-e062d60207a0 tempest-VolumesActionsTest-637900353 None] Creating volume a19d7e1a-7bb9-4af1-8643-35e3e5e22a61 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:24:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-757770a7-1c57-484b-9354-e062d60207a0 tempest-VolumesActionsTest-637900353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:24:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-757770a7-1c57-484b-9354-e062d60207a0 tempest-VolumesActionsTest-637900353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:24:28 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-757770a7-1c57-484b-9354-e062d60207a0 tempest-VolumesActionsTest-637900353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:24:28 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-757770a7-1c57-484b-9354-e062d60207a0 tempest-VolumesActionsTest-637900353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:24:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-757770a7-1c57-484b-9354-e062d60207a0 tempest-VolumesActionsTest-637900353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:24:28 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-757770a7-1c57-484b-9354-e062d60207a0 tempest-VolumesActionsTest-637900353 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:24:28 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-757770a7-1c57-484b-9354-e062d60207a0 tempest-VolumesActionsTest-637900353 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:24:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-757770a7-1c57-484b-9354-e062d60207a0 tempest-VolumesActionsTest-637900353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a19d7e1a-7bb9-4af1-8643-35e3e5e22a61 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:28 devstack sudo[95608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a19d7e1a-7bb9-4af1-8643-35e3e5e22a61 1073741824 Sep 03 14:24:28 devstack sudo[95608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:28 devstack sudo[95608]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-757770a7-1c57-484b-9354-e062d60207a0 tempest-VolumesActionsTest-637900353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a19d7e1a-7bb9-4af1-8643-35e3e5e22a61 1073741824" returned: 0 in 0.570s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-757770a7-1c57-484b-9354-e062d60207a0 tempest-VolumesActionsTest-637900353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a19d7e1a-7bb9-4af1-8643-35e3e5e22a61 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:28 devstack sudo[95614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a19d7e1a-7bb9-4af1-8643-35e3e5e22a61 Sep 03 14:24:28 devstack sudo[95614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:29 devstack sudo[95614]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-757770a7-1c57-484b-9354-e062d60207a0 tempest-VolumesActionsTest-637900353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a19d7e1a-7bb9-4af1-8643-35e3e5e22a61" returned: 0 in 0.324s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:29 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-757770a7-1c57-484b-9354-e062d60207a0 tempest-VolumesActionsTest-637900353 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:24:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-757770a7-1c57-484b-9354-e062d60207a0 tempest-VolumesActionsTest-637900353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:24:29 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-757770a7-1c57-484b-9354-e062d60207a0 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18510c84-06a0-4e4b-a2ac-7e45170af50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a19d7e1a-7bb9-4af1-8643-35e3e5e22a61', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:29 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-757770a7-1c57-484b-9354-e062d60207a0 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c316d8c0-4ce1-4727-b8c8-78731eb0c8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:29 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-757770a7-1c57-484b-9354-e062d60207a0 tempest-VolumesActionsTest-637900353 None] Volume volume-a19d7e1a-7bb9-4af1-8643-35e3e5e22a61 (a19d7e1a-7bb9-4af1-8643-35e3e5e22a61): created successfully Sep 03 14:24:29 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-757770a7-1c57-484b-9354-e062d60207a0 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c316d8c0-4ce1-4727-b8c8-78731eb0c8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:29 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-757770a7-1c57-484b-9354-e062d60207a0 tempest-VolumesActionsTest-637900353 None] Flow 'volume_create_manager' (5b66ce88-a380-483a-be8a-b8cbebe63060) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:24:29 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-757770a7-1c57-484b-9354-e062d60207a0 tempest-VolumesActionsTest-637900353 None] Created volume successfully. Sep 03 14:24:30 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7bb1a8c2-4db3-464e-b5dd-4ed95bd6c58b tempest-VolumesActionsTest-2038702324 None] Acquiring lock "cinder-a19d7e1a-7bb9-4af1-8643-35e3e5e22a61-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:24:30 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7bb1a8c2-4db3-464e-b5dd-4ed95bd6c58b tempest-VolumesActionsTest-2038702324 None] Lock "cinder-a19d7e1a-7bb9-4af1-8643-35e3e5e22a61-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:24:30 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7bb1a8c2-4db3-464e-b5dd-4ed95bd6c58b tempest-VolumesActionsTest-2038702324 None] Acquiring lock "cinder-quobyte-a19d7e1a-7bb9-4af1-8643-35e3e5e22a61" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:24:30 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7bb1a8c2-4db3-464e-b5dd-4ed95bd6c58b tempest-VolumesActionsTest-2038702324 None] Lock "cinder-quobyte-a19d7e1a-7bb9-4af1-8643-35e3e5e22a61" acquired by "delete_volume" :: waited 0.023s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:24:30 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ec8223-fd06-401c-ab7b-e4483f4e5a75]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:24:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7bb1a8c2-4db3-464e-b5dd-4ed95bd6c58b tempest-VolumesActionsTest-2038702324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a19d7e1a-7bb9-4af1-8643-35e3e5e22a61 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:30 devstack sudo[95617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a19d7e1a-7bb9-4af1-8643-35e3e5e22a61 Sep 03 14:24:30 devstack sudo[95617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:31 devstack sudo[95617]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7bb1a8c2-4db3-464e-b5dd-4ed95bd6c58b tempest-VolumesActionsTest-2038702324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a19d7e1a-7bb9-4af1-8643-35e3e5e22a61" returned: 0 in 0.583s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7bb1a8c2-4db3-464e-b5dd-4ed95bd6c58b tempest-VolumesActionsTest-2038702324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a19d7e1a-7bb9-4af1-8643-35e3e5e22a61 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:31 devstack sudo[95624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a19d7e1a-7bb9-4af1-8643-35e3e5e22a61 Sep 03 14:24:31 devstack sudo[95624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:31 devstack sudo[95624]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7bb1a8c2-4db3-464e-b5dd-4ed95bd6c58b tempest-VolumesActionsTest-2038702324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a19d7e1a-7bb9-4af1-8643-35e3e5e22a61" returned: 0 in 0.362s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:31 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7bb1a8c2-4db3-464e-b5dd-4ed95bd6c58b tempest-VolumesActionsTest-2038702324 None] Lock "cinder-quobyte-a19d7e1a-7bb9-4af1-8643-35e3e5e22a61" released by "delete_volume" :: held 1.001s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:24:31 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-7bb1a8c2-4db3-464e-b5dd-4ed95bd6c58b tempest-VolumesActionsTest-2038702324 None] Created reservations ['1e4e981d-d7a5-4db5-8fc4-8b0ce15cbe33', '3ab32cbc-e6f7-4aab-94b3-f5e0e2d8f867', '444fa3cb-5d30-4493-b4ca-4c3508de6e1e', 'b84afc23-89e0-42e5-b817-8b399cf9ae2f'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:24:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7bb1a8c2-4db3-464e-b5dd-4ed95bd6c58b tempest-VolumesActionsTest-2038702324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:24:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7bb1a8c2-4db3-464e-b5dd-4ed95bd6c58b tempest-VolumesActionsTest-2038702324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:24:31 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-7bb1a8c2-4db3-464e-b5dd-4ed95bd6c58b tempest-VolumesActionsTest-2038702324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:24:31 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-7bb1a8c2-4db3-464e-b5dd-4ed95bd6c58b tempest-VolumesActionsTest-2038702324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:24:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7bb1a8c2-4db3-464e-b5dd-4ed95bd6c58b tempest-VolumesActionsTest-2038702324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:24:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7bb1a8c2-4db3-464e-b5dd-4ed95bd6c58b tempest-VolumesActionsTest-2038702324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:31 devstack sudo[95627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:24:31 devstack sudo[95627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:31 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4979b14-ef8d-4b62-adff-e4031e1457a6 tempest-AttachVolumeTestJSON-1766853988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:24:31 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a4979b14-ef8d-4b62-adff-e4031e1457a6 tempest-AttachVolumeTestJSON-1766853988 None] Flow 'volume_create_manager' (1fce75d1-4ac4-4ba2-8fd4-8e9c809ba2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:24:31 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a4979b14-ef8d-4b62-adff-e4031e1457a6 tempest-AttachVolumeTestJSON-1766853988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1d15bae-6434-48b7-a7ad-9103841ec8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:31 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a4979b14-ef8d-4b62-adff-e4031e1457a6 tempest-AttachVolumeTestJSON-1766853988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1d15bae-6434-48b7-a7ad-9103841ec8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2039316328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7653c7f-3d06-4c63-b6d3-a243bec80b0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9786a2cfe4a246d5bc23e4df6064f5bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:24:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:24:32Z,use_quota=True,user_id='f844973d9a8046efb2a11b4b7ee420b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:31 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a4979b14-ef8d-4b62-adff-e4031e1457a6 tempest-AttachVolumeTestJSON-1766853988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (686fbf64-c0a7-4520-b9f3-8a485bd495c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:31 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a4979b14-ef8d-4b62-adff-e4031e1457a6 tempest-AttachVolumeTestJSON-1766853988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (686fbf64-c0a7-4520-b9f3-8a485bd495c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:32 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a4979b14-ef8d-4b62-adff-e4031e1457a6 tempest-AttachVolumeTestJSON-1766853988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ee17fd1-fefa-4aea-ad33-052eca491384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:32 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a4979b14-ef8d-4b62-adff-e4031e1457a6 tempest-AttachVolumeTestJSON-1766853988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ee17fd1-fefa-4aea-ad33-052eca491384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7653c7f-3d06-4c63-b6d3-a243bec80b0e', 'volume_name': 'volume-c7653c7f-3d06-4c63-b6d3-a243bec80b0e', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:32 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a4979b14-ef8d-4b62-adff-e4031e1457a6 tempest-AttachVolumeTestJSON-1766853988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7432b22c-2918-4117-aade-a1f80a8ba8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:32 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a4979b14-ef8d-4b62-adff-e4031e1457a6 tempest-AttachVolumeTestJSON-1766853988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7432b22c-2918-4117-aade-a1f80a8ba8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:32 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a4979b14-ef8d-4b62-adff-e4031e1457a6 tempest-AttachVolumeTestJSON-1766853988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bebebf55-581b-4363-ad1e-6dcd33489b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:32 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-a4979b14-ef8d-4b62-adff-e4031e1457a6 tempest-AttachVolumeTestJSON-1766853988 None] Volume c7653c7f-3d06-4c63-b6d3-a243bec80b0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7653c7f-3d06-4c63-b6d3-a243bec80b0e', 'volume_size': 1} Sep 03 14:24:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a4979b14-ef8d-4b62-adff-e4031e1457a6 tempest-AttachVolumeTestJSON-1766853988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:24:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a4979b14-ef8d-4b62-adff-e4031e1457a6 tempest-AttachVolumeTestJSON-1766853988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:24:32 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a4979b14-ef8d-4b62-adff-e4031e1457a6 tempest-AttachVolumeTestJSON-1766853988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2039316328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7653c7f-3d06-4c63-b6d3-a243bec80b0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9786a2cfe4a246d5bc23e4df6064f5bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:24:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:24:32Z,use_quota=True,user_id='f844973d9a8046efb2a11b4b7ee420b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:24:32 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-a4979b14-ef8d-4b62-adff-e4031e1457a6 tempest-AttachVolumeTestJSON-1766853988 None] Creating volume c7653c7f-3d06-4c63-b6d3-a243bec80b0e {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:24:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a4979b14-ef8d-4b62-adff-e4031e1457a6 tempest-AttachVolumeTestJSON-1766853988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:24:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a4979b14-ef8d-4b62-adff-e4031e1457a6 tempest-AttachVolumeTestJSON-1766853988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:24:32 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a4979b14-ef8d-4b62-adff-e4031e1457a6 tempest-AttachVolumeTestJSON-1766853988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:24:32 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a4979b14-ef8d-4b62-adff-e4031e1457a6 tempest-AttachVolumeTestJSON-1766853988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:24:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a4979b14-ef8d-4b62-adff-e4031e1457a6 tempest-AttachVolumeTestJSON-1766853988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:24:32 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a4979b14-ef8d-4b62-adff-e4031e1457a6 tempest-AttachVolumeTestJSON-1766853988 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:24:32 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-a4979b14-ef8d-4b62-adff-e4031e1457a6 tempest-AttachVolumeTestJSON-1766853988 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:24:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a4979b14-ef8d-4b62-adff-e4031e1457a6 tempest-AttachVolumeTestJSON-1766853988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c7653c7f-3d06-4c63-b6d3-a243bec80b0e 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:32 devstack sudo[95629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c7653c7f-3d06-4c63-b6d3-a243bec80b0e 1073741824 Sep 03 14:24:32 devstack sudo[95629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:32 devstack sudo[95627]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7bb1a8c2-4db3-464e-b5dd-4ed95bd6c58b tempest-VolumesActionsTest-2038702324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.300s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:32 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-7bb1a8c2-4db3-464e-b5dd-4ed95bd6c58b tempest-VolumesActionsTest-2038702324 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:24:32 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-7bb1a8c2-4db3-464e-b5dd-4ed95bd6c58b tempest-VolumesActionsTest-2038702324 None] Deleted volume successfully. Sep 03 14:24:32 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7bb1a8c2-4db3-464e-b5dd-4ed95bd6c58b tempest-VolumesActionsTest-2038702324 None] Lock "cinder-a19d7e1a-7bb9-4af1-8643-35e3e5e22a61-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:24:32 devstack sudo[95629]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a4979b14-ef8d-4b62-adff-e4031e1457a6 tempest-AttachVolumeTestJSON-1766853988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c7653c7f-3d06-4c63-b6d3-a243bec80b0e 1073741824" returned: 0 in 0.490s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a4979b14-ef8d-4b62-adff-e4031e1457a6 tempest-AttachVolumeTestJSON-1766853988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c7653c7f-3d06-4c63-b6d3-a243bec80b0e {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:32 devstack sudo[95636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c7653c7f-3d06-4c63-b6d3-a243bec80b0e Sep 03 14:24:32 devstack sudo[95636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:32 devstack sudo[95636]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a4979b14-ef8d-4b62-adff-e4031e1457a6 tempest-AttachVolumeTestJSON-1766853988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c7653c7f-3d06-4c63-b6d3-a243bec80b0e" returned: 0 in 0.348s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:32 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a4979b14-ef8d-4b62-adff-e4031e1457a6 tempest-AttachVolumeTestJSON-1766853988 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:24:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a4979b14-ef8d-4b62-adff-e4031e1457a6 tempest-AttachVolumeTestJSON-1766853988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:24:32 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a4979b14-ef8d-4b62-adff-e4031e1457a6 tempest-AttachVolumeTestJSON-1766853988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bebebf55-581b-4363-ad1e-6dcd33489b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7653c7f-3d06-4c63-b6d3-a243bec80b0e', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:32 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a4979b14-ef8d-4b62-adff-e4031e1457a6 tempest-AttachVolumeTestJSON-1766853988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cd4fe50-619e-411b-bb72-8025686a3051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:32 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-a4979b14-ef8d-4b62-adff-e4031e1457a6 tempest-AttachVolumeTestJSON-1766853988 None] Volume volume-c7653c7f-3d06-4c63-b6d3-a243bec80b0e (c7653c7f-3d06-4c63-b6d3-a243bec80b0e): created successfully Sep 03 14:24:32 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a4979b14-ef8d-4b62-adff-e4031e1457a6 tempest-AttachVolumeTestJSON-1766853988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cd4fe50-619e-411b-bb72-8025686a3051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:32 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a4979b14-ef8d-4b62-adff-e4031e1457a6 tempest-AttachVolumeTestJSON-1766853988 None] Flow 'volume_create_manager' (1fce75d1-4ac4-4ba2-8fd4-8e9c809ba2c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:24:32 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-a4979b14-ef8d-4b62-adff-e4031e1457a6 tempest-AttachVolumeTestJSON-1766853988 None] Created volume successfully. Sep 03 14:24:33 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-04f0f099-9592-4e65-9928-1db1c7c6350e tempest-VolumesActionsTest-637900353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:24:33 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-04f0f099-9592-4e65-9928-1db1c7c6350e tempest-VolumesActionsTest-637900353 None] Flow 'volume_create_manager' (86fc4706-40ab-4735-90ef-91e1973ac22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:24:33 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-04f0f099-9592-4e65-9928-1db1c7c6350e tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eca7181-cc50-41c1-9514-f150dfed971a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:33 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-04f0f099-9592-4e65-9928-1db1c7c6350e tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eca7181-cc50-41c1-9514-f150dfed971a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2005819468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc71a69f-45d8-44c9-aa38-af704019af03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0bb90fbedf4d30a33ab1ba1ecc6a6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:24:33Z,use_quota=True,user_id='a37e5511bcff4c8a8013a0408401e475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:33 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-04f0f099-9592-4e65-9928-1db1c7c6350e tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f86ae38-903b-4adb-b1df-11022822f7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:33 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-04f0f099-9592-4e65-9928-1db1c7c6350e tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f86ae38-903b-4adb-b1df-11022822f7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:33 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-04f0f099-9592-4e65-9928-1db1c7c6350e tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0ae578e-3559-4b4f-a7af-03ec0c0e5700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:33 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-04f0f099-9592-4e65-9928-1db1c7c6350e tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0ae578e-3559-4b4f-a7af-03ec0c0e5700) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc71a69f-45d8-44c9-aa38-af704019af03', 'volume_name': 'volume-dc71a69f-45d8-44c9-aa38-af704019af03', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:33 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-04f0f099-9592-4e65-9928-1db1c7c6350e tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6ecb774-2089-49b8-93a1-e7dfb5213ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:33 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-04f0f099-9592-4e65-9928-1db1c7c6350e tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6ecb774-2089-49b8-93a1-e7dfb5213ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:33 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-04f0f099-9592-4e65-9928-1db1c7c6350e tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4095421-0757-4426-aeaf-b879120a3725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:33 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-04f0f099-9592-4e65-9928-1db1c7c6350e tempest-VolumesActionsTest-637900353 None] Volume dc71a69f-45d8-44c9-aa38-af704019af03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc71a69f-45d8-44c9-aa38-af704019af03', 'volume_size': 1} Sep 03 14:24:33 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-04f0f099-9592-4e65-9928-1db1c7c6350e tempest-VolumesActionsTest-637900353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:24:33 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-04f0f099-9592-4e65-9928-1db1c7c6350e tempest-VolumesActionsTest-637900353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:24:33 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-04f0f099-9592-4e65-9928-1db1c7c6350e tempest-VolumesActionsTest-637900353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2005819468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc71a69f-45d8-44c9-aa38-af704019af03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0bb90fbedf4d30a33ab1ba1ecc6a6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:24:33Z,use_quota=True,user_id='a37e5511bcff4c8a8013a0408401e475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:24:33 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-04f0f099-9592-4e65-9928-1db1c7c6350e tempest-VolumesActionsTest-637900353 None] Creating volume dc71a69f-45d8-44c9-aa38-af704019af03 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:24:33 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-04f0f099-9592-4e65-9928-1db1c7c6350e tempest-VolumesActionsTest-637900353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:24:33 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-04f0f099-9592-4e65-9928-1db1c7c6350e tempest-VolumesActionsTest-637900353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:24:33 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-04f0f099-9592-4e65-9928-1db1c7c6350e tempest-VolumesActionsTest-637900353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:24:33 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-04f0f099-9592-4e65-9928-1db1c7c6350e tempest-VolumesActionsTest-637900353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:24:33 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-04f0f099-9592-4e65-9928-1db1c7c6350e tempest-VolumesActionsTest-637900353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:24:33 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-04f0f099-9592-4e65-9928-1db1c7c6350e tempest-VolumesActionsTest-637900353 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:24:33 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-04f0f099-9592-4e65-9928-1db1c7c6350e tempest-VolumesActionsTest-637900353 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:24:33 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-04f0f099-9592-4e65-9928-1db1c7c6350e tempest-VolumesActionsTest-637900353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dc71a69f-45d8-44c9-aa38-af704019af03 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:33 devstack sudo[95642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dc71a69f-45d8-44c9-aa38-af704019af03 1073741824 Sep 03 14:24:33 devstack sudo[95642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:34 devstack sudo[95642]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-04f0f099-9592-4e65-9928-1db1c7c6350e tempest-VolumesActionsTest-637900353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dc71a69f-45d8-44c9-aa38-af704019af03 1073741824" returned: 0 in 0.595s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-04f0f099-9592-4e65-9928-1db1c7c6350e tempest-VolumesActionsTest-637900353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dc71a69f-45d8-44c9-aa38-af704019af03 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:34 devstack sudo[95653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dc71a69f-45d8-44c9-aa38-af704019af03 Sep 03 14:24:34 devstack sudo[95653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:34 devstack sudo[95653]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-04f0f099-9592-4e65-9928-1db1c7c6350e tempest-VolumesActionsTest-637900353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dc71a69f-45d8-44c9-aa38-af704019af03" returned: 0 in 0.336s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:34 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-04f0f099-9592-4e65-9928-1db1c7c6350e tempest-VolumesActionsTest-637900353 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:24:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-04f0f099-9592-4e65-9928-1db1c7c6350e tempest-VolumesActionsTest-637900353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:24:34 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-04f0f099-9592-4e65-9928-1db1c7c6350e tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4095421-0757-4426-aeaf-b879120a3725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc71a69f-45d8-44c9-aa38-af704019af03', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:34 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-04f0f099-9592-4e65-9928-1db1c7c6350e tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83e22e54-bd6b-4f9c-a9df-b900b2140d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:34 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-04f0f099-9592-4e65-9928-1db1c7c6350e tempest-VolumesActionsTest-637900353 None] Volume volume-dc71a69f-45d8-44c9-aa38-af704019af03 (dc71a69f-45d8-44c9-aa38-af704019af03): created successfully Sep 03 14:24:34 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-04f0f099-9592-4e65-9928-1db1c7c6350e tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83e22e54-bd6b-4f9c-a9df-b900b2140d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:34 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-04f0f099-9592-4e65-9928-1db1c7c6350e tempest-VolumesActionsTest-637900353 None] Flow 'volume_create_manager' (86fc4706-40ab-4735-90ef-91e1973ac22a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:24:34 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-04f0f099-9592-4e65-9928-1db1c7c6350e tempest-VolumesActionsTest-637900353 None] Created volume successfully. Sep 03 14:24:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-8b6e948c-211d-486f-b847-d919c4f1f933 req-12588d3b-6a0e-4b3d-b9f5-5e39b57ed928 tempest-AttachVolumeTestJSON-1766853988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:24:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-8b6e948c-211d-486f-b847-d919c4f1f933 req-12588d3b-6a0e-4b3d-b9f5-5e39b57ed928 tempest-AttachVolumeTestJSON-1766853988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:24:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-8b6e948c-211d-486f-b847-d919c4f1f933 req-12588d3b-6a0e-4b3d-b9f5-5e39b57ed928 tempest-AttachVolumeTestJSON-1766853988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:24:35 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-8b6e948c-211d-486f-b847-d919c4f1f933 req-12588d3b-6a0e-4b3d-b9f5-5e39b57ed928 tempest-AttachVolumeTestJSON-1766853988 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713', 'name': 'volume-c7653c7f-3d06-4c63-b6d3-a243bec80b0e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c9b37f21-424b-4fbd-8293-aabec7af06c4', 'enforce_multipath': True} {{(pid=87007) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 14:24:35 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-8b6e948c-211d-486f-b847-d919c4f1f933 req-12588d3b-6a0e-4b3d-b9f5-5e39b57ed928 tempest-AttachVolumeTestJSON-1766853988 None] attachment_update completed successfully. Sep 03 14:24:35 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d47bcad9-e5cf-4dc9-8516-0595dbd2cb91 tempest-VolumesActionsTest-2038702324 None] Acquiring lock "cinder-dc71a69f-45d8-44c9-aa38-af704019af03-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:24:35 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d47bcad9-e5cf-4dc9-8516-0595dbd2cb91 tempest-VolumesActionsTest-2038702324 None] Lock "cinder-dc71a69f-45d8-44c9-aa38-af704019af03-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:24:36 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d47bcad9-e5cf-4dc9-8516-0595dbd2cb91 tempest-VolumesActionsTest-2038702324 None] Acquiring lock "cinder-quobyte-dc71a69f-45d8-44c9-aa38-af704019af03" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:24:36 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d47bcad9-e5cf-4dc9-8516-0595dbd2cb91 tempest-VolumesActionsTest-2038702324 None] Lock "cinder-quobyte-dc71a69f-45d8-44c9-aa38-af704019af03" acquired by "delete_volume" :: waited 0.029s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:24:36 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b7cfb5-eae4-44f4-b27b-da625dd27563]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:24:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d47bcad9-e5cf-4dc9-8516-0595dbd2cb91 tempest-VolumesActionsTest-2038702324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dc71a69f-45d8-44c9-aa38-af704019af03 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:36 devstack sudo[95879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dc71a69f-45d8-44c9-aa38-af704019af03 Sep 03 14:24:36 devstack sudo[95879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:36 devstack sudo[95879]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d47bcad9-e5cf-4dc9-8516-0595dbd2cb91 tempest-VolumesActionsTest-2038702324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dc71a69f-45d8-44c9-aa38-af704019af03" returned: 0 in 0.535s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d47bcad9-e5cf-4dc9-8516-0595dbd2cb91 tempest-VolumesActionsTest-2038702324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dc71a69f-45d8-44c9-aa38-af704019af03 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:36 devstack sudo[96073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dc71a69f-45d8-44c9-aa38-af704019af03 Sep 03 14:24:36 devstack sudo[96073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:37 devstack sudo[96073]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d47bcad9-e5cf-4dc9-8516-0595dbd2cb91 tempest-VolumesActionsTest-2038702324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dc71a69f-45d8-44c9-aa38-af704019af03" returned: 0 in 0.395s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:37 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d47bcad9-e5cf-4dc9-8516-0595dbd2cb91 tempest-VolumesActionsTest-2038702324 None] Lock "cinder-quobyte-dc71a69f-45d8-44c9-aa38-af704019af03" released by "delete_volume" :: held 1.017s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:24:37 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-d47bcad9-e5cf-4dc9-8516-0595dbd2cb91 tempest-VolumesActionsTest-2038702324 None] Created reservations ['63989f8e-5ec8-44b9-8ff9-1c5f455e1d2e', '9c7ac565-c46b-4bfe-aa72-ae9ed290897f', '62cd64d1-909b-4e48-8476-14f981d68992', 'db497107-33bd-4cc2-b917-f945c77955ab'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:24:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d47bcad9-e5cf-4dc9-8516-0595dbd2cb91 tempest-VolumesActionsTest-2038702324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:24:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d47bcad9-e5cf-4dc9-8516-0595dbd2cb91 tempest-VolumesActionsTest-2038702324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:24:37 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d47bcad9-e5cf-4dc9-8516-0595dbd2cb91 tempest-VolumesActionsTest-2038702324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:24:37 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d47bcad9-e5cf-4dc9-8516-0595dbd2cb91 tempest-VolumesActionsTest-2038702324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:24:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d47bcad9-e5cf-4dc9-8516-0595dbd2cb91 tempest-VolumesActionsTest-2038702324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:24:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d47bcad9-e5cf-4dc9-8516-0595dbd2cb91 tempest-VolumesActionsTest-2038702324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:37 devstack sudo[96076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:24:37 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:37 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d47bcad9-e5cf-4dc9-8516-0595dbd2cb91 tempest-VolumesActionsTest-2038702324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.346s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:37 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-d47bcad9-e5cf-4dc9-8516-0595dbd2cb91 tempest-VolumesActionsTest-2038702324 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:24:37 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-d47bcad9-e5cf-4dc9-8516-0595dbd2cb91 tempest-VolumesActionsTest-2038702324 None] Deleted volume successfully. Sep 03 14:24:37 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d47bcad9-e5cf-4dc9-8516-0595dbd2cb91 tempest-VolumesActionsTest-2038702324 None] Lock "cinder-dc71a69f-45d8-44c9-aa38-af704019af03-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:24:38 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1ea88e3-8634-41ff-99ea-a2846bc6b793 tempest-AttachVolumeTestJSON-1766853988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:24:38 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e1ea88e3-8634-41ff-99ea-a2846bc6b793 tempest-AttachVolumeTestJSON-1766853988 None] Flow 'volume_create_manager' (9b129084-5be1-40e4-bd43-3ce29682899f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:24:38 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e1ea88e3-8634-41ff-99ea-a2846bc6b793 tempest-AttachVolumeTestJSON-1766853988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a6f3455-8c22-42c7-bef7-459c968a9fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:38 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e1ea88e3-8634-41ff-99ea-a2846bc6b793 tempest-AttachVolumeTestJSON-1766853988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a6f3455-8c22-42c7-bef7-459c968a9fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2141505318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=514b60ca-9b71-49a5-8a05-7b8bb0e3f294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9786a2cfe4a246d5bc23e4df6064f5bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:24:38Z,use_quota=True,user_id='f844973d9a8046efb2a11b4b7ee420b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:38 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e1ea88e3-8634-41ff-99ea-a2846bc6b793 tempest-AttachVolumeTestJSON-1766853988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66449f55-18bb-45bd-aa52-548bb67b1feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:38 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e1ea88e3-8634-41ff-99ea-a2846bc6b793 tempest-AttachVolumeTestJSON-1766853988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66449f55-18bb-45bd-aa52-548bb67b1feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:38 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e1ea88e3-8634-41ff-99ea-a2846bc6b793 tempest-AttachVolumeTestJSON-1766853988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f03c6a1a-9b3b-4f9f-a502-9ac35cc47a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:38 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e1ea88e3-8634-41ff-99ea-a2846bc6b793 tempest-AttachVolumeTestJSON-1766853988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f03c6a1a-9b3b-4f9f-a502-9ac35cc47a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '514b60ca-9b71-49a5-8a05-7b8bb0e3f294', 'volume_name': 'volume-514b60ca-9b71-49a5-8a05-7b8bb0e3f294', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:38 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e1ea88e3-8634-41ff-99ea-a2846bc6b793 tempest-AttachVolumeTestJSON-1766853988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b68700d7-578e-4369-b443-085e566158b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:38 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e1ea88e3-8634-41ff-99ea-a2846bc6b793 tempest-AttachVolumeTestJSON-1766853988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b68700d7-578e-4369-b443-085e566158b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:38 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e1ea88e3-8634-41ff-99ea-a2846bc6b793 tempest-AttachVolumeTestJSON-1766853988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f83ab118-dd72-4d36-ae18-04270267eac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:38 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-e1ea88e3-8634-41ff-99ea-a2846bc6b793 tempest-AttachVolumeTestJSON-1766853988 None] Volume 514b60ca-9b71-49a5-8a05-7b8bb0e3f294: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-514b60ca-9b71-49a5-8a05-7b8bb0e3f294', 'volume_size': 1} Sep 03 14:24:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-e1ea88e3-8634-41ff-99ea-a2846bc6b793 tempest-AttachVolumeTestJSON-1766853988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:24:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-e1ea88e3-8634-41ff-99ea-a2846bc6b793 tempest-AttachVolumeTestJSON-1766853988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:24:38 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-e1ea88e3-8634-41ff-99ea-a2846bc6b793 tempest-AttachVolumeTestJSON-1766853988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2141505318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=514b60ca-9b71-49a5-8a05-7b8bb0e3f294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9786a2cfe4a246d5bc23e4df6064f5bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:24:38Z,use_quota=True,user_id='f844973d9a8046efb2a11b4b7ee420b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:24:38 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-e1ea88e3-8634-41ff-99ea-a2846bc6b793 tempest-AttachVolumeTestJSON-1766853988 None] Creating volume 514b60ca-9b71-49a5-8a05-7b8bb0e3f294 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:24:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-e1ea88e3-8634-41ff-99ea-a2846bc6b793 tempest-AttachVolumeTestJSON-1766853988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:24:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-e1ea88e3-8634-41ff-99ea-a2846bc6b793 tempest-AttachVolumeTestJSON-1766853988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:24:38 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-e1ea88e3-8634-41ff-99ea-a2846bc6b793 tempest-AttachVolumeTestJSON-1766853988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:24:38 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-e1ea88e3-8634-41ff-99ea-a2846bc6b793 tempest-AttachVolumeTestJSON-1766853988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:24:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-e1ea88e3-8634-41ff-99ea-a2846bc6b793 tempest-AttachVolumeTestJSON-1766853988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:24:38 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-e1ea88e3-8634-41ff-99ea-a2846bc6b793 tempest-AttachVolumeTestJSON-1766853988 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:24:38 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-e1ea88e3-8634-41ff-99ea-a2846bc6b793 tempest-AttachVolumeTestJSON-1766853988 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:24:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e1ea88e3-8634-41ff-99ea-a2846bc6b793 tempest-AttachVolumeTestJSON-1766853988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-514b60ca-9b71-49a5-8a05-7b8bb0e3f294 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:38 devstack sudo[96080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-514b60ca-9b71-49a5-8a05-7b8bb0e3f294 1073741824 Sep 03 14:24:38 devstack sudo[96080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:38 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-0192bdbc-cbc4-4dc9-816b-18f3e4b308a7 tempest-VolumesActionsTest-637900353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:24:39 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0192bdbc-cbc4-4dc9-816b-18f3e4b308a7 tempest-VolumesActionsTest-637900353 None] Flow 'volume_create_manager' (7100939a-04c5-4034-b673-3f15a877d66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:24:39 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0192bdbc-cbc4-4dc9-816b-18f3e4b308a7 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (054f44a0-fdf7-4f26-9cf3-12652e1c104d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:39 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0192bdbc-cbc4-4dc9-816b-18f3e4b308a7 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (054f44a0-fdf7-4f26-9cf3-12652e1c104d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1320988873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f96f27a-de45-4bf6-9057-3731cbfc5802,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0bb90fbedf4d30a33ab1ba1ecc6a6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:24:39Z,use_quota=True,user_id='a37e5511bcff4c8a8013a0408401e475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:39 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0192bdbc-cbc4-4dc9-816b-18f3e4b308a7 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b79c8ef0-b70f-46f2-b3b7-953e232f24b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:39 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0192bdbc-cbc4-4dc9-816b-18f3e4b308a7 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b79c8ef0-b70f-46f2-b3b7-953e232f24b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:39 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0192bdbc-cbc4-4dc9-816b-18f3e4b308a7 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60c3e376-3e03-4162-bbfa-e3d758a15d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:39 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0192bdbc-cbc4-4dc9-816b-18f3e4b308a7 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60c3e376-3e03-4162-bbfa-e3d758a15d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f96f27a-de45-4bf6-9057-3731cbfc5802', 'volume_name': 'volume-6f96f27a-de45-4bf6-9057-3731cbfc5802', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:39 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0192bdbc-cbc4-4dc9-816b-18f3e4b308a7 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f15dd923-46d5-434a-ab43-4134dfbc272d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:39 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0192bdbc-cbc4-4dc9-816b-18f3e4b308a7 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f15dd923-46d5-434a-ab43-4134dfbc272d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:39 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0192bdbc-cbc4-4dc9-816b-18f3e4b308a7 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1443268-4afd-4c6f-9f30-6a8048045fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:39 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-0192bdbc-cbc4-4dc9-816b-18f3e4b308a7 tempest-VolumesActionsTest-637900353 None] Volume 6f96f27a-de45-4bf6-9057-3731cbfc5802: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f96f27a-de45-4bf6-9057-3731cbfc5802', 'volume_size': 1} Sep 03 14:24:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-0192bdbc-cbc4-4dc9-816b-18f3e4b308a7 tempest-VolumesActionsTest-637900353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:24:39 devstack sudo[96080]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e1ea88e3-8634-41ff-99ea-a2846bc6b793 tempest-AttachVolumeTestJSON-1766853988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-514b60ca-9b71-49a5-8a05-7b8bb0e3f294 1073741824" returned: 0 in 0.981s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e1ea88e3-8634-41ff-99ea-a2846bc6b793 tempest-AttachVolumeTestJSON-1766853988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-514b60ca-9b71-49a5-8a05-7b8bb0e3f294 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:39 devstack sudo[96132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-514b60ca-9b71-49a5-8a05-7b8bb0e3f294 Sep 03 14:24:39 devstack sudo[96132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:40 devstack sudo[96132]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e1ea88e3-8634-41ff-99ea-a2846bc6b793 tempest-AttachVolumeTestJSON-1766853988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-514b60ca-9b71-49a5-8a05-7b8bb0e3f294" returned: 0 in 0.464s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:40 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-e1ea88e3-8634-41ff-99ea-a2846bc6b793 tempest-AttachVolumeTestJSON-1766853988 None] <== create_volume: return (1540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:24:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-e1ea88e3-8634-41ff-99ea-a2846bc6b793 tempest-AttachVolumeTestJSON-1766853988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.545s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:24:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-0192bdbc-cbc4-4dc9-816b-18f3e4b308a7 tempest-VolumesActionsTest-637900353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.928s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:24:40 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-0192bdbc-cbc4-4dc9-816b-18f3e4b308a7 tempest-VolumesActionsTest-637900353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1320988873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f96f27a-de45-4bf6-9057-3731cbfc5802,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0bb90fbedf4d30a33ab1ba1ecc6a6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:24:39Z,use_quota=True,user_id='a37e5511bcff4c8a8013a0408401e475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:24:40 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-0192bdbc-cbc4-4dc9-816b-18f3e4b308a7 tempest-VolumesActionsTest-637900353 None] Creating volume 6f96f27a-de45-4bf6-9057-3731cbfc5802 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:24:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-0192bdbc-cbc4-4dc9-816b-18f3e4b308a7 tempest-VolumesActionsTest-637900353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:24:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-0192bdbc-cbc4-4dc9-816b-18f3e4b308a7 tempest-VolumesActionsTest-637900353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:24:40 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-0192bdbc-cbc4-4dc9-816b-18f3e4b308a7 tempest-VolumesActionsTest-637900353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:24:40 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-0192bdbc-cbc4-4dc9-816b-18f3e4b308a7 tempest-VolumesActionsTest-637900353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:24:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-0192bdbc-cbc4-4dc9-816b-18f3e4b308a7 tempest-VolumesActionsTest-637900353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:24:40 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-0192bdbc-cbc4-4dc9-816b-18f3e4b308a7 tempest-VolumesActionsTest-637900353 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:24:40 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-0192bdbc-cbc4-4dc9-816b-18f3e4b308a7 tempest-VolumesActionsTest-637900353 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:24:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0192bdbc-cbc4-4dc9-816b-18f3e4b308a7 tempest-VolumesActionsTest-637900353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6f96f27a-de45-4bf6-9057-3731cbfc5802 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e1ea88e3-8634-41ff-99ea-a2846bc6b793 tempest-AttachVolumeTestJSON-1766853988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f83ab118-dd72-4d36-ae18-04270267eac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-514b60ca-9b71-49a5-8a05-7b8bb0e3f294', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:40 devstack sudo[96147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6f96f27a-de45-4bf6-9057-3731cbfc5802 1073741824 Sep 03 14:24:40 devstack sudo[96147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e1ea88e3-8634-41ff-99ea-a2846bc6b793 tempest-AttachVolumeTestJSON-1766853988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9bede5c-bc8a-432d-9f30-af9890aa226d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:40 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-e1ea88e3-8634-41ff-99ea-a2846bc6b793 tempest-AttachVolumeTestJSON-1766853988 None] Volume volume-514b60ca-9b71-49a5-8a05-7b8bb0e3f294 (514b60ca-9b71-49a5-8a05-7b8bb0e3f294): created successfully Sep 03 14:24:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e1ea88e3-8634-41ff-99ea-a2846bc6b793 tempest-AttachVolumeTestJSON-1766853988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9bede5c-bc8a-432d-9f30-af9890aa226d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e1ea88e3-8634-41ff-99ea-a2846bc6b793 tempest-AttachVolumeTestJSON-1766853988 None] Flow 'volume_create_manager' (9b129084-5be1-40e4-bd43-3ce29682899f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:24:40 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-e1ea88e3-8634-41ff-99ea-a2846bc6b793 tempest-AttachVolumeTestJSON-1766853988 None] Created volume successfully. Sep 03 14:24:40 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-75b8af4f-5a03-441f-a311-175a557be10e tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:24:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-75b8af4f-5a03-441f-a311-175a557be10e tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Flow 'volume_create_manager' (7b98b9d2-08ca-45f9-ac0e-76bf89f43c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:24:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-75b8af4f-5a03-441f-a311-175a557be10e tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27097cc1-7e92-475a-b488-d220081cb7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-75b8af4f-5a03-441f-a311-175a557be10e tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27097cc1-7e92-475a-b488-d220081cb7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-487182915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c2de51d-a620-4ea3-a76c-be530fb9590c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b27a92815a64697a0182bd3ff0a4bab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:24:40Z,use_quota=True,user_id='5ac480554e944661a7178ea9fbd7a8fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(042b279c-17b0-4ef8-b6b6-7da53f81d270),volume_type_id=042b279c-17b0-4ef8-b6b6-7da53f81d270)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-75b8af4f-5a03-441f-a311-175a557be10e tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c4cb771-14fc-4a3f-b0d1-c54fd4b46cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-75b8af4f-5a03-441f-a311-175a557be10e tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c4cb771-14fc-4a3f-b0d1-c54fd4b46cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-75b8af4f-5a03-441f-a311-175a557be10e tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce2654cf-1e9d-4abe-b20e-6e53d0e162a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-75b8af4f-5a03-441f-a311-175a557be10e tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce2654cf-1e9d-4abe-b20e-6e53d0e162a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c2de51d-a620-4ea3-a76c-be530fb9590c', 'volume_name': 'volume-9c2de51d-a620-4ea3-a76c-be530fb9590c', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-75b8af4f-5a03-441f-a311-175a557be10e tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceaade8f-3df5-4da0-a498-78c612bd1927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-75b8af4f-5a03-441f-a311-175a557be10e tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceaade8f-3df5-4da0-a498-78c612bd1927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-75b8af4f-5a03-441f-a311-175a557be10e tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82d079bb-3de9-441d-a4bf-18eef5097bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:40 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-75b8af4f-5a03-441f-a311-175a557be10e tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Volume 9c2de51d-a620-4ea3-a76c-be530fb9590c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c2de51d-a620-4ea3-a76c-be530fb9590c', 'volume_size': 1} Sep 03 14:24:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-75b8af4f-5a03-441f-a311-175a557be10e tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:24:40 devstack sudo[96147]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0192bdbc-cbc4-4dc9-816b-18f3e4b308a7 tempest-VolumesActionsTest-637900353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6f96f27a-de45-4bf6-9057-3731cbfc5802 1073741824" returned: 0 in 0.850s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0192bdbc-cbc4-4dc9-816b-18f3e4b308a7 tempest-VolumesActionsTest-637900353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6f96f27a-de45-4bf6-9057-3731cbfc5802 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:41 devstack sudo[96168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6f96f27a-de45-4bf6-9057-3731cbfc5802 Sep 03 14:24:41 devstack sudo[96168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:41 devstack sudo[96168]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0192bdbc-cbc4-4dc9-816b-18f3e4b308a7 tempest-VolumesActionsTest-637900353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6f96f27a-de45-4bf6-9057-3731cbfc5802" returned: 0 in 0.527s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-0192bdbc-cbc4-4dc9-816b-18f3e4b308a7 tempest-VolumesActionsTest-637900353 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:24:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-0192bdbc-cbc4-4dc9-816b-18f3e4b308a7 tempest-VolumesActionsTest-637900353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:24:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-75b8af4f-5a03-441f-a311-175a557be10e tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.687s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:24:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-75b8af4f-5a03-441f-a311-175a557be10e tempest-VolumeRetypeWithoutMigrationTest-788795427 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-487182915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c2de51d-a620-4ea3-a76c-be530fb9590c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b27a92815a64697a0182bd3ff0a4bab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:24:40Z,use_quota=True,user_id='5ac480554e944661a7178ea9fbd7a8fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(042b279c-17b0-4ef8-b6b6-7da53f81d270),volume_type_id=042b279c-17b0-4ef8-b6b6-7da53f81d270)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:24:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-75b8af4f-5a03-441f-a311-175a557be10e tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Creating volume 9c2de51d-a620-4ea3-a76c-be530fb9590c {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:24:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-75b8af4f-5a03-441f-a311-175a557be10e tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:24:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-75b8af4f-5a03-441f-a311-175a557be10e tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:24:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-75b8af4f-5a03-441f-a311-175a557be10e tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:24:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-75b8af4f-5a03-441f-a311-175a557be10e tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:24:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-75b8af4f-5a03-441f-a311-175a557be10e tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:24:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-75b8af4f-5a03-441f-a311-175a557be10e tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:24:41 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-75b8af4f-5a03-441f-a311-175a557be10e tempest-VolumeRetypeWithoutMigrationTest-788795427 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:24:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-75b8af4f-5a03-441f-a311-175a557be10e tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9c2de51d-a620-4ea3-a76c-be530fb9590c 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0192bdbc-cbc4-4dc9-816b-18f3e4b308a7 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1443268-4afd-4c6f-9f30-6a8048045fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f96f27a-de45-4bf6-9057-3731cbfc5802', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:41 devstack sudo[96178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9c2de51d-a620-4ea3-a76c-be530fb9590c 1073741824 Sep 03 14:24:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0192bdbc-cbc4-4dc9-816b-18f3e4b308a7 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8053a0e7-b81c-44c1-b04c-b27e43d40c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:41 devstack sudo[96178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:41 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-0192bdbc-cbc4-4dc9-816b-18f3e4b308a7 tempest-VolumesActionsTest-637900353 None] Volume volume-6f96f27a-de45-4bf6-9057-3731cbfc5802 (6f96f27a-de45-4bf6-9057-3731cbfc5802): created successfully Sep 03 14:24:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0192bdbc-cbc4-4dc9-816b-18f3e4b308a7 tempest-VolumesActionsTest-637900353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8053a0e7-b81c-44c1-b04c-b27e43d40c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0192bdbc-cbc4-4dc9-816b-18f3e4b308a7 tempest-VolumesActionsTest-637900353 None] Flow 'volume_create_manager' (7100939a-04c5-4034-b673-3f15a877d66f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:24:41 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-0192bdbc-cbc4-4dc9-816b-18f3e4b308a7 tempest-VolumesActionsTest-637900353 None] Created volume successfully. Sep 03 14:24:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-a7975b2d-5b2c-495f-b91a-885725cd690b req-451342cd-6406-48be-b7b2-71b48990facb tempest-AttachVolumeTestJSON-1766853988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:24:42 devstack sudo[96178]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-75b8af4f-5a03-441f-a311-175a557be10e tempest-VolumeRetypeWithoutMigrationTest-788795427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9c2de51d-a620-4ea3-a76c-be530fb9590c 1073741824" returned: 0 in 0.565s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-75b8af4f-5a03-441f-a311-175a557be10e tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9c2de51d-a620-4ea3-a76c-be530fb9590c {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:42 devstack sudo[96185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9c2de51d-a620-4ea3-a76c-be530fb9590c Sep 03 14:24:42 devstack sudo[96185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:42 devstack sudo[96185]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-75b8af4f-5a03-441f-a311-175a557be10e tempest-VolumeRetypeWithoutMigrationTest-788795427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9c2de51d-a620-4ea3-a76c-be530fb9590c" returned: 0 in 0.291s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:42 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-75b8af4f-5a03-441f-a311-175a557be10e tempest-VolumeRetypeWithoutMigrationTest-788795427 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:24:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-75b8af4f-5a03-441f-a311-175a557be10e tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:24:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-a7975b2d-5b2c-495f-b91a-885725cd690b req-451342cd-6406-48be-b7b2-71b48990facb tempest-AttachVolumeTestJSON-1766853988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.758s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:24:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-a7975b2d-5b2c-495f-b91a-885725cd690b req-451342cd-6406-48be-b7b2-71b48990facb tempest-AttachVolumeTestJSON-1766853988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:24:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-75b8af4f-5a03-441f-a311-175a557be10e tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82d079bb-3de9-441d-a4bf-18eef5097bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c2de51d-a620-4ea3-a76c-be530fb9590c', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-75b8af4f-5a03-441f-a311-175a557be10e tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6e05d76-11f6-4b29-ae74-e619a015ec96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:42 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-75b8af4f-5a03-441f-a311-175a557be10e tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Volume volume-9c2de51d-a620-4ea3-a76c-be530fb9590c (9c2de51d-a620-4ea3-a76c-be530fb9590c): created successfully Sep 03 14:24:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-75b8af4f-5a03-441f-a311-175a557be10e tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6e05d76-11f6-4b29-ae74-e619a015ec96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-75b8af4f-5a03-441f-a311-175a557be10e tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Flow 'volume_create_manager' (7b98b9d2-08ca-45f9-ac0e-76bf89f43c85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:24:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-a7975b2d-5b2c-495f-b91a-885725cd690b req-451342cd-6406-48be-b7b2-71b48990facb tempest-AttachVolumeTestJSON-1766853988 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713', 'name': 'volume-514b60ca-9b71-49a5-8a05-7b8bb0e3f294', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '643980c9-cd1b-4b35-8156-0fba84ba38ab', 'enforce_multipath': True} {{(pid=87007) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 14:24:42 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-75b8af4f-5a03-441f-a311-175a557be10e tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Created volume successfully. Sep 03 14:24:42 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-a7975b2d-5b2c-495f-b91a-885725cd690b req-451342cd-6406-48be-b7b2-71b48990facb tempest-AttachVolumeTestJSON-1766853988 None] attachment_update completed successfully. Sep 03 14:24:43 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7612cd78-c6d2-4fef-a02c-a92392d3468f tempest-VolumesActionsTest-637900353 None] Acquiring lock "cinder-6f96f27a-de45-4bf6-9057-3731cbfc5802-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:24:43 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7612cd78-c6d2-4fef-a02c-a92392d3468f tempest-VolumesActionsTest-637900353 None] Lock "cinder-6f96f27a-de45-4bf6-9057-3731cbfc5802-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:24:43 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7612cd78-c6d2-4fef-a02c-a92392d3468f tempest-VolumesActionsTest-637900353 None] Acquiring lock "cinder-quobyte-6f96f27a-de45-4bf6-9057-3731cbfc5802" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:24:43 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7612cd78-c6d2-4fef-a02c-a92392d3468f tempest-VolumesActionsTest-637900353 None] Lock "cinder-quobyte-6f96f27a-de45-4bf6-9057-3731cbfc5802" acquired by "delete_volume" :: waited 0.037s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:24:43 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ac1061-98df-4620-88df-4886a63f0969]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:24:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7612cd78-c6d2-4fef-a02c-a92392d3468f tempest-VolumesActionsTest-637900353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6f96f27a-de45-4bf6-9057-3731cbfc5802 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:43 devstack sudo[96191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6f96f27a-de45-4bf6-9057-3731cbfc5802 Sep 03 14:24:43 devstack sudo[96191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2977e584-b441-4543-aa50-f15ceecbc285 tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:24:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2977e584-b441-4543-aa50-f15ceecbc285 tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:24:44 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2977e584-b441-4543-aa50-f15ceecbc285 tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:24:44 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2977e584-b441-4543-aa50-f15ceecbc285 tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:24:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2977e584-b441-4543-aa50-f15ceecbc285 tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:24:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2977e584-b441-4543-aa50-f15ceecbc285 tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:44 devstack sudo[96198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:24:44 devstack sudo[96198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:44 devstack sudo[96191]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7612cd78-c6d2-4fef-a02c-a92392d3468f tempest-VolumesActionsTest-637900353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6f96f27a-de45-4bf6-9057-3731cbfc5802" returned: 0 in 0.627s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7612cd78-c6d2-4fef-a02c-a92392d3468f tempest-VolumesActionsTest-637900353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6f96f27a-de45-4bf6-9057-3731cbfc5802 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:44 devstack sudo[96201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6f96f27a-de45-4bf6-9057-3731cbfc5802 Sep 03 14:24:44 devstack sudo[96201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:44 devstack sudo[96198]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2977e584-b441-4543-aa50-f15ceecbc285 tempest-VolumeRetypeWithoutMigrationTest-788795427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.318s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:44 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-2977e584-b441-4543-aa50-f15ceecbc285 tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:24:44 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-2977e584-b441-4543-aa50-f15ceecbc285 tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Retype volume completed successfully. Sep 03 14:24:44 devstack sudo[96201]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7612cd78-c6d2-4fef-a02c-a92392d3468f tempest-VolumesActionsTest-637900353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6f96f27a-de45-4bf6-9057-3731cbfc5802" returned: 0 in 0.332s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:44 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7612cd78-c6d2-4fef-a02c-a92392d3468f tempest-VolumesActionsTest-637900353 None] Lock "cinder-quobyte-6f96f27a-de45-4bf6-9057-3731cbfc5802" released by "delete_volume" :: held 1.034s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:24:44 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-7612cd78-c6d2-4fef-a02c-a92392d3468f tempest-VolumesActionsTest-637900353 None] Created reservations ['3f46e2aa-d93e-4701-b3e8-0bd0273b97e8', '5b2b43e6-de14-463b-ae26-ac37c3dd5a59', 'f789b3d8-57f5-4e74-b82a-c0380e33e070', 'd495f921-05bf-4edd-be18-4d90690cd3d6'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:24:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7612cd78-c6d2-4fef-a02c-a92392d3468f tempest-VolumesActionsTest-637900353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:24:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7612cd78-c6d2-4fef-a02c-a92392d3468f tempest-VolumesActionsTest-637900353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:24:44 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-7612cd78-c6d2-4fef-a02c-a92392d3468f tempest-VolumesActionsTest-637900353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:24:44 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-7612cd78-c6d2-4fef-a02c-a92392d3468f tempest-VolumesActionsTest-637900353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:24:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7612cd78-c6d2-4fef-a02c-a92392d3468f tempest-VolumesActionsTest-637900353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:24:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7612cd78-c6d2-4fef-a02c-a92392d3468f tempest-VolumesActionsTest-637900353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:44 devstack sudo[96205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:24:44 devstack sudo[96205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:45 devstack sudo[96205]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7612cd78-c6d2-4fef-a02c-a92392d3468f tempest-VolumesActionsTest-637900353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.267s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:45 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-7612cd78-c6d2-4fef-a02c-a92392d3468f tempest-VolumesActionsTest-637900353 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:24:45 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-7612cd78-c6d2-4fef-a02c-a92392d3468f tempest-VolumesActionsTest-637900353 None] Deleted volume successfully. Sep 03 14:24:45 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7612cd78-c6d2-4fef-a02c-a92392d3468f tempest-VolumesActionsTest-637900353 None] Lock "cinder-6f96f27a-de45-4bf6-9057-3731cbfc5802-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:24:45 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-e7c5fe93-6a23-4456-a2c5-87e3a2f90677 req-fbd04929-0d2a-4142-afbb-6af79fa339c7 tempest-AttachVolumeTestJSON-1766853988 None] Terminate volume connection completed successfully. Sep 03 14:24:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-e7c5fe93-6a23-4456-a2c5-87e3a2f90677 req-fbd04929-0d2a-4142-afbb-6af79fa339c7 tempest-AttachVolumeTestJSON-1766853988 None] Deleting attachment c9b37f21-424b-4fbd-8293-aabec7af06c4. {{(pid=87007) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 14:24:45 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-daff2a26-78c4-456f-b173-389afcb6d051 tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Acquiring lock "cinder-9c2de51d-a620-4ea3-a76c-be530fb9590c-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:24:45 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-daff2a26-78c4-456f-b173-389afcb6d051 tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Lock "cinder-9c2de51d-a620-4ea3-a76c-be530fb9590c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:24:45 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-daff2a26-78c4-456f-b173-389afcb6d051 tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Acquiring lock "cinder-quobyte-9c2de51d-a620-4ea3-a76c-be530fb9590c" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:24:45 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-daff2a26-78c4-456f-b173-389afcb6d051 tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Lock "cinder-quobyte-9c2de51d-a620-4ea3-a76c-be530fb9590c" acquired by "delete_volume" :: waited 0.034s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:24:45 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ffebd5-0bf7-4661-adfc-0e97965c1a00]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:24:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-daff2a26-78c4-456f-b173-389afcb6d051 tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9c2de51d-a620-4ea3-a76c-be530fb9590c {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:45 devstack sudo[96211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9c2de51d-a620-4ea3-a76c-be530fb9590c Sep 03 14:24:45 devstack sudo[96211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:46 devstack sudo[96211]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-daff2a26-78c4-456f-b173-389afcb6d051 tempest-VolumeRetypeWithoutMigrationTest-788795427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9c2de51d-a620-4ea3-a76c-be530fb9590c" returned: 0 in 0.541s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-daff2a26-78c4-456f-b173-389afcb6d051 tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9c2de51d-a620-4ea3-a76c-be530fb9590c {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:46 devstack sudo[96216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9c2de51d-a620-4ea3-a76c-be530fb9590c Sep 03 14:24:46 devstack sudo[96216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:46 devstack sudo[96216]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-daff2a26-78c4-456f-b173-389afcb6d051 tempest-VolumeRetypeWithoutMigrationTest-788795427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9c2de51d-a620-4ea3-a76c-be530fb9590c" returned: 0 in 0.319s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:46 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-daff2a26-78c4-456f-b173-389afcb6d051 tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Lock "cinder-quobyte-9c2de51d-a620-4ea3-a76c-be530fb9590c" released by "delete_volume" :: held 0.936s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:24:46 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-0211242d-3494-45ae-84f6-6c7897035830 req-c5820a23-3d6c-49b1-afa5-2cba35d1e744 tempest-AttachVolumeTestJSON-1766853988 None] Terminate volume connection completed successfully. Sep 03 14:24:46 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-0211242d-3494-45ae-84f6-6c7897035830 req-c5820a23-3d6c-49b1-afa5-2cba35d1e744 tempest-AttachVolumeTestJSON-1766853988 None] Deleting attachment 643980c9-cd1b-4b35-8156-0fba84ba38ab. {{(pid=87007) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 14:24:46 devstack cinder-volume[87007]: WARNING cinder.quota [None req-daff2a26-78c4-456f-b173-389afcb6d051 tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 03 14:24:46 devstack cinder-volume[87007]: WARNING cinder.quota [None req-daff2a26-78c4-456f-b173-389afcb6d051 tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 03 14:24:46 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-daff2a26-78c4-456f-b173-389afcb6d051 tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Created reservations ['a24c246f-21b5-4322-8d10-9d7a74104e44', 'f2299b46-7266-43f7-ae58-b14584c57214', 'ab705100-38c9-48cd-8a30-b8bde54d3483', '2d598690-c432-43b9-b35e-96c0e68d1b52'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:24:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-daff2a26-78c4-456f-b173-389afcb6d051 tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:24:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-daff2a26-78c4-456f-b173-389afcb6d051 tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:24:47 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-daff2a26-78c4-456f-b173-389afcb6d051 tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:24:47 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-daff2a26-78c4-456f-b173-389afcb6d051 tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:24:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-daff2a26-78c4-456f-b173-389afcb6d051 tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:24:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-daff2a26-78c4-456f-b173-389afcb6d051 tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:47 devstack sudo[96246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:24:47 devstack sudo[96246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:47 devstack sudo[96246]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-daff2a26-78c4-456f-b173-389afcb6d051 tempest-VolumeRetypeWithoutMigrationTest-788795427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.291s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:47 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-daff2a26-78c4-456f-b173-389afcb6d051 tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:24:47 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-daff2a26-78c4-456f-b173-389afcb6d051 tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Deleted volume successfully. Sep 03 14:24:47 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-daff2a26-78c4-456f-b173-389afcb6d051 tempest-VolumeRetypeWithoutMigrationTest-788795427 None] Lock "cinder-9c2de51d-a620-4ea3-a76c-be530fb9590c-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:24:51 devstack cinder-volume[87007]: DEBUG oslo_service.periodic_task [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87007) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 14:24:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:24:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:24:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:24:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:24:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:24:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:51 devstack sudo[96273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:24:51 devstack sudo[96273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:52 devstack sudo[96273]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.713s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:52 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:24:52 devstack cinder-volume[87007]: DEBUG oslo_service.periodic_task [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running periodic task VolumeManager._thread_info {{(pid=87007) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 14:24:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] thread count: 28 {{(pid=87007) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 14:24:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] thread info: [<_MainThread(MainThread, started 123689171054720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87007) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 14:24:53 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7c61540e-83a8-4049-8c26-6bf8ae6297c2 tempest-AttachVolumeTestJSON-1766853988 None] Acquiring lock "cinder-514b60ca-9b71-49a5-8a05-7b8bb0e3f294-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:24:53 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7c61540e-83a8-4049-8c26-6bf8ae6297c2 tempest-AttachVolumeTestJSON-1766853988 None] Lock "cinder-514b60ca-9b71-49a5-8a05-7b8bb0e3f294-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:24:53 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7c61540e-83a8-4049-8c26-6bf8ae6297c2 tempest-AttachVolumeTestJSON-1766853988 None] Acquiring lock "cinder-quobyte-514b60ca-9b71-49a5-8a05-7b8bb0e3f294" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:24:53 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7c61540e-83a8-4049-8c26-6bf8ae6297c2 tempest-AttachVolumeTestJSON-1766853988 None] Lock "cinder-quobyte-514b60ca-9b71-49a5-8a05-7b8bb0e3f294" acquired by "delete_volume" :: waited 0.020s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:24:53 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e25c20-5e8e-4ccf-afe6-0f268bbf2d50]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:24:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7c61540e-83a8-4049-8c26-6bf8ae6297c2 tempest-AttachVolumeTestJSON-1766853988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-514b60ca-9b71-49a5-8a05-7b8bb0e3f294 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:53 devstack sudo[96282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-514b60ca-9b71-49a5-8a05-7b8bb0e3f294 Sep 03 14:24:53 devstack sudo[96282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:53 devstack sudo[96282]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7c61540e-83a8-4049-8c26-6bf8ae6297c2 tempest-AttachVolumeTestJSON-1766853988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-514b60ca-9b71-49a5-8a05-7b8bb0e3f294" returned: 0 in 0.575s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7c61540e-83a8-4049-8c26-6bf8ae6297c2 tempest-AttachVolumeTestJSON-1766853988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-514b60ca-9b71-49a5-8a05-7b8bb0e3f294 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:53 devstack sudo[96297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-514b60ca-9b71-49a5-8a05-7b8bb0e3f294 Sep 03 14:24:53 devstack sudo[96297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:54 devstack sudo[96297]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7c61540e-83a8-4049-8c26-6bf8ae6297c2 tempest-AttachVolumeTestJSON-1766853988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-514b60ca-9b71-49a5-8a05-7b8bb0e3f294" returned: 0 in 0.331s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:54 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7c61540e-83a8-4049-8c26-6bf8ae6297c2 tempest-AttachVolumeTestJSON-1766853988 None] Lock "cinder-quobyte-514b60ca-9b71-49a5-8a05-7b8bb0e3f294" released by "delete_volume" :: held 0.981s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:24:54 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-7c61540e-83a8-4049-8c26-6bf8ae6297c2 tempest-AttachVolumeTestJSON-1766853988 None] Created reservations ['8265eb84-569a-4c23-8bb5-c9a4dc49a11b', 'fa3c4d50-1afe-4351-be95-9213c59308c9', '82322db5-a533-4734-8b57-4192183d70d2', '33217bde-46b7-4635-905e-d2008bd19994'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:24:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7c61540e-83a8-4049-8c26-6bf8ae6297c2 tempest-AttachVolumeTestJSON-1766853988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:24:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7c61540e-83a8-4049-8c26-6bf8ae6297c2 tempest-AttachVolumeTestJSON-1766853988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:24:54 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-7c61540e-83a8-4049-8c26-6bf8ae6297c2 tempest-AttachVolumeTestJSON-1766853988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:24:54 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-7c61540e-83a8-4049-8c26-6bf8ae6297c2 tempest-AttachVolumeTestJSON-1766853988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:24:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7c61540e-83a8-4049-8c26-6bf8ae6297c2 tempest-AttachVolumeTestJSON-1766853988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:24:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7c61540e-83a8-4049-8c26-6bf8ae6297c2 tempest-AttachVolumeTestJSON-1766853988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:54 devstack sudo[96301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:24:54 devstack sudo[96301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:54 devstack sudo[96301]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7c61540e-83a8-4049-8c26-6bf8ae6297c2 tempest-AttachVolumeTestJSON-1766853988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.269s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:54 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-7c61540e-83a8-4049-8c26-6bf8ae6297c2 tempest-AttachVolumeTestJSON-1766853988 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:24:54 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-7c61540e-83a8-4049-8c26-6bf8ae6297c2 tempest-AttachVolumeTestJSON-1766853988 None] Deleted volume successfully. Sep 03 14:24:54 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7c61540e-83a8-4049-8c26-6bf8ae6297c2 tempest-AttachVolumeTestJSON-1766853988 None] Lock "cinder-514b60ca-9b71-49a5-8a05-7b8bb0e3f294-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:24:55 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1883923d-135a-42fc-859d-0b4df6826e91 tempest-AttachVolumeTestJSON-1766853988 None] Acquiring lock "cinder-c7653c7f-3d06-4c63-b6d3-a243bec80b0e-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:24:55 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1883923d-135a-42fc-859d-0b4df6826e91 tempest-AttachVolumeTestJSON-1766853988 None] Lock "cinder-c7653c7f-3d06-4c63-b6d3-a243bec80b0e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:24:55 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1883923d-135a-42fc-859d-0b4df6826e91 tempest-AttachVolumeTestJSON-1766853988 None] Acquiring lock "cinder-quobyte-c7653c7f-3d06-4c63-b6d3-a243bec80b0e" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:24:55 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1883923d-135a-42fc-859d-0b4df6826e91 tempest-AttachVolumeTestJSON-1766853988 None] Lock "cinder-quobyte-c7653c7f-3d06-4c63-b6d3-a243bec80b0e" acquired by "delete_volume" :: waited 0.018s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:24:55 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f14065-c874-42b8-b7f6-22ef663f78a0]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:24:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1883923d-135a-42fc-859d-0b4df6826e91 tempest-AttachVolumeTestJSON-1766853988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c7653c7f-3d06-4c63-b6d3-a243bec80b0e {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:55 devstack sudo[96304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c7653c7f-3d06-4c63-b6d3-a243bec80b0e Sep 03 14:24:55 devstack sudo[96304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:56 devstack sudo[96304]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1883923d-135a-42fc-859d-0b4df6826e91 tempest-AttachVolumeTestJSON-1766853988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c7653c7f-3d06-4c63-b6d3-a243bec80b0e" returned: 0 in 0.378s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1883923d-135a-42fc-859d-0b4df6826e91 tempest-AttachVolumeTestJSON-1766853988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c7653c7f-3d06-4c63-b6d3-a243bec80b0e {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:56 devstack sudo[96310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c7653c7f-3d06-4c63-b6d3-a243bec80b0e Sep 03 14:24:56 devstack sudo[96310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:56 devstack sudo[96310]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1883923d-135a-42fc-859d-0b4df6826e91 tempest-AttachVolumeTestJSON-1766853988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c7653c7f-3d06-4c63-b6d3-a243bec80b0e" returned: 0 in 0.319s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:56 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1883923d-135a-42fc-859d-0b4df6826e91 tempest-AttachVolumeTestJSON-1766853988 None] Lock "cinder-quobyte-c7653c7f-3d06-4c63-b6d3-a243bec80b0e" released by "delete_volume" :: held 0.751s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:24:56 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-1883923d-135a-42fc-859d-0b4df6826e91 tempest-AttachVolumeTestJSON-1766853988 None] Created reservations ['38d60398-53b8-4e9f-bef0-53f086c28ccd', '937c088c-513c-4fe9-8842-8a28a290b2c9', '859f47e9-0569-44f8-acae-3f04e8859b05', '463832ea-e696-4808-b5b0-055c86303020'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:24:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1883923d-135a-42fc-859d-0b4df6826e91 tempest-AttachVolumeTestJSON-1766853988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:24:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1883923d-135a-42fc-859d-0b4df6826e91 tempest-AttachVolumeTestJSON-1766853988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:24:56 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-1883923d-135a-42fc-859d-0b4df6826e91 tempest-AttachVolumeTestJSON-1766853988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:24:56 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-1883923d-135a-42fc-859d-0b4df6826e91 tempest-AttachVolumeTestJSON-1766853988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:24:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1883923d-135a-42fc-859d-0b4df6826e91 tempest-AttachVolumeTestJSON-1766853988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:24:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1883923d-135a-42fc-859d-0b4df6826e91 tempest-AttachVolumeTestJSON-1766853988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:56 devstack sudo[96313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:24:56 devstack sudo[96313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:56 devstack sudo[96313]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1883923d-135a-42fc-859d-0b4df6826e91 tempest-AttachVolumeTestJSON-1766853988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.304s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:56 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-1883923d-135a-42fc-859d-0b4df6826e91 tempest-AttachVolumeTestJSON-1766853988 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:24:56 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-1883923d-135a-42fc-859d-0b4df6826e91 tempest-AttachVolumeTestJSON-1766853988 None] Deleted volume successfully. Sep 03 14:24:56 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1883923d-135a-42fc-859d-0b4df6826e91 tempest-AttachVolumeTestJSON-1766853988 None] Lock "cinder-c7653c7f-3d06-4c63-b6d3-a243bec80b0e-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:24:56 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-799dad37-01c3-46a4-b934-36150831d9c2 tempest-AttachVolumeTestJSON-1766853988 None] Acquiring lock "cinder-3a2280bd-a309-4de5-b092-d5d3606da127-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:24:56 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-799dad37-01c3-46a4-b934-36150831d9c2 tempest-AttachVolumeTestJSON-1766853988 None] Lock "cinder-3a2280bd-a309-4de5-b092-d5d3606da127-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:24:56 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-799dad37-01c3-46a4-b934-36150831d9c2 tempest-AttachVolumeTestJSON-1766853988 None] Acquiring lock "cinder-quobyte-3a2280bd-a309-4de5-b092-d5d3606da127" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:24:57 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-799dad37-01c3-46a4-b934-36150831d9c2 tempest-AttachVolumeTestJSON-1766853988 None] Lock "cinder-quobyte-3a2280bd-a309-4de5-b092-d5d3606da127" acquired by "delete_volume" :: waited 0.020s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:24:57 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2918efc4-851f-42e9-8c1f-89174ab2941d]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:24:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-799dad37-01c3-46a4-b934-36150831d9c2 tempest-AttachVolumeTestJSON-1766853988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a2280bd-a309-4de5-b092-d5d3606da127 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:57 devstack sudo[96316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a2280bd-a309-4de5-b092-d5d3606da127 Sep 03 14:24:57 devstack sudo[96316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:57 devstack sudo[96316]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-799dad37-01c3-46a4-b934-36150831d9c2 tempest-AttachVolumeTestJSON-1766853988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a2280bd-a309-4de5-b092-d5d3606da127" returned: 0 in 0.396s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-799dad37-01c3-46a4-b934-36150831d9c2 tempest-AttachVolumeTestJSON-1766853988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a2280bd-a309-4de5-b092-d5d3606da127 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:57 devstack sudo[96322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a2280bd-a309-4de5-b092-d5d3606da127 Sep 03 14:24:57 devstack sudo[96322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:57 devstack sudo[96322]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-799dad37-01c3-46a4-b934-36150831d9c2 tempest-AttachVolumeTestJSON-1766853988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a2280bd-a309-4de5-b092-d5d3606da127" returned: 0 in 0.322s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:57 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-799dad37-01c3-46a4-b934-36150831d9c2 tempest-AttachVolumeTestJSON-1766853988 None] Lock "cinder-quobyte-3a2280bd-a309-4de5-b092-d5d3606da127" released by "delete_volume" :: held 0.769s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:24:57 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:SELECT=127,cinder:UPDATE=136,cinder:DELETE=10,cinder:INSERT=33 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:24:57 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:SELECT=109,cinder:INSERT=30,cinder:UPDATE=137,cinder:DELETE=11 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:24:57 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-799dad37-01c3-46a4-b934-36150831d9c2 tempest-AttachVolumeTestJSON-1766853988 None] Created reservations ['6bfc8f9a-5ca8-4cca-a3ff-82785656aa7c', '5c783f8a-4b8c-40cb-9ff2-7053cd0919d9', '5bbf705b-0b7d-4b93-96dd-2cdbff21a319', '5fa18f34-e114-4b30-98f0-8c6fd37a5fb8'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:24:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-799dad37-01c3-46a4-b934-36150831d9c2 tempest-AttachVolumeTestJSON-1766853988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:24:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-799dad37-01c3-46a4-b934-36150831d9c2 tempest-AttachVolumeTestJSON-1766853988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:24:57 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-799dad37-01c3-46a4-b934-36150831d9c2 tempest-AttachVolumeTestJSON-1766853988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:24:57 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-799dad37-01c3-46a4-b934-36150831d9c2 tempest-AttachVolumeTestJSON-1766853988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:24:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-799dad37-01c3-46a4-b934-36150831d9c2 tempest-AttachVolumeTestJSON-1766853988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:24:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-799dad37-01c3-46a4-b934-36150831d9c2 tempest-AttachVolumeTestJSON-1766853988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:58 devstack sudo[96325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:24:58 devstack sudo[96325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:58 devstack sudo[96325]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-799dad37-01c3-46a4-b934-36150831d9c2 tempest-AttachVolumeTestJSON-1766853988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.334s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:58 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-799dad37-01c3-46a4-b934-36150831d9c2 tempest-AttachVolumeTestJSON-1766853988 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:24:58 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-46aadd34-c93d-496f-b15b-fdd5df301941 tempest-VolumeTypesAccessTest-1126434858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:24:58 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-46aadd34-c93d-496f-b15b-fdd5df301941 tempest-VolumeTypesAccessTest-1126434858 None] Flow 'volume_create_manager' (d7225c7a-892f-4fc0-86b5-9ae4ffad4ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:24:58 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-46aadd34-c93d-496f-b15b-fdd5df301941 tempest-VolumeTypesAccessTest-1126434858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b58fff83-4c3e-4f93-8ed0-01bdbe545067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:58 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-799dad37-01c3-46a4-b934-36150831d9c2 tempest-AttachVolumeTestJSON-1766853988 None] Deleted volume successfully. Sep 03 14:24:58 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-46aadd34-c93d-496f-b15b-fdd5df301941 tempest-VolumeTypesAccessTest-1126434858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b58fff83-4c3e-4f93-8ed0-01bdbe545067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1514981923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34d92221-d0ea-48f5-b2d7-cce1737701e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3986f02d36c54062b8af92a3d803e59a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:24:58Z,use_quota=True,user_id='f48d8709f0204369936400dbe2a986d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1aaf0885-a42a-4aad-a639-162e096e16a0),volume_type_id=1aaf0885-a42a-4aad-a639-162e096e16a0)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:58 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-46aadd34-c93d-496f-b15b-fdd5df301941 tempest-VolumeTypesAccessTest-1126434858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31de1841-ce99-4cf8-9b39-209fde6d6421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:58 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-46aadd34-c93d-496f-b15b-fdd5df301941 tempest-VolumeTypesAccessTest-1126434858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31de1841-ce99-4cf8-9b39-209fde6d6421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:58 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-46aadd34-c93d-496f-b15b-fdd5df301941 tempest-VolumeTypesAccessTest-1126434858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0a9262b-ad27-4447-99db-1ec722d80834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:58 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-46aadd34-c93d-496f-b15b-fdd5df301941 tempest-VolumeTypesAccessTest-1126434858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0a9262b-ad27-4447-99db-1ec722d80834) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34d92221-d0ea-48f5-b2d7-cce1737701e9', 'volume_name': 'volume-34d92221-d0ea-48f5-b2d7-cce1737701e9', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:58 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-46aadd34-c93d-496f-b15b-fdd5df301941 tempest-VolumeTypesAccessTest-1126434858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f55c2d80-e7ef-439a-8af3-cb69c52808de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:58 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-46aadd34-c93d-496f-b15b-fdd5df301941 tempest-VolumeTypesAccessTest-1126434858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f55c2d80-e7ef-439a-8af3-cb69c52808de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:58 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-46aadd34-c93d-496f-b15b-fdd5df301941 tempest-VolumeTypesAccessTest-1126434858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e680867c-739c-42d6-a19b-25109f5bf721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:58 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-46aadd34-c93d-496f-b15b-fdd5df301941 tempest-VolumeTypesAccessTest-1126434858 None] Volume 34d92221-d0ea-48f5-b2d7-cce1737701e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34d92221-d0ea-48f5-b2d7-cce1737701e9', 'volume_size': 1} Sep 03 14:24:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-46aadd34-c93d-496f-b15b-fdd5df301941 tempest-VolumeTypesAccessTest-1126434858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:24:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-46aadd34-c93d-496f-b15b-fdd5df301941 tempest-VolumeTypesAccessTest-1126434858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:24:58 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-46aadd34-c93d-496f-b15b-fdd5df301941 tempest-VolumeTypesAccessTest-1126434858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1514981923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34d92221-d0ea-48f5-b2d7-cce1737701e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3986f02d36c54062b8af92a3d803e59a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:24:58Z,use_quota=True,user_id='f48d8709f0204369936400dbe2a986d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1aaf0885-a42a-4aad-a639-162e096e16a0),volume_type_id=1aaf0885-a42a-4aad-a639-162e096e16a0)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:24:58 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-46aadd34-c93d-496f-b15b-fdd5df301941 tempest-VolumeTypesAccessTest-1126434858 None] Creating volume 34d92221-d0ea-48f5-b2d7-cce1737701e9 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:24:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-46aadd34-c93d-496f-b15b-fdd5df301941 tempest-VolumeTypesAccessTest-1126434858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:24:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-46aadd34-c93d-496f-b15b-fdd5df301941 tempest-VolumeTypesAccessTest-1126434858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:24:58 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-46aadd34-c93d-496f-b15b-fdd5df301941 tempest-VolumeTypesAccessTest-1126434858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:24:58 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-46aadd34-c93d-496f-b15b-fdd5df301941 tempest-VolumeTypesAccessTest-1126434858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:24:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-46aadd34-c93d-496f-b15b-fdd5df301941 tempest-VolumeTypesAccessTest-1126434858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:24:58 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-46aadd34-c93d-496f-b15b-fdd5df301941 tempest-VolumeTypesAccessTest-1126434858 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:24:58 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-46aadd34-c93d-496f-b15b-fdd5df301941 tempest-VolumeTypesAccessTest-1126434858 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:24:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-46aadd34-c93d-496f-b15b-fdd5df301941 tempest-VolumeTypesAccessTest-1126434858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-34d92221-d0ea-48f5-b2d7-cce1737701e9 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:58 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-799dad37-01c3-46a4-b934-36150831d9c2 tempest-AttachVolumeTestJSON-1766853988 None] Lock "cinder-3a2280bd-a309-4de5-b092-d5d3606da127-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:24:58 devstack sudo[96328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-34d92221-d0ea-48f5-b2d7-cce1737701e9 1073741824 Sep 03 14:24:58 devstack sudo[96328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:58 devstack sudo[96328]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-46aadd34-c93d-496f-b15b-fdd5df301941 tempest-VolumeTypesAccessTest-1126434858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-34d92221-d0ea-48f5-b2d7-cce1737701e9 1073741824" returned: 0 in 0.548s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-46aadd34-c93d-496f-b15b-fdd5df301941 tempest-VolumeTypesAccessTest-1126434858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-34d92221-d0ea-48f5-b2d7-cce1737701e9 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:24:59 devstack sudo[96334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-34d92221-d0ea-48f5-b2d7-cce1737701e9 Sep 03 14:24:59 devstack sudo[96334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:24:59 devstack sudo[96334]: pam_unix(sudo:session): session closed for user root Sep 03 14:24:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-46aadd34-c93d-496f-b15b-fdd5df301941 tempest-VolumeTypesAccessTest-1126434858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-34d92221-d0ea-48f5-b2d7-cce1737701e9" returned: 0 in 0.321s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:24:59 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-46aadd34-c93d-496f-b15b-fdd5df301941 tempest-VolumeTypesAccessTest-1126434858 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:24:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-46aadd34-c93d-496f-b15b-fdd5df301941 tempest-VolumeTypesAccessTest-1126434858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:24:59 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-46aadd34-c93d-496f-b15b-fdd5df301941 tempest-VolumeTypesAccessTest-1126434858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e680867c-739c-42d6-a19b-25109f5bf721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34d92221-d0ea-48f5-b2d7-cce1737701e9', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:59 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-46aadd34-c93d-496f-b15b-fdd5df301941 tempest-VolumeTypesAccessTest-1126434858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af160b44-0290-488a-9bf6-85c5f6881a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:24:59 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-46aadd34-c93d-496f-b15b-fdd5df301941 tempest-VolumeTypesAccessTest-1126434858 None] Volume volume-34d92221-d0ea-48f5-b2d7-cce1737701e9 (34d92221-d0ea-48f5-b2d7-cce1737701e9): created successfully Sep 03 14:24:59 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-46aadd34-c93d-496f-b15b-fdd5df301941 tempest-VolumeTypesAccessTest-1126434858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af160b44-0290-488a-9bf6-85c5f6881a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:24:59 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-46aadd34-c93d-496f-b15b-fdd5df301941 tempest-VolumeTypesAccessTest-1126434858 None] Flow 'volume_create_manager' (d7225c7a-892f-4fc0-86b5-9ae4ffad4ccc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:24:59 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-46aadd34-c93d-496f-b15b-fdd5df301941 tempest-VolumeTypesAccessTest-1126434858 None] Created volume successfully. Sep 03 14:25:00 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-00ccbbee-d6ad-4af4-a6e0-60597d573cd8 tempest-VolumeTypesAccessTest-1126434858 None] Acquiring lock "cinder-34d92221-d0ea-48f5-b2d7-cce1737701e9-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:25:00 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-00ccbbee-d6ad-4af4-a6e0-60597d573cd8 tempest-VolumeTypesAccessTest-1126434858 None] Lock "cinder-34d92221-d0ea-48f5-b2d7-cce1737701e9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:25:00 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-00ccbbee-d6ad-4af4-a6e0-60597d573cd8 tempest-VolumeTypesAccessTest-1126434858 None] Acquiring lock "cinder-quobyte-34d92221-d0ea-48f5-b2d7-cce1737701e9" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:25:00 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-00ccbbee-d6ad-4af4-a6e0-60597d573cd8 tempest-VolumeTypesAccessTest-1126434858 None] Lock "cinder-quobyte-34d92221-d0ea-48f5-b2d7-cce1737701e9" acquired by "delete_volume" :: waited 0.032s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:25:00 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0017a9-96a0-49fb-a4f2-a3869ff66b27]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:25:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-00ccbbee-d6ad-4af4-a6e0-60597d573cd8 tempest-VolumeTypesAccessTest-1126434858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-34d92221-d0ea-48f5-b2d7-cce1737701e9 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:00 devstack sudo[96338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-34d92221-d0ea-48f5-b2d7-cce1737701e9 Sep 03 14:25:00 devstack sudo[96338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:01 devstack sudo[96338]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-00ccbbee-d6ad-4af4-a6e0-60597d573cd8 tempest-VolumeTypesAccessTest-1126434858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-34d92221-d0ea-48f5-b2d7-cce1737701e9" returned: 0 in 0.457s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-00ccbbee-d6ad-4af4-a6e0-60597d573cd8 tempest-VolumeTypesAccessTest-1126434858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-34d92221-d0ea-48f5-b2d7-cce1737701e9 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:01 devstack sudo[96343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-34d92221-d0ea-48f5-b2d7-cce1737701e9 Sep 03 14:25:01 devstack sudo[96343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:01 devstack sudo[96343]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-00ccbbee-d6ad-4af4-a6e0-60597d573cd8 tempest-VolumeTypesAccessTest-1126434858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-34d92221-d0ea-48f5-b2d7-cce1737701e9" returned: 0 in 0.332s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:01 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-00ccbbee-d6ad-4af4-a6e0-60597d573cd8 tempest-VolumeTypesAccessTest-1126434858 None] Lock "cinder-quobyte-34d92221-d0ea-48f5-b2d7-cce1737701e9" released by "delete_volume" :: held 0.853s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:25:01 devstack cinder-volume[87007]: WARNING cinder.quota [None req-00ccbbee-d6ad-4af4-a6e0-60597d573cd8 tempest-VolumeTypesAccessTest-1126434858 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-186536760 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-186536760, it is now deprecated. Please use the default quota class for default quota. Sep 03 14:25:01 devstack cinder-volume[87007]: WARNING cinder.quota [None req-00ccbbee-d6ad-4af4-a6e0-60597d573cd8 tempest-VolumeTypesAccessTest-1126434858 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-186536760 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-186536760, it is now deprecated. Please use the default quota class for default quota. Sep 03 14:25:01 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-00ccbbee-d6ad-4af4-a6e0-60597d573cd8 tempest-VolumeTypesAccessTest-1126434858 None] Created reservations ['904d451e-8fff-4a10-9f9f-df61b85fcb6a', '9c02ae3d-1669-4903-80e5-f1b9161c1cec', '2306450d-6dca-45c5-b096-1d8fa634708a', 'd6b93ce9-9a98-43cf-bc8a-0c3c379d140c'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:25:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-00ccbbee-d6ad-4af4-a6e0-60597d573cd8 tempest-VolumeTypesAccessTest-1126434858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:25:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-00ccbbee-d6ad-4af4-a6e0-60597d573cd8 tempest-VolumeTypesAccessTest-1126434858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:25:01 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-00ccbbee-d6ad-4af4-a6e0-60597d573cd8 tempest-VolumeTypesAccessTest-1126434858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:25:01 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-00ccbbee-d6ad-4af4-a6e0-60597d573cd8 tempest-VolumeTypesAccessTest-1126434858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:25:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-00ccbbee-d6ad-4af4-a6e0-60597d573cd8 tempest-VolumeTypesAccessTest-1126434858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:25:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-00ccbbee-d6ad-4af4-a6e0-60597d573cd8 tempest-VolumeTypesAccessTest-1126434858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:01 devstack sudo[96346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:25:01 devstack sudo[96346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:01 devstack sudo[96346]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-00ccbbee-d6ad-4af4-a6e0-60597d573cd8 tempest-VolumeTypesAccessTest-1126434858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.300s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:01 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-00ccbbee-d6ad-4af4-a6e0-60597d573cd8 tempest-VolumeTypesAccessTest-1126434858 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:25:02 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-00ccbbee-d6ad-4af4-a6e0-60597d573cd8 tempest-VolumeTypesAccessTest-1126434858 None] Deleted volume successfully. Sep 03 14:25:02 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-00ccbbee-d6ad-4af4-a6e0-60597d573cd8 tempest-VolumeTypesAccessTest-1126434858 None] Lock "cinder-34d92221-d0ea-48f5-b2d7-cce1737701e9-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:25:04 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7ed6bad-5999-4828-af07-87c6ce64a3ef tempest-AttachVolumeNegativeTest-1835626697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:25:04 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f7ed6bad-5999-4828-af07-87c6ce64a3ef tempest-AttachVolumeNegativeTest-1835626697 None] Flow 'volume_create_manager' (614e7be5-9679-45d2-8b8a-71f32604b6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:25:04 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f7ed6bad-5999-4828-af07-87c6ce64a3ef tempest-AttachVolumeNegativeTest-1835626697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94609f38-4f15-4bf2-9685-f0c9ef26c970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:04 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f7ed6bad-5999-4828-af07-87c6ce64a3ef tempest-AttachVolumeNegativeTest-1835626697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94609f38-4f15-4bf2-9685-f0c9ef26c970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-673070562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c34a5dd2-0054-4e18-8c4f-fb46301fa957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd1be5ab58fa4aa09e854306dcc6bbe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:25:05Z,use_quota=True,user_id='337e93cf223a488fa18dcadbd42fbcd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:04 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f7ed6bad-5999-4828-af07-87c6ce64a3ef tempest-AttachVolumeNegativeTest-1835626697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (535cebc6-3304-44d1-bcbd-f3b662453c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:04 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f7ed6bad-5999-4828-af07-87c6ce64a3ef tempest-AttachVolumeNegativeTest-1835626697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (535cebc6-3304-44d1-bcbd-f3b662453c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:04 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f7ed6bad-5999-4828-af07-87c6ce64a3ef tempest-AttachVolumeNegativeTest-1835626697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8324fc93-9369-456c-9a52-65bebf037f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:04 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f7ed6bad-5999-4828-af07-87c6ce64a3ef tempest-AttachVolumeNegativeTest-1835626697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8324fc93-9369-456c-9a52-65bebf037f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c34a5dd2-0054-4e18-8c4f-fb46301fa957', 'volume_name': 'volume-c34a5dd2-0054-4e18-8c4f-fb46301fa957', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:04 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f7ed6bad-5999-4828-af07-87c6ce64a3ef tempest-AttachVolumeNegativeTest-1835626697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ab62161-6ff5-4a75-a58c-8d9f36a1d1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:04 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f7ed6bad-5999-4828-af07-87c6ce64a3ef tempest-AttachVolumeNegativeTest-1835626697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ab62161-6ff5-4a75-a58c-8d9f36a1d1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:04 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f7ed6bad-5999-4828-af07-87c6ce64a3ef tempest-AttachVolumeNegativeTest-1835626697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcc17905-9d7a-4504-aad9-0008cbc2495d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:04 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-f7ed6bad-5999-4828-af07-87c6ce64a3ef tempest-AttachVolumeNegativeTest-1835626697 None] Volume c34a5dd2-0054-4e18-8c4f-fb46301fa957: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c34a5dd2-0054-4e18-8c4f-fb46301fa957', 'volume_size': 1} Sep 03 14:25:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f7ed6bad-5999-4828-af07-87c6ce64a3ef tempest-AttachVolumeNegativeTest-1835626697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:25:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f7ed6bad-5999-4828-af07-87c6ce64a3ef tempest-AttachVolumeNegativeTest-1835626697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:25:04 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f7ed6bad-5999-4828-af07-87c6ce64a3ef tempest-AttachVolumeNegativeTest-1835626697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-673070562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c34a5dd2-0054-4e18-8c4f-fb46301fa957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd1be5ab58fa4aa09e854306dcc6bbe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:25:05Z,use_quota=True,user_id='337e93cf223a488fa18dcadbd42fbcd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:25:04 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-f7ed6bad-5999-4828-af07-87c6ce64a3ef tempest-AttachVolumeNegativeTest-1835626697 None] Creating volume c34a5dd2-0054-4e18-8c4f-fb46301fa957 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:25:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f7ed6bad-5999-4828-af07-87c6ce64a3ef tempest-AttachVolumeNegativeTest-1835626697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:25:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f7ed6bad-5999-4828-af07-87c6ce64a3ef tempest-AttachVolumeNegativeTest-1835626697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:25:04 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f7ed6bad-5999-4828-af07-87c6ce64a3ef tempest-AttachVolumeNegativeTest-1835626697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:25:04 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f7ed6bad-5999-4828-af07-87c6ce64a3ef tempest-AttachVolumeNegativeTest-1835626697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:25:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f7ed6bad-5999-4828-af07-87c6ce64a3ef tempest-AttachVolumeNegativeTest-1835626697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:25:04 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f7ed6bad-5999-4828-af07-87c6ce64a3ef tempest-AttachVolumeNegativeTest-1835626697 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:25:04 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-f7ed6bad-5999-4828-af07-87c6ce64a3ef tempest-AttachVolumeNegativeTest-1835626697 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:25:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f7ed6bad-5999-4828-af07-87c6ce64a3ef tempest-AttachVolumeNegativeTest-1835626697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c34a5dd2-0054-4e18-8c4f-fb46301fa957 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:04 devstack sudo[96720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c34a5dd2-0054-4e18-8c4f-fb46301fa957 1073741824 Sep 03 14:25:04 devstack sudo[96720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:05 devstack sudo[96720]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f7ed6bad-5999-4828-af07-87c6ce64a3ef tempest-AttachVolumeNegativeTest-1835626697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c34a5dd2-0054-4e18-8c4f-fb46301fa957 1073741824" returned: 0 in 0.661s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f7ed6bad-5999-4828-af07-87c6ce64a3ef tempest-AttachVolumeNegativeTest-1835626697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c34a5dd2-0054-4e18-8c4f-fb46301fa957 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:05 devstack sudo[96726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c34a5dd2-0054-4e18-8c4f-fb46301fa957 Sep 03 14:25:05 devstack sudo[96726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:05 devstack sudo[96726]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f7ed6bad-5999-4828-af07-87c6ce64a3ef tempest-AttachVolumeNegativeTest-1835626697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c34a5dd2-0054-4e18-8c4f-fb46301fa957" returned: 0 in 0.314s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:05 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f7ed6bad-5999-4828-af07-87c6ce64a3ef tempest-AttachVolumeNegativeTest-1835626697 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:25:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f7ed6bad-5999-4828-af07-87c6ce64a3ef tempest-AttachVolumeNegativeTest-1835626697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:25:05 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f7ed6bad-5999-4828-af07-87c6ce64a3ef tempest-AttachVolumeNegativeTest-1835626697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcc17905-9d7a-4504-aad9-0008cbc2495d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c34a5dd2-0054-4e18-8c4f-fb46301fa957', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:05 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f7ed6bad-5999-4828-af07-87c6ce64a3ef tempest-AttachVolumeNegativeTest-1835626697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c77b7672-54d1-473b-8764-ffb06c364ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:05 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-f7ed6bad-5999-4828-af07-87c6ce64a3ef tempest-AttachVolumeNegativeTest-1835626697 None] Volume volume-c34a5dd2-0054-4e18-8c4f-fb46301fa957 (c34a5dd2-0054-4e18-8c4f-fb46301fa957): created successfully Sep 03 14:25:05 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f7ed6bad-5999-4828-af07-87c6ce64a3ef tempest-AttachVolumeNegativeTest-1835626697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c77b7672-54d1-473b-8764-ffb06c364ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:05 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f7ed6bad-5999-4828-af07-87c6ce64a3ef tempest-AttachVolumeNegativeTest-1835626697 None] Flow 'volume_create_manager' (614e7be5-9679-45d2-8b8a-71f32604b6ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:25:05 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-f7ed6bad-5999-4828-af07-87c6ce64a3ef tempest-AttachVolumeNegativeTest-1835626697 None] Created volume successfully. Sep 03 14:25:06 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a8ec461-6e6a-44de-be8c-45a6fdd9d227 tempest-VolumesListTestJSON-265208478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:25:06 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5a8ec461-6e6a-44de-be8c-45a6fdd9d227 tempest-VolumesListTestJSON-265208478 None] Flow 'volume_create_manager' (c8e9c4cc-4900-4841-ac3e-f6ebb9248b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:25:06 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5a8ec461-6e6a-44de-be8c-45a6fdd9d227 tempest-VolumesListTestJSON-265208478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea43b999-abbb-4f12-b940-14f5b1989593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:06 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5a8ec461-6e6a-44de-be8c-45a6fdd9d227 tempest-VolumesListTestJSON-265208478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea43b999-abbb-4f12-b940-14f5b1989593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-512414458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67eeea5e-df3d-4e61-b324-9a24f36de6d5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='37ee49dbc10f42768341ecd81b4297ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:25:06Z,use_quota=True,user_id='12686284bbe64811b5751fe408d53f7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:06 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5a8ec461-6e6a-44de-be8c-45a6fdd9d227 tempest-VolumesListTestJSON-265208478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12ef9e49-f61a-42cd-815d-873b1f27ac0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:06 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5a8ec461-6e6a-44de-be8c-45a6fdd9d227 tempest-VolumesListTestJSON-265208478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12ef9e49-f61a-42cd-815d-873b1f27ac0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:06 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5a8ec461-6e6a-44de-be8c-45a6fdd9d227 tempest-VolumesListTestJSON-265208478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0416a751-c0e9-44da-a4c7-bfc25e7ecb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:06 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5a8ec461-6e6a-44de-be8c-45a6fdd9d227 tempest-VolumesListTestJSON-265208478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0416a751-c0e9-44da-a4c7-bfc25e7ecb04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67eeea5e-df3d-4e61-b324-9a24f36de6d5', 'volume_name': 'volume-67eeea5e-df3d-4e61-b324-9a24f36de6d5', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:06 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5a8ec461-6e6a-44de-be8c-45a6fdd9d227 tempest-VolumesListTestJSON-265208478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d1a7321-c79a-4443-b71c-0409882dea58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:06 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5a8ec461-6e6a-44de-be8c-45a6fdd9d227 tempest-VolumesListTestJSON-265208478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d1a7321-c79a-4443-b71c-0409882dea58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:06 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5a8ec461-6e6a-44de-be8c-45a6fdd9d227 tempest-VolumesListTestJSON-265208478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31865a60-f7db-47b4-b4ec-99a377c87b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:06 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-5a8ec461-6e6a-44de-be8c-45a6fdd9d227 tempest-VolumesListTestJSON-265208478 None] Volume 67eeea5e-df3d-4e61-b324-9a24f36de6d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67eeea5e-df3d-4e61-b324-9a24f36de6d5', 'volume_size': 1} Sep 03 14:25:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-5a8ec461-6e6a-44de-be8c-45a6fdd9d227 tempest-VolumesListTestJSON-265208478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:25:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-5a8ec461-6e6a-44de-be8c-45a6fdd9d227 tempest-VolumesListTestJSON-265208478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:25:06 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-5a8ec461-6e6a-44de-be8c-45a6fdd9d227 tempest-VolumesListTestJSON-265208478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-512414458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67eeea5e-df3d-4e61-b324-9a24f36de6d5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='37ee49dbc10f42768341ecd81b4297ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:25:06Z,use_quota=True,user_id='12686284bbe64811b5751fe408d53f7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:25:06 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-5a8ec461-6e6a-44de-be8c-45a6fdd9d227 tempest-VolumesListTestJSON-265208478 None] Creating volume 67eeea5e-df3d-4e61-b324-9a24f36de6d5 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:25:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-5a8ec461-6e6a-44de-be8c-45a6fdd9d227 tempest-VolumesListTestJSON-265208478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:25:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-5a8ec461-6e6a-44de-be8c-45a6fdd9d227 tempest-VolumesListTestJSON-265208478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:25:06 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-5a8ec461-6e6a-44de-be8c-45a6fdd9d227 tempest-VolumesListTestJSON-265208478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:25:06 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-5a8ec461-6e6a-44de-be8c-45a6fdd9d227 tempest-VolumesListTestJSON-265208478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:25:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-5a8ec461-6e6a-44de-be8c-45a6fdd9d227 tempest-VolumesListTestJSON-265208478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:25:06 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-5a8ec461-6e6a-44de-be8c-45a6fdd9d227 tempest-VolumesListTestJSON-265208478 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:25:06 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-5a8ec461-6e6a-44de-be8c-45a6fdd9d227 tempest-VolumesListTestJSON-265208478 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:25:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5a8ec461-6e6a-44de-be8c-45a6fdd9d227 tempest-VolumesListTestJSON-265208478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-67eeea5e-df3d-4e61-b324-9a24f36de6d5 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:06 devstack sudo[96730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-67eeea5e-df3d-4e61-b324-9a24f36de6d5 1073741824 Sep 03 14:25:06 devstack sudo[96730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:07 devstack sudo[96730]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5a8ec461-6e6a-44de-be8c-45a6fdd9d227 tempest-VolumesListTestJSON-265208478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-67eeea5e-df3d-4e61-b324-9a24f36de6d5 1073741824" returned: 0 in 0.588s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5a8ec461-6e6a-44de-be8c-45a6fdd9d227 tempest-VolumesListTestJSON-265208478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-67eeea5e-df3d-4e61-b324-9a24f36de6d5 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:07 devstack sudo[96739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-67eeea5e-df3d-4e61-b324-9a24f36de6d5 Sep 03 14:25:07 devstack sudo[96739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:07 devstack sudo[96739]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5a8ec461-6e6a-44de-be8c-45a6fdd9d227 tempest-VolumesListTestJSON-265208478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-67eeea5e-df3d-4e61-b324-9a24f36de6d5" returned: 0 in 0.341s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:07 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-5a8ec461-6e6a-44de-be8c-45a6fdd9d227 tempest-VolumesListTestJSON-265208478 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:25:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-5a8ec461-6e6a-44de-be8c-45a6fdd9d227 tempest-VolumesListTestJSON-265208478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:25:07 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5a8ec461-6e6a-44de-be8c-45a6fdd9d227 tempest-VolumesListTestJSON-265208478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31865a60-f7db-47b4-b4ec-99a377c87b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67eeea5e-df3d-4e61-b324-9a24f36de6d5', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:07 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5a8ec461-6e6a-44de-be8c-45a6fdd9d227 tempest-VolumesListTestJSON-265208478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaa09d13-6ed5-48fd-89b7-2a9652a63b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:07 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-5a8ec461-6e6a-44de-be8c-45a6fdd9d227 tempest-VolumesListTestJSON-265208478 None] Volume volume-67eeea5e-df3d-4e61-b324-9a24f36de6d5 (67eeea5e-df3d-4e61-b324-9a24f36de6d5): created successfully Sep 03 14:25:07 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5a8ec461-6e6a-44de-be8c-45a6fdd9d227 tempest-VolumesListTestJSON-265208478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaa09d13-6ed5-48fd-89b7-2a9652a63b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:07 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5a8ec461-6e6a-44de-be8c-45a6fdd9d227 tempest-VolumesListTestJSON-265208478 None] Flow 'volume_create_manager' (c8e9c4cc-4900-4841-ac3e-f6ebb9248b9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:25:07 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-5a8ec461-6e6a-44de-be8c-45a6fdd9d227 tempest-VolumesListTestJSON-265208478 None] Created volume successfully. Sep 03 14:25:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-9a234ca2-393b-4f41-a8e2-dd5e93dffb0a req-ef55886a-fd0b-4cfb-bc1a-b8a13c2389fc tempest-AttachVolumeNegativeTest-1835626697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:25:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-9a234ca2-393b-4f41-a8e2-dd5e93dffb0a req-ef55886a-fd0b-4cfb-bc1a-b8a13c2389fc tempest-AttachVolumeNegativeTest-1835626697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:25:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-9a234ca2-393b-4f41-a8e2-dd5e93dffb0a req-ef55886a-fd0b-4cfb-bc1a-b8a13c2389fc tempest-AttachVolumeNegativeTest-1835626697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:25:07 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-9a234ca2-393b-4f41-a8e2-dd5e93dffb0a req-ef55886a-fd0b-4cfb-bc1a-b8a13c2389fc tempest-AttachVolumeNegativeTest-1835626697 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713', 'name': 'volume-c34a5dd2-0054-4e18-8c4f-fb46301fa957', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '28a44d83-cdb8-4006-8ed4-11577a9afae6', 'enforce_multipath': True} {{(pid=87007) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 14:25:07 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-9a234ca2-393b-4f41-a8e2-dd5e93dffb0a req-ef55886a-fd0b-4cfb-bc1a-b8a13c2389fc tempest-AttachVolumeNegativeTest-1835626697 None] attachment_update completed successfully. Sep 03 14:25:08 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5d519382-fdda-49b4-9c09-d265472a6548 tempest-BackendsCapabilitiesAdminTestsJSON-1308825148 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8406867980957, 'free_capacity_gb': 1773.8406867980957, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87007) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 03 14:25:08 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-08bcf97d-3119-4add-86db-b020e9883ead tempest-BackendsCapabilitiesAdminTestsJSON-1308825148 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8406867980957, 'free_capacity_gb': 1773.8406867980957, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87007) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 03 14:25:09 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a2137e1-4132-4ddc-abe6-9d31d0bd55a2 tempest-VolumesListTestJSON-265208478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:25:09 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7a2137e1-4132-4ddc-abe6-9d31d0bd55a2 tempest-VolumesListTestJSON-265208478 None] Flow 'volume_create_manager' (3df383c7-1021-4a41-898a-eadd46e4662d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:25:09 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7a2137e1-4132-4ddc-abe6-9d31d0bd55a2 tempest-VolumesListTestJSON-265208478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c7e32ee-e8ea-4c39-bbab-24ec3432ac7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:09 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7a2137e1-4132-4ddc-abe6-9d31d0bd55a2 tempest-VolumesListTestJSON-265208478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c7e32ee-e8ea-4c39-bbab-24ec3432ac7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1532613311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a1072a6-2978-478a-bdff-465c843f91b2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='37ee49dbc10f42768341ecd81b4297ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:25:09Z,use_quota=True,user_id='12686284bbe64811b5751fe408d53f7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:09 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7a2137e1-4132-4ddc-abe6-9d31d0bd55a2 tempest-VolumesListTestJSON-265208478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95423716-5658-4784-a44e-89bad429a26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:09 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7a2137e1-4132-4ddc-abe6-9d31d0bd55a2 tempest-VolumesListTestJSON-265208478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95423716-5658-4784-a44e-89bad429a26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:09 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7a2137e1-4132-4ddc-abe6-9d31d0bd55a2 tempest-VolumesListTestJSON-265208478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea1ca0d0-2d76-4d45-90ed-2a03707c5f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:09 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7a2137e1-4132-4ddc-abe6-9d31d0bd55a2 tempest-VolumesListTestJSON-265208478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea1ca0d0-2d76-4d45-90ed-2a03707c5f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a1072a6-2978-478a-bdff-465c843f91b2', 'volume_name': 'volume-9a1072a6-2978-478a-bdff-465c843f91b2', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:09 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7a2137e1-4132-4ddc-abe6-9d31d0bd55a2 tempest-VolumesListTestJSON-265208478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4a5e64b-f873-4da2-a6f0-92bd2dae2b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:09 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7a2137e1-4132-4ddc-abe6-9d31d0bd55a2 tempest-VolumesListTestJSON-265208478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4a5e64b-f873-4da2-a6f0-92bd2dae2b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:09 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7a2137e1-4132-4ddc-abe6-9d31d0bd55a2 tempest-VolumesListTestJSON-265208478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e51121ce-e4d8-4204-8ab6-cfd9f494c43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:09 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-7a2137e1-4132-4ddc-abe6-9d31d0bd55a2 tempest-VolumesListTestJSON-265208478 None] Volume 9a1072a6-2978-478a-bdff-465c843f91b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a1072a6-2978-478a-bdff-465c843f91b2', 'volume_size': 1} Sep 03 14:25:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7a2137e1-4132-4ddc-abe6-9d31d0bd55a2 tempest-VolumesListTestJSON-265208478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:25:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7a2137e1-4132-4ddc-abe6-9d31d0bd55a2 tempest-VolumesListTestJSON-265208478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:25:09 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-7a2137e1-4132-4ddc-abe6-9d31d0bd55a2 tempest-VolumesListTestJSON-265208478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1532613311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a1072a6-2978-478a-bdff-465c843f91b2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='37ee49dbc10f42768341ecd81b4297ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:25:09Z,use_quota=True,user_id='12686284bbe64811b5751fe408d53f7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:25:09 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-7a2137e1-4132-4ddc-abe6-9d31d0bd55a2 tempest-VolumesListTestJSON-265208478 None] Creating volume 9a1072a6-2978-478a-bdff-465c843f91b2 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:25:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7a2137e1-4132-4ddc-abe6-9d31d0bd55a2 tempest-VolumesListTestJSON-265208478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:25:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7a2137e1-4132-4ddc-abe6-9d31d0bd55a2 tempest-VolumesListTestJSON-265208478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:25:09 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-7a2137e1-4132-4ddc-abe6-9d31d0bd55a2 tempest-VolumesListTestJSON-265208478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:25:09 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-7a2137e1-4132-4ddc-abe6-9d31d0bd55a2 tempest-VolumesListTestJSON-265208478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:25:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7a2137e1-4132-4ddc-abe6-9d31d0bd55a2 tempest-VolumesListTestJSON-265208478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:25:09 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-7a2137e1-4132-4ddc-abe6-9d31d0bd55a2 tempest-VolumesListTestJSON-265208478 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:25:09 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-7a2137e1-4132-4ddc-abe6-9d31d0bd55a2 tempest-VolumesListTestJSON-265208478 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:25:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7a2137e1-4132-4ddc-abe6-9d31d0bd55a2 tempest-VolumesListTestJSON-265208478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9a1072a6-2978-478a-bdff-465c843f91b2 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:09 devstack sudo[97133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9a1072a6-2978-478a-bdff-465c843f91b2 1073741824 Sep 03 14:25:09 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:09 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7a2137e1-4132-4ddc-abe6-9d31d0bd55a2 tempest-VolumesListTestJSON-265208478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9a1072a6-2978-478a-bdff-465c843f91b2 1073741824" returned: 0 in 0.583s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7a2137e1-4132-4ddc-abe6-9d31d0bd55a2 tempest-VolumesListTestJSON-265208478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9a1072a6-2978-478a-bdff-465c843f91b2 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:09 devstack sudo[97139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9a1072a6-2978-478a-bdff-465c843f91b2 Sep 03 14:25:09 devstack sudo[97139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:10 devstack sudo[97139]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7a2137e1-4132-4ddc-abe6-9d31d0bd55a2 tempest-VolumesListTestJSON-265208478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9a1072a6-2978-478a-bdff-465c843f91b2" returned: 0 in 0.327s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:10 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-7a2137e1-4132-4ddc-abe6-9d31d0bd55a2 tempest-VolumesListTestJSON-265208478 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:25:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7a2137e1-4132-4ddc-abe6-9d31d0bd55a2 tempest-VolumesListTestJSON-265208478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:25:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7a2137e1-4132-4ddc-abe6-9d31d0bd55a2 tempest-VolumesListTestJSON-265208478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e51121ce-e4d8-4204-8ab6-cfd9f494c43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a1072a6-2978-478a-bdff-465c843f91b2', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7a2137e1-4132-4ddc-abe6-9d31d0bd55a2 tempest-VolumesListTestJSON-265208478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4cca68b-813f-4c87-ad1b-cc10b7fe3da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:10 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-7a2137e1-4132-4ddc-abe6-9d31d0bd55a2 tempest-VolumesListTestJSON-265208478 None] Volume volume-9a1072a6-2978-478a-bdff-465c843f91b2 (9a1072a6-2978-478a-bdff-465c843f91b2): created successfully Sep 03 14:25:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7a2137e1-4132-4ddc-abe6-9d31d0bd55a2 tempest-VolumesListTestJSON-265208478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4cca68b-813f-4c87-ad1b-cc10b7fe3da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7a2137e1-4132-4ddc-abe6-9d31d0bd55a2 tempest-VolumesListTestJSON-265208478 None] Flow 'volume_create_manager' (3df383c7-1021-4a41-898a-eadd46e4662d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:25:10 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-7a2137e1-4132-4ddc-abe6-9d31d0bd55a2 tempest-VolumesListTestJSON-265208478 None] Created volume successfully. Sep 03 14:25:10 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-19de7fe0-3caf-4d11-b8dd-a87be8ecff22 req-ee2bac6f-721a-45da-992a-d72a513cdedb tempest-AttachVolumeNegativeTest-1835626697 None] Terminate volume connection completed successfully. Sep 03 14:25:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-19de7fe0-3caf-4d11-b8dd-a87be8ecff22 req-ee2bac6f-721a-45da-992a-d72a513cdedb tempest-AttachVolumeNegativeTest-1835626697 None] Deleting attachment 28a44d83-cdb8-4006-8ed4-11577a9afae6. {{(pid=87007) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 14:25:12 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-d46f2623-a1f0-4d43-845d-b828311c802c tempest-VolumesListTestJSON-265208478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:25:12 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d46f2623-a1f0-4d43-845d-b828311c802c tempest-VolumesListTestJSON-265208478 None] Flow 'volume_create_manager' (7a08f76a-6638-461a-9dc5-35a05e9297c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:25:12 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d46f2623-a1f0-4d43-845d-b828311c802c tempest-VolumesListTestJSON-265208478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f023b2a8-a053-4f56-b0de-cc7dbb44bbfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:12 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d46f2623-a1f0-4d43-845d-b828311c802c tempest-VolumesListTestJSON-265208478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f023b2a8-a053-4f56-b0de-cc7dbb44bbfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-120330754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dabf8bb-1205-4a22-b89a-bdec2b7a6637,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='37ee49dbc10f42768341ecd81b4297ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:25:12Z,use_quota=True,user_id='12686284bbe64811b5751fe408d53f7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:12 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d46f2623-a1f0-4d43-845d-b828311c802c tempest-VolumesListTestJSON-265208478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d1ba511-8131-43f3-82eb-fd9b768c098b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:12 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d46f2623-a1f0-4d43-845d-b828311c802c tempest-VolumesListTestJSON-265208478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d1ba511-8131-43f3-82eb-fd9b768c098b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:12 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d46f2623-a1f0-4d43-845d-b828311c802c tempest-VolumesListTestJSON-265208478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96cdbe9f-d3c1-4b52-8bd2-cc0dfa8ed933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:12 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d46f2623-a1f0-4d43-845d-b828311c802c tempest-VolumesListTestJSON-265208478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96cdbe9f-d3c1-4b52-8bd2-cc0dfa8ed933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dabf8bb-1205-4a22-b89a-bdec2b7a6637', 'volume_name': 'volume-7dabf8bb-1205-4a22-b89a-bdec2b7a6637', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:12 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d46f2623-a1f0-4d43-845d-b828311c802c tempest-VolumesListTestJSON-265208478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5094d76-6d61-4171-9b44-ba64b3fc9b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:12 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d46f2623-a1f0-4d43-845d-b828311c802c tempest-VolumesListTestJSON-265208478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5094d76-6d61-4171-9b44-ba64b3fc9b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:12 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d46f2623-a1f0-4d43-845d-b828311c802c tempest-VolumesListTestJSON-265208478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e99ccf9-f479-47b1-beb9-202be0140bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:12 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-d46f2623-a1f0-4d43-845d-b828311c802c tempest-VolumesListTestJSON-265208478 None] Volume 7dabf8bb-1205-4a22-b89a-bdec2b7a6637: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dabf8bb-1205-4a22-b89a-bdec2b7a6637', 'volume_size': 1} Sep 03 14:25:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d46f2623-a1f0-4d43-845d-b828311c802c tempest-VolumesListTestJSON-265208478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:25:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d46f2623-a1f0-4d43-845d-b828311c802c tempest-VolumesListTestJSON-265208478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:25:12 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d46f2623-a1f0-4d43-845d-b828311c802c tempest-VolumesListTestJSON-265208478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-120330754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dabf8bb-1205-4a22-b89a-bdec2b7a6637,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='37ee49dbc10f42768341ecd81b4297ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:25:12Z,use_quota=True,user_id='12686284bbe64811b5751fe408d53f7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:25:12 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-d46f2623-a1f0-4d43-845d-b828311c802c tempest-VolumesListTestJSON-265208478 None] Creating volume 7dabf8bb-1205-4a22-b89a-bdec2b7a6637 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:25:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d46f2623-a1f0-4d43-845d-b828311c802c tempest-VolumesListTestJSON-265208478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:25:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d46f2623-a1f0-4d43-845d-b828311c802c tempest-VolumesListTestJSON-265208478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:25:12 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d46f2623-a1f0-4d43-845d-b828311c802c tempest-VolumesListTestJSON-265208478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:25:12 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d46f2623-a1f0-4d43-845d-b828311c802c tempest-VolumesListTestJSON-265208478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:25:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d46f2623-a1f0-4d43-845d-b828311c802c tempest-VolumesListTestJSON-265208478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:25:12 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d46f2623-a1f0-4d43-845d-b828311c802c tempest-VolumesListTestJSON-265208478 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:25:12 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-d46f2623-a1f0-4d43-845d-b828311c802c tempest-VolumesListTestJSON-265208478 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:25:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d46f2623-a1f0-4d43-845d-b828311c802c tempest-VolumesListTestJSON-265208478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7dabf8bb-1205-4a22-b89a-bdec2b7a6637 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:12 devstack sudo[97256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7dabf8bb-1205-4a22-b89a-bdec2b7a6637 1073741824 Sep 03 14:25:12 devstack sudo[97256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:12 devstack sudo[97256]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d46f2623-a1f0-4d43-845d-b828311c802c tempest-VolumesListTestJSON-265208478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7dabf8bb-1205-4a22-b89a-bdec2b7a6637 1073741824" returned: 0 in 0.755s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d46f2623-a1f0-4d43-845d-b828311c802c tempest-VolumesListTestJSON-265208478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7dabf8bb-1205-4a22-b89a-bdec2b7a6637 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:12 devstack sudo[97282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7dabf8bb-1205-4a22-b89a-bdec2b7a6637 Sep 03 14:25:12 devstack sudo[97282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:13 devstack sudo[97282]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d46f2623-a1f0-4d43-845d-b828311c802c tempest-VolumesListTestJSON-265208478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7dabf8bb-1205-4a22-b89a-bdec2b7a6637" returned: 0 in 0.361s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:13 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d46f2623-a1f0-4d43-845d-b828311c802c tempest-VolumesListTestJSON-265208478 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:25:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d46f2623-a1f0-4d43-845d-b828311c802c tempest-VolumesListTestJSON-265208478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:25:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d46f2623-a1f0-4d43-845d-b828311c802c tempest-VolumesListTestJSON-265208478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e99ccf9-f479-47b1-beb9-202be0140bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dabf8bb-1205-4a22-b89a-bdec2b7a6637', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d46f2623-a1f0-4d43-845d-b828311c802c tempest-VolumesListTestJSON-265208478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b87cc71-0a92-4f97-a483-c7b7c6f2f56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:13 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-d46f2623-a1f0-4d43-845d-b828311c802c tempest-VolumesListTestJSON-265208478 None] Volume volume-7dabf8bb-1205-4a22-b89a-bdec2b7a6637 (7dabf8bb-1205-4a22-b89a-bdec2b7a6637): created successfully Sep 03 14:25:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d46f2623-a1f0-4d43-845d-b828311c802c tempest-VolumesListTestJSON-265208478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b87cc71-0a92-4f97-a483-c7b7c6f2f56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d46f2623-a1f0-4d43-845d-b828311c802c tempest-VolumesListTestJSON-265208478 None] Flow 'volume_create_manager' (7a08f76a-6638-461a-9dc5-35a05e9297c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:25:13 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-d46f2623-a1f0-4d43-845d-b828311c802c tempest-VolumesListTestJSON-265208478 None] Created volume successfully. Sep 03 14:25:17 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b51aaf45-0a88-49c0-bc95-1509580f8335 tempest-VolumesListTestJSON-265208478 None] Acquiring lock "cinder-7dabf8bb-1205-4a22-b89a-bdec2b7a6637-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:25:17 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b51aaf45-0a88-49c0-bc95-1509580f8335 tempest-VolumesListTestJSON-265208478 None] Lock "cinder-7dabf8bb-1205-4a22-b89a-bdec2b7a6637-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:25:17 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b51aaf45-0a88-49c0-bc95-1509580f8335 tempest-VolumesListTestJSON-265208478 None] Acquiring lock "cinder-quobyte-7dabf8bb-1205-4a22-b89a-bdec2b7a6637" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:25:17 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b51aaf45-0a88-49c0-bc95-1509580f8335 tempest-VolumesListTestJSON-265208478 None] Lock "cinder-quobyte-7dabf8bb-1205-4a22-b89a-bdec2b7a6637" acquired by "delete_volume" :: waited 0.020s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:25:17 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edb3e3a-bc5a-49de-bf99-e1c7663b7228]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:25:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b51aaf45-0a88-49c0-bc95-1509580f8335 tempest-VolumesListTestJSON-265208478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7dabf8bb-1205-4a22-b89a-bdec2b7a6637 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:17 devstack sudo[97291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7dabf8bb-1205-4a22-b89a-bdec2b7a6637 Sep 03 14:25:17 devstack sudo[97291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:17 devstack sudo[97291]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b51aaf45-0a88-49c0-bc95-1509580f8335 tempest-VolumesListTestJSON-265208478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7dabf8bb-1205-4a22-b89a-bdec2b7a6637" returned: 0 in 0.509s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b51aaf45-0a88-49c0-bc95-1509580f8335 tempest-VolumesListTestJSON-265208478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7dabf8bb-1205-4a22-b89a-bdec2b7a6637 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:17 devstack sudo[97296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7dabf8bb-1205-4a22-b89a-bdec2b7a6637 Sep 03 14:25:17 devstack sudo[97296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:18 devstack sudo[97296]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b51aaf45-0a88-49c0-bc95-1509580f8335 tempest-VolumesListTestJSON-265208478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7dabf8bb-1205-4a22-b89a-bdec2b7a6637" returned: 0 in 0.362s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:18 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b51aaf45-0a88-49c0-bc95-1509580f8335 tempest-VolumesListTestJSON-265208478 None] Lock "cinder-quobyte-7dabf8bb-1205-4a22-b89a-bdec2b7a6637" released by "delete_volume" :: held 0.941s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:25:18 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-b51aaf45-0a88-49c0-bc95-1509580f8335 tempest-VolumesListTestJSON-265208478 None] Created reservations ['1fe23be3-e18b-42bd-8ba1-213cecba9a2e', 'a808c90e-6922-4037-b3d2-73537c5d2a5a', 'b3326deb-17de-4e17-9a42-60e84b72fcf6', 'b883ea7e-c4bc-46b9-a45d-71b5a0b536eb'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:25:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b51aaf45-0a88-49c0-bc95-1509580f8335 tempest-VolumesListTestJSON-265208478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:25:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b51aaf45-0a88-49c0-bc95-1509580f8335 tempest-VolumesListTestJSON-265208478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:25:18 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b51aaf45-0a88-49c0-bc95-1509580f8335 tempest-VolumesListTestJSON-265208478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:25:18 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b51aaf45-0a88-49c0-bc95-1509580f8335 tempest-VolumesListTestJSON-265208478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:25:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b51aaf45-0a88-49c0-bc95-1509580f8335 tempest-VolumesListTestJSON-265208478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:25:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b51aaf45-0a88-49c0-bc95-1509580f8335 tempest-VolumesListTestJSON-265208478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:18 devstack sudo[97299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:25:18 devstack sudo[97299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:18 devstack sudo[97299]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b51aaf45-0a88-49c0-bc95-1509580f8335 tempest-VolumesListTestJSON-265208478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.298s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:18 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-b51aaf45-0a88-49c0-bc95-1509580f8335 tempest-VolumesListTestJSON-265208478 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:25:18 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-b51aaf45-0a88-49c0-bc95-1509580f8335 tempest-VolumesListTestJSON-265208478 None] Deleted volume successfully. Sep 03 14:25:18 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b51aaf45-0a88-49c0-bc95-1509580f8335 tempest-VolumesListTestJSON-265208478 None] Lock "cinder-7dabf8bb-1205-4a22-b89a-bdec2b7a6637-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:25:19 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-e6c4ec92-fd8f-4c19-9398-8deacdeb6af6 tempest-VolumesListTestJSON-265208478 None] Acquiring lock "cinder-9a1072a6-2978-478a-bdff-465c843f91b2-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:25:19 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-e6c4ec92-fd8f-4c19-9398-8deacdeb6af6 tempest-VolumesListTestJSON-265208478 None] Lock "cinder-9a1072a6-2978-478a-bdff-465c843f91b2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:25:19 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d42cdfd-f08c-408f-8966-802f4f7e5c26 tempest-VolumesListAdminTestJSON-1774154643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:25:19 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6d42cdfd-f08c-408f-8966-802f4f7e5c26 tempest-VolumesListAdminTestJSON-1774154643 None] Flow 'volume_create_manager' (c47c03f1-ea77-43be-8a9c-e12602d61dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:25:19 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6d42cdfd-f08c-408f-8966-802f4f7e5c26 tempest-VolumesListAdminTestJSON-1774154643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1615b5a-766b-4bad-826c-93e7980b8964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:19 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-e6c4ec92-fd8f-4c19-9398-8deacdeb6af6 tempest-VolumesListTestJSON-265208478 None] Acquiring lock "cinder-quobyte-9a1072a6-2978-478a-bdff-465c843f91b2" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:25:19 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6d42cdfd-f08c-408f-8966-802f4f7e5c26 tempest-VolumesListAdminTestJSON-1774154643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1615b5a-766b-4bad-826c-93e7980b8964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:25:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1846369480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba36c23b-f1c8-4855-8090-f64453a5f5dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7c2ee04eb945aaa3c701bcec9edeac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:25:20Z,use_quota=True,user_id='c8e958cceafe40f29ce091b8feb55dbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:19 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6d42cdfd-f08c-408f-8966-802f4f7e5c26 tempest-VolumesListAdminTestJSON-1774154643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97304bdc-4095-4b1a-a3ae-490d966e8766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:19 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6d42cdfd-f08c-408f-8966-802f4f7e5c26 tempest-VolumesListAdminTestJSON-1774154643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97304bdc-4095-4b1a-a3ae-490d966e8766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:19 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6d42cdfd-f08c-408f-8966-802f4f7e5c26 tempest-VolumesListAdminTestJSON-1774154643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a38bf36-ee79-4fdf-9446-6a7fab126fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:19 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6d42cdfd-f08c-408f-8966-802f4f7e5c26 tempest-VolumesListAdminTestJSON-1774154643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a38bf36-ee79-4fdf-9446-6a7fab126fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba36c23b-f1c8-4855-8090-f64453a5f5dd', 'volume_name': 'volume-ba36c23b-f1c8-4855-8090-f64453a5f5dd', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:19 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6d42cdfd-f08c-408f-8966-802f4f7e5c26 tempest-VolumesListAdminTestJSON-1774154643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcef03b4-bad0-4c08-b29c-e6f5b06b264a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:19 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6d42cdfd-f08c-408f-8966-802f4f7e5c26 tempest-VolumesListAdminTestJSON-1774154643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcef03b4-bad0-4c08-b29c-e6f5b06b264a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:19 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6d42cdfd-f08c-408f-8966-802f4f7e5c26 tempest-VolumesListAdminTestJSON-1774154643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90aacf51-b6b2-4c46-a91d-bc218028c41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:19 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-6d42cdfd-f08c-408f-8966-802f4f7e5c26 tempest-VolumesListAdminTestJSON-1774154643 None] Volume ba36c23b-f1c8-4855-8090-f64453a5f5dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba36c23b-f1c8-4855-8090-f64453a5f5dd', 'volume_size': 1} Sep 03 14:25:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6d42cdfd-f08c-408f-8966-802f4f7e5c26 tempest-VolumesListAdminTestJSON-1774154643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:25:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6d42cdfd-f08c-408f-8966-802f4f7e5c26 tempest-VolumesListAdminTestJSON-1774154643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:25:19 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-6d42cdfd-f08c-408f-8966-802f4f7e5c26 tempest-VolumesListAdminTestJSON-1774154643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:25:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1846369480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba36c23b-f1c8-4855-8090-f64453a5f5dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7c2ee04eb945aaa3c701bcec9edeac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:25:20Z,use_quota=True,user_id='c8e958cceafe40f29ce091b8feb55dbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:25:19 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-6d42cdfd-f08c-408f-8966-802f4f7e5c26 tempest-VolumesListAdminTestJSON-1774154643 None] Creating volume ba36c23b-f1c8-4855-8090-f64453a5f5dd {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:25:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6d42cdfd-f08c-408f-8966-802f4f7e5c26 tempest-VolumesListAdminTestJSON-1774154643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:25:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6d42cdfd-f08c-408f-8966-802f4f7e5c26 tempest-VolumesListAdminTestJSON-1774154643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:25:19 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-6d42cdfd-f08c-408f-8966-802f4f7e5c26 tempest-VolumesListAdminTestJSON-1774154643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:25:19 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-6d42cdfd-f08c-408f-8966-802f4f7e5c26 tempest-VolumesListAdminTestJSON-1774154643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:25:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6d42cdfd-f08c-408f-8966-802f4f7e5c26 tempest-VolumesListAdminTestJSON-1774154643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:25:19 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-6d42cdfd-f08c-408f-8966-802f4f7e5c26 tempest-VolumesListAdminTestJSON-1774154643 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:25:19 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-6d42cdfd-f08c-408f-8966-802f4f7e5c26 tempest-VolumesListAdminTestJSON-1774154643 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:25:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6d42cdfd-f08c-408f-8966-802f4f7e5c26 tempest-VolumesListAdminTestJSON-1774154643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ba36c23b-f1c8-4855-8090-f64453a5f5dd 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:19 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-e6c4ec92-fd8f-4c19-9398-8deacdeb6af6 tempest-VolumesListTestJSON-265208478 None] Lock "cinder-quobyte-9a1072a6-2978-478a-bdff-465c843f91b2" acquired by "delete_volume" :: waited 0.101s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:25:19 devstack sudo[97302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ba36c23b-f1c8-4855-8090-f64453a5f5dd 1073741824 Sep 03 14:25:19 devstack sudo[97302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:19 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc5e460-ad8c-4b50-adb1-032b912b9d70]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:25:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e6c4ec92-fd8f-4c19-9398-8deacdeb6af6 tempest-VolumesListTestJSON-265208478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9a1072a6-2978-478a-bdff-465c843f91b2 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:19 devstack sudo[97304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9a1072a6-2978-478a-bdff-465c843f91b2 Sep 03 14:25:19 devstack sudo[97304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:20 devstack sudo[97304]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e6c4ec92-fd8f-4c19-9398-8deacdeb6af6 tempest-VolumesListTestJSON-265208478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9a1072a6-2978-478a-bdff-465c843f91b2" returned: 0 in 0.413s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e6c4ec92-fd8f-4c19-9398-8deacdeb6af6 tempest-VolumesListTestJSON-265208478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9a1072a6-2978-478a-bdff-465c843f91b2 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:20 devstack sudo[97314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9a1072a6-2978-478a-bdff-465c843f91b2 Sep 03 14:25:20 devstack sudo[97314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:20 devstack sudo[97302]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6d42cdfd-f08c-408f-8966-802f4f7e5c26 tempest-VolumesListAdminTestJSON-1774154643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ba36c23b-f1c8-4855-8090-f64453a5f5dd 1073741824" returned: 0 in 0.606s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6d42cdfd-f08c-408f-8966-802f4f7e5c26 tempest-VolumesListAdminTestJSON-1774154643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ba36c23b-f1c8-4855-8090-f64453a5f5dd {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:20 devstack sudo[97316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ba36c23b-f1c8-4855-8090-f64453a5f5dd Sep 03 14:25:20 devstack sudo[97316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:20 devstack sudo[97314]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e6c4ec92-fd8f-4c19-9398-8deacdeb6af6 tempest-VolumesListTestJSON-265208478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9a1072a6-2978-478a-bdff-465c843f91b2" returned: 0 in 0.363s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:20 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-e6c4ec92-fd8f-4c19-9398-8deacdeb6af6 tempest-VolumesListTestJSON-265208478 None] Lock "cinder-quobyte-9a1072a6-2978-478a-bdff-465c843f91b2" released by "delete_volume" :: held 0.839s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:25:20 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-e6c4ec92-fd8f-4c19-9398-8deacdeb6af6 tempest-VolumesListTestJSON-265208478 None] Created reservations ['4dcfec21-5b91-4613-bda2-c0b0b286c69b', '4372b790-9a58-4cb0-be86-8d5911e3c7d1', 'f08f7ee4-6a8d-4233-b178-ec1fa94e91a8', '3b34d832-aa39-448e-bbd0-0f25e984f24e'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:25:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-e6c4ec92-fd8f-4c19-9398-8deacdeb6af6 tempest-VolumesListTestJSON-265208478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:25:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-e6c4ec92-fd8f-4c19-9398-8deacdeb6af6 tempest-VolumesListTestJSON-265208478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:25:20 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-e6c4ec92-fd8f-4c19-9398-8deacdeb6af6 tempest-VolumesListTestJSON-265208478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:25:20 devstack sudo[97316]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:20 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-e6c4ec92-fd8f-4c19-9398-8deacdeb6af6 tempest-VolumesListTestJSON-265208478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:25:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-e6c4ec92-fd8f-4c19-9398-8deacdeb6af6 tempest-VolumesListTestJSON-265208478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:25:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e6c4ec92-fd8f-4c19-9398-8deacdeb6af6 tempest-VolumesListTestJSON-265208478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6d42cdfd-f08c-408f-8966-802f4f7e5c26 tempest-VolumesListAdminTestJSON-1774154643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ba36c23b-f1c8-4855-8090-f64453a5f5dd" returned: 0 in 0.423s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:20 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-6d42cdfd-f08c-408f-8966-802f4f7e5c26 tempest-VolumesListAdminTestJSON-1774154643 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:25:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6d42cdfd-f08c-408f-8966-802f4f7e5c26 tempest-VolumesListAdminTestJSON-1774154643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:25:20 devstack sudo[97323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:25:20 devstack sudo[97323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:20 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6d42cdfd-f08c-408f-8966-802f4f7e5c26 tempest-VolumesListAdminTestJSON-1774154643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90aacf51-b6b2-4c46-a91d-bc218028c41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba36c23b-f1c8-4855-8090-f64453a5f5dd', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:20 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6d42cdfd-f08c-408f-8966-802f4f7e5c26 tempest-VolumesListAdminTestJSON-1774154643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fa18e5b-80d7-4864-aef1-9f1ec4b3710a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:20 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-6d42cdfd-f08c-408f-8966-802f4f7e5c26 tempest-VolumesListAdminTestJSON-1774154643 None] Volume volume-ba36c23b-f1c8-4855-8090-f64453a5f5dd (ba36c23b-f1c8-4855-8090-f64453a5f5dd): created successfully Sep 03 14:25:20 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6d42cdfd-f08c-408f-8966-802f4f7e5c26 tempest-VolumesListAdminTestJSON-1774154643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fa18e5b-80d7-4864-aef1-9f1ec4b3710a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:20 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6d42cdfd-f08c-408f-8966-802f4f7e5c26 tempest-VolumesListAdminTestJSON-1774154643 None] Flow 'volume_create_manager' (c47c03f1-ea77-43be-8a9c-e12602d61dc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:25:20 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-6d42cdfd-f08c-408f-8966-802f4f7e5c26 tempest-VolumesListAdminTestJSON-1774154643 None] Created volume successfully. Sep 03 14:25:21 devstack sudo[97323]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e6c4ec92-fd8f-4c19-9398-8deacdeb6af6 tempest-VolumesListTestJSON-265208478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.303s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:21 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-e6c4ec92-fd8f-4c19-9398-8deacdeb6af6 tempest-VolumesListTestJSON-265208478 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:25:21 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-e6c4ec92-fd8f-4c19-9398-8deacdeb6af6 tempest-VolumesListTestJSON-265208478 None] Deleted volume successfully. Sep 03 14:25:21 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-e6c4ec92-fd8f-4c19-9398-8deacdeb6af6 tempest-VolumesListTestJSON-265208478 None] Lock "cinder-9a1072a6-2978-478a-bdff-465c843f91b2-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:25:22 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-4fef9e4e-f7b4-4163-93ec-5c5318cde8d0 tempest-GroupsV314Test-220542306 None] Group tempest-GroupsV314Test-Group-1186186207: creating Sep 03 14:25:22 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-4fef9e4e-f7b4-4163-93ec-5c5318cde8d0 tempest-GroupsV314Test-220542306 None] Group tempest-GroupsV314Test-Group-1186186207: created successfully Sep 03 14:25:22 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-4fef9e4e-f7b4-4163-93ec-5c5318cde8d0 tempest-GroupsV314Test-220542306 None] Create group completed successfully. Sep 03 14:25:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-242fdb6b-badd-4c85-a328-a069356c3dac tempest-VolumesListTestJSON-265208478 None] Acquiring lock "cinder-67eeea5e-df3d-4e61-b324-9a24f36de6d5-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:25:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-242fdb6b-badd-4c85-a328-a069356c3dac tempest-VolumesListTestJSON-265208478 None] Lock "cinder-67eeea5e-df3d-4e61-b324-9a24f36de6d5-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:25:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-242fdb6b-badd-4c85-a328-a069356c3dac tempest-VolumesListTestJSON-265208478 None] Acquiring lock "cinder-quobyte-67eeea5e-df3d-4e61-b324-9a24f36de6d5" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:25:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-242fdb6b-badd-4c85-a328-a069356c3dac tempest-VolumesListTestJSON-265208478 None] Lock "cinder-quobyte-67eeea5e-df3d-4e61-b324-9a24f36de6d5" acquired by "delete_volume" :: waited 0.036s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:25:22 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-56bdb7b2-917a-43e2-b2f3-afaf5b429747 tempest-VolumesListAdminTestJSON-1774154643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:25:22 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-56bdb7b2-917a-43e2-b2f3-afaf5b429747 tempest-VolumesListAdminTestJSON-1774154643 None] Flow 'volume_create_manager' (8250b521-eb5e-4b6a-b5d0-ba7226e64116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:25:22 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-56bdb7b2-917a-43e2-b2f3-afaf5b429747 tempest-VolumesListAdminTestJSON-1774154643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc348553-8325-4c62-b790-60f11fa36ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:22 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[65142620-19e3-4009-8b04-0c1f6ed0c5d7]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:25:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-242fdb6b-badd-4c85-a328-a069356c3dac tempest-VolumesListTestJSON-265208478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-67eeea5e-df3d-4e61-b324-9a24f36de6d5 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:22 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-56bdb7b2-917a-43e2-b2f3-afaf5b429747 tempest-VolumesListAdminTestJSON-1774154643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc348553-8325-4c62-b790-60f11fa36ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-485763120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f16799c8-412e-4085-8e8e-6b75abcc4988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7c2ee04eb945aaa3c701bcec9edeac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:25:22Z,use_quota=True,user_id='c8e958cceafe40f29ce091b8feb55dbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:22 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-56bdb7b2-917a-43e2-b2f3-afaf5b429747 tempest-VolumesListAdminTestJSON-1774154643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e1249dd-efa5-492a-9b73-1fb9ba3d2af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:22 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-56bdb7b2-917a-43e2-b2f3-afaf5b429747 tempest-VolumesListAdminTestJSON-1774154643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e1249dd-efa5-492a-9b73-1fb9ba3d2af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:22 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-56bdb7b2-917a-43e2-b2f3-afaf5b429747 tempest-VolumesListAdminTestJSON-1774154643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a1f6c81-03bc-4ca8-945f-c7bb746a1a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:22 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-56bdb7b2-917a-43e2-b2f3-afaf5b429747 tempest-VolumesListAdminTestJSON-1774154643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a1f6c81-03bc-4ca8-945f-c7bb746a1a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f16799c8-412e-4085-8e8e-6b75abcc4988', 'volume_name': 'volume-f16799c8-412e-4085-8e8e-6b75abcc4988', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:22 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-56bdb7b2-917a-43e2-b2f3-afaf5b429747 tempest-VolumesListAdminTestJSON-1774154643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (744e5891-da46-4607-9aaf-f926c4baa968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:22 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-56bdb7b2-917a-43e2-b2f3-afaf5b429747 tempest-VolumesListAdminTestJSON-1774154643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (744e5891-da46-4607-9aaf-f926c4baa968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:22 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-56bdb7b2-917a-43e2-b2f3-afaf5b429747 tempest-VolumesListAdminTestJSON-1774154643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6e5085d-75d2-4aa9-8a39-34c49d849c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:22 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-56bdb7b2-917a-43e2-b2f3-afaf5b429747 tempest-VolumesListAdminTestJSON-1774154643 None] Volume f16799c8-412e-4085-8e8e-6b75abcc4988: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f16799c8-412e-4085-8e8e-6b75abcc4988', 'volume_size': 1} Sep 03 14:25:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-56bdb7b2-917a-43e2-b2f3-afaf5b429747 tempest-VolumesListAdminTestJSON-1774154643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:25:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-56bdb7b2-917a-43e2-b2f3-afaf5b429747 tempest-VolumesListAdminTestJSON-1774154643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:25:22 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-56bdb7b2-917a-43e2-b2f3-afaf5b429747 tempest-VolumesListAdminTestJSON-1774154643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-485763120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f16799c8-412e-4085-8e8e-6b75abcc4988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7c2ee04eb945aaa3c701bcec9edeac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:25:22Z,use_quota=True,user_id='c8e958cceafe40f29ce091b8feb55dbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:25:22 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-56bdb7b2-917a-43e2-b2f3-afaf5b429747 tempest-VolumesListAdminTestJSON-1774154643 None] Creating volume f16799c8-412e-4085-8e8e-6b75abcc4988 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:25:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-56bdb7b2-917a-43e2-b2f3-afaf5b429747 tempest-VolumesListAdminTestJSON-1774154643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:25:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-56bdb7b2-917a-43e2-b2f3-afaf5b429747 tempest-VolumesListAdminTestJSON-1774154643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:25:22 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-56bdb7b2-917a-43e2-b2f3-afaf5b429747 tempest-VolumesListAdminTestJSON-1774154643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:25:22 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-56bdb7b2-917a-43e2-b2f3-afaf5b429747 tempest-VolumesListAdminTestJSON-1774154643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:25:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-56bdb7b2-917a-43e2-b2f3-afaf5b429747 tempest-VolumesListAdminTestJSON-1774154643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:25:22 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-56bdb7b2-917a-43e2-b2f3-afaf5b429747 tempest-VolumesListAdminTestJSON-1774154643 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:25:22 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-56bdb7b2-917a-43e2-b2f3-afaf5b429747 tempest-VolumesListAdminTestJSON-1774154643 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:25:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-56bdb7b2-917a-43e2-b2f3-afaf5b429747 tempest-VolumesListAdminTestJSON-1774154643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f16799c8-412e-4085-8e8e-6b75abcc4988 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:22 devstack sudo[97332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-67eeea5e-df3d-4e61-b324-9a24f36de6d5 Sep 03 14:25:22 devstack sudo[97332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:22 devstack sudo[97338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f16799c8-412e-4085-8e8e-6b75abcc4988 1073741824 Sep 03 14:25:22 devstack sudo[97338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:23 devstack sudo[97332]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-242fdb6b-badd-4c85-a328-a069356c3dac tempest-VolumesListTestJSON-265208478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-67eeea5e-df3d-4e61-b324-9a24f36de6d5" returned: 0 in 0.493s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-242fdb6b-badd-4c85-a328-a069356c3dac tempest-VolumesListTestJSON-265208478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-67eeea5e-df3d-4e61-b324-9a24f36de6d5 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:23 devstack sudo[97347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-67eeea5e-df3d-4e61-b324-9a24f36de6d5 Sep 03 14:25:23 devstack sudo[97347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:23 devstack sudo[97347]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-242fdb6b-badd-4c85-a328-a069356c3dac tempest-VolumesListTestJSON-265208478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-67eeea5e-df3d-4e61-b324-9a24f36de6d5" returned: 0 in 0.367s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:23 devstack sudo[97338]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-56bdb7b2-917a-43e2-b2f3-afaf5b429747 tempest-VolumesListAdminTestJSON-1774154643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f16799c8-412e-4085-8e8e-6b75abcc4988 1073741824" returned: 0 in 0.787s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:23 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-242fdb6b-badd-4c85-a328-a069356c3dac tempest-VolumesListTestJSON-265208478 None] Lock "cinder-quobyte-67eeea5e-df3d-4e61-b324-9a24f36de6d5" released by "delete_volume" :: held 0.956s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:25:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-56bdb7b2-917a-43e2-b2f3-afaf5b429747 tempest-VolumesListAdminTestJSON-1774154643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f16799c8-412e-4085-8e8e-6b75abcc4988 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:23 devstack sudo[97360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f16799c8-412e-4085-8e8e-6b75abcc4988 Sep 03 14:25:23 devstack sudo[97360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:23 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-242fdb6b-badd-4c85-a328-a069356c3dac tempest-VolumesListTestJSON-265208478 None] Created reservations ['9508107b-73d2-43d8-8625-cfe028679af8', '2ff6e0d8-7e0d-43b1-adfe-7ec3e80a57a2', '0b29f777-a4f1-453d-aa91-15cc3db6049e', '9abaaa28-99e4-459e-b8e6-a3f40e0dff71'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:25:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-242fdb6b-badd-4c85-a328-a069356c3dac tempest-VolumesListTestJSON-265208478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:25:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-242fdb6b-badd-4c85-a328-a069356c3dac tempest-VolumesListTestJSON-265208478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:25:23 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-242fdb6b-badd-4c85-a328-a069356c3dac tempest-VolumesListTestJSON-265208478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:25:23 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-242fdb6b-badd-4c85-a328-a069356c3dac tempest-VolumesListTestJSON-265208478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:25:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-242fdb6b-badd-4c85-a328-a069356c3dac tempest-VolumesListTestJSON-265208478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:25:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-242fdb6b-badd-4c85-a328-a069356c3dac tempest-VolumesListTestJSON-265208478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:23 devstack sudo[97362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:25:23 devstack sudo[97362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:23 devstack sudo[97360]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-56bdb7b2-917a-43e2-b2f3-afaf5b429747 tempest-VolumesListAdminTestJSON-1774154643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f16799c8-412e-4085-8e8e-6b75abcc4988" returned: 0 in 0.392s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:23 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-56bdb7b2-917a-43e2-b2f3-afaf5b429747 tempest-VolumesListAdminTestJSON-1774154643 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:25:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-56bdb7b2-917a-43e2-b2f3-afaf5b429747 tempest-VolumesListAdminTestJSON-1774154643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:25:23 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-56bdb7b2-917a-43e2-b2f3-afaf5b429747 tempest-VolumesListAdminTestJSON-1774154643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6e5085d-75d2-4aa9-8a39-34c49d849c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f16799c8-412e-4085-8e8e-6b75abcc4988', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:23 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-56bdb7b2-917a-43e2-b2f3-afaf5b429747 tempest-VolumesListAdminTestJSON-1774154643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e912fdc3-5f92-4e30-abdf-7126db685e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:23 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-56bdb7b2-917a-43e2-b2f3-afaf5b429747 tempest-VolumesListAdminTestJSON-1774154643 None] Volume volume-f16799c8-412e-4085-8e8e-6b75abcc4988 (f16799c8-412e-4085-8e8e-6b75abcc4988): created successfully Sep 03 14:25:23 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-56bdb7b2-917a-43e2-b2f3-afaf5b429747 tempest-VolumesListAdminTestJSON-1774154643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e912fdc3-5f92-4e30-abdf-7126db685e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:23 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-56bdb7b2-917a-43e2-b2f3-afaf5b429747 tempest-VolumesListAdminTestJSON-1774154643 None] Flow 'volume_create_manager' (8250b521-eb5e-4b6a-b5d0-ba7226e64116) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:25:23 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-56bdb7b2-917a-43e2-b2f3-afaf5b429747 tempest-VolumesListAdminTestJSON-1774154643 None] Created volume successfully. Sep 03 14:25:24 devstack sudo[97362]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-242fdb6b-badd-4c85-a328-a069356c3dac tempest-VolumesListTestJSON-265208478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.385s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:24 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-242fdb6b-badd-4c85-a328-a069356c3dac tempest-VolumesListTestJSON-265208478 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:25:24 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-242fdb6b-badd-4c85-a328-a069356c3dac tempest-VolumesListTestJSON-265208478 None] Deleted volume successfully. Sep 03 14:25:24 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-242fdb6b-badd-4c85-a328-a069356c3dac tempest-VolumesListTestJSON-265208478 None] Lock "cinder-67eeea5e-df3d-4e61-b324-9a24f36de6d5-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:25:24 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-83265870-36b4-4aac-b936-63ac908a1ffa tempest-GroupsV314Test-220542306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:25:24 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-83265870-36b4-4aac-b936-63ac908a1ffa tempest-GroupsV314Test-220542306 None] Flow 'volume_create_manager' (a134d4db-88c6-4465-8f02-1454644cb165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:25:24 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-83265870-36b4-4aac-b936-63ac908a1ffa tempest-GroupsV314Test-220542306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a82206c-a736-44f9-bf6d-64cd04379049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:24 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-83265870-36b4-4aac-b936-63ac908a1ffa tempest-GroupsV314Test-220542306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a82206c-a736-44f9-bf6d-64cd04379049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-180259260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c0a5897b-b369-421f-b8cc-96fa85cb7d92,host='devstack@QuobyteHD#QuobyteHD',id=28a69133-f9d1-420d-899a-12b3453c1a4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e689b83a25041859b4b3007bc347b0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:25:24Z,use_quota=True,user_id='aa829aa76ec64c239a8610bb9480d68d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bac45a98-d459-4a1f-9e10-6dfdb94fb78b),volume_type_id=bac45a98-d459-4a1f-9e10-6dfdb94fb78b)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:24 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-83265870-36b4-4aac-b936-63ac908a1ffa tempest-GroupsV314Test-220542306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d21b7ef-b765-4780-838a-0b3d14c07d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:24 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-83265870-36b4-4aac-b936-63ac908a1ffa tempest-GroupsV314Test-220542306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d21b7ef-b765-4780-838a-0b3d14c07d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:24 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-83265870-36b4-4aac-b936-63ac908a1ffa tempest-GroupsV314Test-220542306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b397d7b5-fa90-4a84-8591-0365fbbe7f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:24 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-83265870-36b4-4aac-b936-63ac908a1ffa tempest-GroupsV314Test-220542306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b397d7b5-fa90-4a84-8591-0365fbbe7f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28a69133-f9d1-420d-899a-12b3453c1a4f', 'volume_name': 'volume-28a69133-f9d1-420d-899a-12b3453c1a4f', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:24 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-83265870-36b4-4aac-b936-63ac908a1ffa tempest-GroupsV314Test-220542306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7685b70-0cca-4731-9e17-1b5403a69d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:24 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-83265870-36b4-4aac-b936-63ac908a1ffa tempest-GroupsV314Test-220542306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7685b70-0cca-4731-9e17-1b5403a69d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:24 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-83265870-36b4-4aac-b936-63ac908a1ffa tempest-GroupsV314Test-220542306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (091f73d0-5bf0-46ef-85b4-1dcfc9b57ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:24 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-83265870-36b4-4aac-b936-63ac908a1ffa tempest-GroupsV314Test-220542306 None] Volume 28a69133-f9d1-420d-899a-12b3453c1a4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28a69133-f9d1-420d-899a-12b3453c1a4f', 'volume_size': 1} Sep 03 14:25:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-83265870-36b4-4aac-b936-63ac908a1ffa tempest-GroupsV314Test-220542306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:25:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-83265870-36b4-4aac-b936-63ac908a1ffa tempest-GroupsV314Test-220542306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:25:24 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-83265870-36b4-4aac-b936-63ac908a1ffa tempest-GroupsV314Test-220542306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c0a5897b-b369-421f-b8cc-96fa85cb7d92,created_at=2026-09-03T12:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-180259260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c0a5897b-b369-421f-b8cc-96fa85cb7d92,host='devstack@QuobyteHD#QuobyteHD',id=28a69133-f9d1-420d-899a-12b3453c1a4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e689b83a25041859b4b3007bc347b0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:25:24Z,use_quota=True,user_id='aa829aa76ec64c239a8610bb9480d68d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bac45a98-d459-4a1f-9e10-6dfdb94fb78b),volume_type_id=bac45a98-d459-4a1f-9e10-6dfdb94fb78b)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:25:24 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-83265870-36b4-4aac-b936-63ac908a1ffa tempest-GroupsV314Test-220542306 None] Creating volume 28a69133-f9d1-420d-899a-12b3453c1a4f {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:25:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-83265870-36b4-4aac-b936-63ac908a1ffa tempest-GroupsV314Test-220542306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:25:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-83265870-36b4-4aac-b936-63ac908a1ffa tempest-GroupsV314Test-220542306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:25:24 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-83265870-36b4-4aac-b936-63ac908a1ffa tempest-GroupsV314Test-220542306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:25:24 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-83265870-36b4-4aac-b936-63ac908a1ffa tempest-GroupsV314Test-220542306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:25:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-83265870-36b4-4aac-b936-63ac908a1ffa tempest-GroupsV314Test-220542306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:25:24 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-83265870-36b4-4aac-b936-63ac908a1ffa tempest-GroupsV314Test-220542306 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:25:24 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-83265870-36b4-4aac-b936-63ac908a1ffa tempest-GroupsV314Test-220542306 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:25:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-83265870-36b4-4aac-b936-63ac908a1ffa tempest-GroupsV314Test-220542306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:24 devstack sudo[97372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f 1073741824 Sep 03 14:25:24 devstack sudo[97372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:24 devstack sudo[97372]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-83265870-36b4-4aac-b936-63ac908a1ffa tempest-GroupsV314Test-220542306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f 1073741824" returned: 0 in 0.607s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-83265870-36b4-4aac-b936-63ac908a1ffa tempest-GroupsV314Test-220542306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:24 devstack sudo[97379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f Sep 03 14:25:24 devstack sudo[97379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:25 devstack sudo[97379]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-83265870-36b4-4aac-b936-63ac908a1ffa tempest-GroupsV314Test-220542306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f" returned: 0 in 0.404s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:25 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-83265870-36b4-4aac-b936-63ac908a1ffa tempest-GroupsV314Test-220542306 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:25:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-83265870-36b4-4aac-b936-63ac908a1ffa tempest-GroupsV314Test-220542306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:25:25 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-83265870-36b4-4aac-b936-63ac908a1ffa tempest-GroupsV314Test-220542306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (091f73d0-5bf0-46ef-85b4-1dcfc9b57ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28a69133-f9d1-420d-899a-12b3453c1a4f', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:25 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-83265870-36b4-4aac-b936-63ac908a1ffa tempest-GroupsV314Test-220542306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2cb854b-c31e-4d35-9e86-94a5fdd3f233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:25 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e71e6ec-c1da-41fe-bfbc-41df9ded849b tempest-VolumesListAdminTestJSON-1774154643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:25:25 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5e71e6ec-c1da-41fe-bfbc-41df9ded849b tempest-VolumesListAdminTestJSON-1774154643 None] Flow 'volume_create_manager' (6a5e9a82-8cb7-45fc-8cd3-df5518b58a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:25:25 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5e71e6ec-c1da-41fe-bfbc-41df9ded849b tempest-VolumesListAdminTestJSON-1774154643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f67c2c6-8f5b-412d-9a0d-41892879bae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:25 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-83265870-36b4-4aac-b936-63ac908a1ffa tempest-GroupsV314Test-220542306 None] Volume volume-28a69133-f9d1-420d-899a-12b3453c1a4f (28a69133-f9d1-420d-899a-12b3453c1a4f): created successfully Sep 03 14:25:25 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-83265870-36b4-4aac-b936-63ac908a1ffa tempest-GroupsV314Test-220542306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2cb854b-c31e-4d35-9e86-94a5fdd3f233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:25 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-83265870-36b4-4aac-b936-63ac908a1ffa tempest-GroupsV314Test-220542306 None] Flow 'volume_create_manager' (a134d4db-88c6-4465-8f02-1454644cb165) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:25:25 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5e71e6ec-c1da-41fe-bfbc-41df9ded849b tempest-VolumesListAdminTestJSON-1774154643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f67c2c6-8f5b-412d-9a0d-41892879bae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-969392765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95e3bba5-1cba-479e-bc70-c1ca1a158641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7c2ee04eb945aaa3c701bcec9edeac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:25:25Z,use_quota=True,user_id='c8e958cceafe40f29ce091b8feb55dbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:25 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5e71e6ec-c1da-41fe-bfbc-41df9ded849b tempest-VolumesListAdminTestJSON-1774154643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (548dd3fd-c7bd-44c6-b22e-3d934a054582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:25 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5e71e6ec-c1da-41fe-bfbc-41df9ded849b tempest-VolumesListAdminTestJSON-1774154643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (548dd3fd-c7bd-44c6-b22e-3d934a054582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:25 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5e71e6ec-c1da-41fe-bfbc-41df9ded849b tempest-VolumesListAdminTestJSON-1774154643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d9e90e4-423c-4f48-bcbf-f899147f85a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:25 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5e71e6ec-c1da-41fe-bfbc-41df9ded849b tempest-VolumesListAdminTestJSON-1774154643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d9e90e4-423c-4f48-bcbf-f899147f85a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95e3bba5-1cba-479e-bc70-c1ca1a158641', 'volume_name': 'volume-95e3bba5-1cba-479e-bc70-c1ca1a158641', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:25 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5e71e6ec-c1da-41fe-bfbc-41df9ded849b tempest-VolumesListAdminTestJSON-1774154643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38510d1a-d21c-4295-8852-529c8b678b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:25 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5e71e6ec-c1da-41fe-bfbc-41df9ded849b tempest-VolumesListAdminTestJSON-1774154643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38510d1a-d21c-4295-8852-529c8b678b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:25 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5e71e6ec-c1da-41fe-bfbc-41df9ded849b tempest-VolumesListAdminTestJSON-1774154643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e2ba242-a669-42b9-87ba-01f6abd669af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:25 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-5e71e6ec-c1da-41fe-bfbc-41df9ded849b tempest-VolumesListAdminTestJSON-1774154643 None] Volume 95e3bba5-1cba-479e-bc70-c1ca1a158641: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95e3bba5-1cba-479e-bc70-c1ca1a158641', 'volume_size': 1} Sep 03 14:25:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-5e71e6ec-c1da-41fe-bfbc-41df9ded849b tempest-VolumesListAdminTestJSON-1774154643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:25:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-5e71e6ec-c1da-41fe-bfbc-41df9ded849b tempest-VolumesListAdminTestJSON-1774154643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:25:25 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-5e71e6ec-c1da-41fe-bfbc-41df9ded849b tempest-VolumesListAdminTestJSON-1774154643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-969392765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95e3bba5-1cba-479e-bc70-c1ca1a158641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7c2ee04eb945aaa3c701bcec9edeac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:25:25Z,use_quota=True,user_id='c8e958cceafe40f29ce091b8feb55dbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:25:25 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-5e71e6ec-c1da-41fe-bfbc-41df9ded849b tempest-VolumesListAdminTestJSON-1774154643 None] Creating volume 95e3bba5-1cba-479e-bc70-c1ca1a158641 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:25:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-5e71e6ec-c1da-41fe-bfbc-41df9ded849b tempest-VolumesListAdminTestJSON-1774154643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:25:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-5e71e6ec-c1da-41fe-bfbc-41df9ded849b tempest-VolumesListAdminTestJSON-1774154643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:25:25 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-5e71e6ec-c1da-41fe-bfbc-41df9ded849b tempest-VolumesListAdminTestJSON-1774154643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:25:25 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-5e71e6ec-c1da-41fe-bfbc-41df9ded849b tempest-VolumesListAdminTestJSON-1774154643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:25:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-5e71e6ec-c1da-41fe-bfbc-41df9ded849b tempest-VolumesListAdminTestJSON-1774154643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:25:25 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-5e71e6ec-c1da-41fe-bfbc-41df9ded849b tempest-VolumesListAdminTestJSON-1774154643 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:25:25 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-5e71e6ec-c1da-41fe-bfbc-41df9ded849b tempest-VolumesListAdminTestJSON-1774154643 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:25:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5e71e6ec-c1da-41fe-bfbc-41df9ded849b tempest-VolumesListAdminTestJSON-1774154643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-95e3bba5-1cba-479e-bc70-c1ca1a158641 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:25 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-83265870-36b4-4aac-b936-63ac908a1ffa tempest-GroupsV314Test-220542306 None] Created volume successfully. Sep 03 14:25:25 devstack sudo[97402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-95e3bba5-1cba-479e-bc70-c1ca1a158641 1073741824 Sep 03 14:25:25 devstack sudo[97402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:26 devstack sudo[97402]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5e71e6ec-c1da-41fe-bfbc-41df9ded849b tempest-VolumesListAdminTestJSON-1774154643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-95e3bba5-1cba-479e-bc70-c1ca1a158641 1073741824" returned: 0 in 0.936s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5e71e6ec-c1da-41fe-bfbc-41df9ded849b tempest-VolumesListAdminTestJSON-1774154643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-95e3bba5-1cba-479e-bc70-c1ca1a158641 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:26 devstack sudo[97454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-95e3bba5-1cba-479e-bc70-c1ca1a158641 Sep 03 14:25:26 devstack sudo[97454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:27 devstack sudo[97454]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5e71e6ec-c1da-41fe-bfbc-41df9ded849b tempest-VolumesListAdminTestJSON-1774154643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-95e3bba5-1cba-479e-bc70-c1ca1a158641" returned: 0 in 0.459s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:27 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-5e71e6ec-c1da-41fe-bfbc-41df9ded849b tempest-VolumesListAdminTestJSON-1774154643 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:25:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-5e71e6ec-c1da-41fe-bfbc-41df9ded849b tempest-VolumesListAdminTestJSON-1774154643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:25:27 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5e71e6ec-c1da-41fe-bfbc-41df9ded849b tempest-VolumesListAdminTestJSON-1774154643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e2ba242-a669-42b9-87ba-01f6abd669af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95e3bba5-1cba-479e-bc70-c1ca1a158641', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:27 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5e71e6ec-c1da-41fe-bfbc-41df9ded849b tempest-VolumesListAdminTestJSON-1774154643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa27209f-6965-4bb7-a3cc-7798b67ec389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:27 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-5e71e6ec-c1da-41fe-bfbc-41df9ded849b tempest-VolumesListAdminTestJSON-1774154643 None] Volume volume-95e3bba5-1cba-479e-bc70-c1ca1a158641 (95e3bba5-1cba-479e-bc70-c1ca1a158641): created successfully Sep 03 14:25:27 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5e71e6ec-c1da-41fe-bfbc-41df9ded849b tempest-VolumesListAdminTestJSON-1774154643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa27209f-6965-4bb7-a3cc-7798b67ec389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:27 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5e71e6ec-c1da-41fe-bfbc-41df9ded849b tempest-VolumesListAdminTestJSON-1774154643 None] Flow 'volume_create_manager' (6a5e9a82-8cb7-45fc-8cd3-df5518b58a12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:25:27 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-5e71e6ec-c1da-41fe-bfbc-41df9ded849b tempest-VolumesListAdminTestJSON-1774154643 None] Created volume successfully. Sep 03 14:25:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:25:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:25:28 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] Cloning volume 28a69133-f9d1-420d-899a-12b3453c1a4f to volume ec7249a2-ef6f-4fb4-ae16-0ec3f0d5b1d1 Sep 03 14:25:28 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] Creating offline snapshot aa91723e-5350-4096-a59c-516fc151fff6 of volume 28a69133-f9d1-420d-899a-12b3453c1a4f {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:25:28 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b0f818-4fa3-4d5c-b50f-4a85bdb8ad00]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:25:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:28 devstack sudo[97460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f Sep 03 14:25:28 devstack sudo[97460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:28 devstack sudo[97460]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f" returned: 0 in 0.688s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f.aa91723e-5350-4096-a59c-516fc151fff6 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:29 devstack sudo[97465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f.aa91723e-5350-4096-a59c-516fc151fff6 1G Sep 03 14:25:29 devstack sudo[97465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:29 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e24c8fd-6033-45de-8e38-3c7a4d311fad tempest-VolumesListAdminTestJSON-1592582828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:25:29 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-9e24c8fd-6033-45de-8e38-3c7a4d311fad tempest-VolumesListAdminTestJSON-1592582828 None] Flow 'volume_create_manager' (59830df6-150a-4c6f-86c5-fce771654bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:25:29 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-9e24c8fd-6033-45de-8e38-3c7a4d311fad tempest-VolumesListAdminTestJSON-1592582828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d2db38e-56da-44e3-886d-f598268a509a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:29 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-9e24c8fd-6033-45de-8e38-3c7a4d311fad tempest-VolumesListAdminTestJSON-1592582828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d2db38e-56da-44e3-886d-f598268a509a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21c2e7a7-8512-4f53-839e-79c709bc5584,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60942febb6b442baa687f6b8e258acc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:25:29Z,use_quota=True,user_id='2433dda0b1104e5d952ef9ca39bea9e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:29 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-9e24c8fd-6033-45de-8e38-3c7a4d311fad tempest-VolumesListAdminTestJSON-1592582828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (604078b0-61f9-4ebc-b045-e863851e922b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:29 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-9e24c8fd-6033-45de-8e38-3c7a4d311fad tempest-VolumesListAdminTestJSON-1592582828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (604078b0-61f9-4ebc-b045-e863851e922b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:29 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-9e24c8fd-6033-45de-8e38-3c7a4d311fad tempest-VolumesListAdminTestJSON-1592582828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec1982f8-3952-421d-a7b9-f91655290d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:29 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-9e24c8fd-6033-45de-8e38-3c7a4d311fad tempest-VolumesListAdminTestJSON-1592582828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec1982f8-3952-421d-a7b9-f91655290d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21c2e7a7-8512-4f53-839e-79c709bc5584', 'volume_name': 'volume-21c2e7a7-8512-4f53-839e-79c709bc5584', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:29 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-9e24c8fd-6033-45de-8e38-3c7a4d311fad tempest-VolumesListAdminTestJSON-1592582828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37caf159-45e5-4fc4-812d-64f981696891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:29 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-9e24c8fd-6033-45de-8e38-3c7a4d311fad tempest-VolumesListAdminTestJSON-1592582828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37caf159-45e5-4fc4-812d-64f981696891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:29 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-9e24c8fd-6033-45de-8e38-3c7a4d311fad tempest-VolumesListAdminTestJSON-1592582828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (425f635d-96bd-4548-8f5b-751bcb710fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:29 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-9e24c8fd-6033-45de-8e38-3c7a4d311fad tempest-VolumesListAdminTestJSON-1592582828 None] Volume 21c2e7a7-8512-4f53-839e-79c709bc5584: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21c2e7a7-8512-4f53-839e-79c709bc5584', 'volume_size': 1} Sep 03 14:25:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-9e24c8fd-6033-45de-8e38-3c7a4d311fad tempest-VolumesListAdminTestJSON-1592582828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:25:29 devstack sudo[97465]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f.aa91723e-5350-4096-a59c-516fc151fff6 1G" returned: 0 in 0.711s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28a69133-f9d1-420d-899a-12b3453c1a4f -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f.aa91723e-5350-4096-a59c-516fc151fff6 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:29 devstack sudo[97470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28a69133-f9d1-420d-899a-12b3453c1a4f -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f.aa91723e-5350-4096-a59c-516fc151fff6 Sep 03 14:25:29 devstack sudo[97470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:30 devstack sudo[97470]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28a69133-f9d1-420d-899a-12b3453c1a4f -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f.aa91723e-5350-4096-a59c-516fc151fff6" returned: 0 in 0.523s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:30 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f.aa91723e-5350-4096-a59c-516fc151fff6 is being set with open permissions: ugo+rw: NotImplementedError Sep 03 14:25:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f.aa91723e-5350-4096-a59c-516fc151fff6 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:30 devstack sudo[97476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f.aa91723e-5350-4096-a59c-516fc151fff6 Sep 03 14:25:30 devstack sudo[97476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:30 devstack sudo[97476]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f.aa91723e-5350-4096-a59c-516fc151fff6" returned: 0 in 0.329s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:30 devstack sudo[97479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f.info Sep 03 14:25:30 devstack sudo[97479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:30 devstack sudo[97479]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f.info" returned: 0 in 0.341s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:30 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f.info is being set with open permissions: ugo+rw: NotImplementedError Sep 03 14:25:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:30 devstack sudo[97483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f.info Sep 03 14:25:30 devstack sudo[97483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:31 devstack sudo[97483]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f.info" returned: 0 in 0.404s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:31 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] Acquiring lock "cinder-quobyte-ec7249a2-ef6f-4fb4-ae16-0ec3f0d5b1d1" by "_copy_volume_from_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:25:31 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] Lock "cinder-quobyte-ec7249a2-ef6f-4fb4-ae16-0ec3f0d5b1d1" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:25:31 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] snapshot: aa91723e-5350-4096-a59c-516fc151fff6, volume: ec7249a2-ef6f-4fb4-ae16-0ec3f0d5b1d1, {{(pid=87007) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 14:25:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:25:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:25:31 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:25:31 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:25:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:25:31 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb06518-97ee-4228-b3a1-f2d6d68eb9f5]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:25:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f.aa91723e-5350-4096-a59c-516fc151fff6 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:31 devstack sudo[97486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f.aa91723e-5350-4096-a59c-516fc151fff6 Sep 03 14:25:31 devstack sudo[97486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:31 devstack sudo[97486]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f.aa91723e-5350-4096-a59c-516fc151fff6" returned: 0 in 0.437s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:31 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28a69133-f9d1-420d-899a-12b3453c1a4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:25:31 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca85fe7d-5f77-44e5-af5b-3fa47a5ff350]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:25:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:31 devstack sudo[97491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f Sep 03 14:25:31 devstack sudo[97491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:32 devstack sudo[97491]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f" returned: 0 in 0.431s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:32 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f {{(pid=87007) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 14:25:32 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] Creating direct copy from snapshot {{(pid=87007) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 14:25:32 devstack cinder-volume[87007]: DEBUG cinder.utils [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] Path /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec7249a2-ef6f-4fb4-ae16-0ec3f0d5b1d1 not found in is_blk_device check {{(pid=87007) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 14:25:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec7249a2-ef6f-4fb4-ae16-0ec3f0d5b1d1 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:32 devstack sudo[97496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec7249a2-ef6f-4fb4-ae16-0ec3f0d5b1d1 Sep 03 14:25:32 devstack sudo[97496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:39 devstack sudo[97496]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec7249a2-ef6f-4fb4-ae16-0ec3f0d5b1d1" returned: 0 in 6.846s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:39 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] Image conversion details: src /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f, size 1024.00 MB, duration 6.85 sec, destination /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec7249a2-ef6f-4fb4-ae16-0ec3f0d5b1d1 {{(pid=87007) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 14:25:39 devstack cinder-volume[87007]: INFO cinder.image.image_utils [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] Converted 1024.00 MB image at 149.52 MB/s Sep 03 14:25:39 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec7249a2-ef6f-4fb4-ae16-0ec3f0d5b1d1 is being set with open permissions: ugo+rw: NotImplementedError Sep 03 14:25:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec7249a2-ef6f-4fb4-ae16-0ec3f0d5b1d1 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:39 devstack sudo[97511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec7249a2-ef6f-4fb4-ae16-0ec3f0d5b1d1 Sep 03 14:25:39 devstack sudo[97511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:39 devstack sudo[97511]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec7249a2-ef6f-4fb4-ae16-0ec3f0d5b1d1" returned: 0 in 0.296s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:39 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] Lock "cinder-quobyte-ec7249a2-ef6f-4fb4-ae16-0ec3f0d5b1d1" released by "_copy_volume_from_snapshot" :: held 8.093s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:25:39 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] Acquiring lock "cinder-quobyte-aa91723e-5350-4096-a59c-516fc151fff6" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:25:39 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] Lock "cinder-quobyte-aa91723e-5350-4096-a59c-516fc151fff6" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:25:39 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] Deleting offline snapshot aa91723e-5350-4096-a59c-516fc151fff6 of volume 28a69133-f9d1-420d-899a-12b3453c1a4f {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:25:39 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] snapshot_file for this snap is: volume-28a69133-f9d1-420d-899a-12b3453c1a4f.aa91723e-5350-4096-a59c-516fc151fff6 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:25:39 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2144e859-4947-432d-9e90-f137081e8c7f]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:25:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f.aa91723e-5350-4096-a59c-516fc151fff6 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:39 devstack sudo[97532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f.aa91723e-5350-4096-a59c-516fc151fff6 Sep 03 14:25:39 devstack sudo[97532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:40 devstack sudo[97532]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f.aa91723e-5350-4096-a59c-516fc151fff6" returned: 0 in 0.444s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:40 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28a69133-f9d1-420d-899a-12b3453c1a4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:25:40 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[46858ef9-3774-43e9-9332-28846b840888]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:25:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:40 devstack sudo[97537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f Sep 03 14:25:40 devstack sudo[97537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:40 devstack sudo[97537]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f" returned: 0 in 0.510s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f.aa91723e-5350-4096-a59c-516fc151fff6 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:40 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:INSERT=14,cinder:UPDATE=69,cinder:SELECT=63,cinder:DELETE=8 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:25:40 devstack sudo[97542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f.aa91723e-5350-4096-a59c-516fc151fff6 Sep 03 14:25:40 devstack sudo[97542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:40 devstack sudo[97542]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f.aa91723e-5350-4096-a59c-516fc151fff6" returned: 0 in 0.413s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f.aa91723e-5350-4096-a59c-516fc151fff6 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:41 devstack sudo[97548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f.aa91723e-5350-4096-a59c-516fc151fff6 Sep 03 14:25:41 devstack sudo[97548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:41 devstack sudo[97548]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f.aa91723e-5350-4096-a59c-516fc151fff6" returned: 0 in 0.267s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:41 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] Lock "cinder-quobyte-aa91723e-5350-4096-a59c-516fc151fff6" released by "_delete_snapshot" :: held 1.759s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:25:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.160s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:25:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-9e24c8fd-6033-45de-8e38-3c7a4d311fad tempest-VolumesListAdminTestJSON-1592582828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.079s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:25:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-9e24c8fd-6033-45de-8e38-3c7a4d311fad tempest-VolumesListAdminTestJSON-1592582828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21c2e7a7-8512-4f53-839e-79c709bc5584,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60942febb6b442baa687f6b8e258acc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:25:29Z,use_quota=True,user_id='2433dda0b1104e5d952ef9ca39bea9e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:25:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-9e24c8fd-6033-45de-8e38-3c7a4d311fad tempest-VolumesListAdminTestJSON-1592582828 None] Creating volume 21c2e7a7-8512-4f53-839e-79c709bc5584 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:25:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-9e24c8fd-6033-45de-8e38-3c7a4d311fad tempest-VolumesListAdminTestJSON-1592582828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:25:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-9e24c8fd-6033-45de-8e38-3c7a4d311fad tempest-VolumesListAdminTestJSON-1592582828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:25:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-9e24c8fd-6033-45de-8e38-3c7a4d311fad tempest-VolumesListAdminTestJSON-1592582828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:25:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-9e24c8fd-6033-45de-8e38-3c7a4d311fad tempest-VolumesListAdminTestJSON-1592582828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:25:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-9e24c8fd-6033-45de-8e38-3c7a4d311fad tempest-VolumesListAdminTestJSON-1592582828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:25:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-9e24c8fd-6033-45de-8e38-3c7a4d311fad tempest-VolumesListAdminTestJSON-1592582828 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:25:41 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-9e24c8fd-6033-45de-8e38-3c7a4d311fad tempest-VolumesListAdminTestJSON-1592582828 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:25:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9e24c8fd-6033-45de-8e38-3c7a4d311fad tempest-VolumesListAdminTestJSON-1592582828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-21c2e7a7-8512-4f53-839e-79c709bc5584 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:41 devstack sudo[97551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-21c2e7a7-8512-4f53-839e-79c709bc5584 1073741824 Sep 03 14:25:41 devstack sudo[97551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:41 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-c5c14be7-3f49-4d4f-9d5f-0c32becf623e tempest-GroupsV314Test-220542306 None] Create group from source-group-c0a5897b-b369-421f-b8cc-96fa85cb7d92 completed successfully. Sep 03 14:25:41 devstack sudo[97551]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9e24c8fd-6033-45de-8e38-3c7a4d311fad tempest-VolumesListAdminTestJSON-1592582828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-21c2e7a7-8512-4f53-839e-79c709bc5584 1073741824" returned: 0 in 0.533s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9e24c8fd-6033-45de-8e38-3c7a4d311fad tempest-VolumesListAdminTestJSON-1592582828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-21c2e7a7-8512-4f53-839e-79c709bc5584 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:41 devstack sudo[97557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-21c2e7a7-8512-4f53-839e-79c709bc5584 Sep 03 14:25:41 devstack sudo[97557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:42 devstack sudo[97557]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9e24c8fd-6033-45de-8e38-3c7a4d311fad tempest-VolumesListAdminTestJSON-1592582828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-21c2e7a7-8512-4f53-839e-79c709bc5584" returned: 0 in 0.282s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:42 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-9e24c8fd-6033-45de-8e38-3c7a4d311fad tempest-VolumesListAdminTestJSON-1592582828 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:25:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-9e24c8fd-6033-45de-8e38-3c7a4d311fad tempest-VolumesListAdminTestJSON-1592582828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:25:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-9e24c8fd-6033-45de-8e38-3c7a4d311fad tempest-VolumesListAdminTestJSON-1592582828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (425f635d-96bd-4548-8f5b-751bcb710fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21c2e7a7-8512-4f53-839e-79c709bc5584', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-9e24c8fd-6033-45de-8e38-3c7a4d311fad tempest-VolumesListAdminTestJSON-1592582828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a06d2cd-8a18-41dc-aaba-b1035d780f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:42 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-9e24c8fd-6033-45de-8e38-3c7a4d311fad tempest-VolumesListAdminTestJSON-1592582828 None] Volume volume-21c2e7a7-8512-4f53-839e-79c709bc5584 (21c2e7a7-8512-4f53-839e-79c709bc5584): created successfully Sep 03 14:25:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-9e24c8fd-6033-45de-8e38-3c7a4d311fad tempest-VolumesListAdminTestJSON-1592582828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a06d2cd-8a18-41dc-aaba-b1035d780f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-9e24c8fd-6033-45de-8e38-3c7a4d311fad tempest-VolumesListAdminTestJSON-1592582828 None] Flow 'volume_create_manager' (59830df6-150a-4c6f-86c5-fce771654bb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:25:42 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-9e24c8fd-6033-45de-8e38-3c7a4d311fad tempest-VolumesListAdminTestJSON-1592582828 None] Created volume successfully. Sep 03 14:25:42 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-4ef64295-e150-4897-b1b8-84a630614ebd tempest-GroupsV314Test-220542306 None] Acquiring lock "cinder-quobyte-ec7249a2-ef6f-4fb4-ae16-0ec3f0d5b1d1" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:25:42 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-4ef64295-e150-4897-b1b8-84a630614ebd tempest-GroupsV314Test-220542306 None] Lock "cinder-quobyte-ec7249a2-ef6f-4fb4-ae16-0ec3f0d5b1d1" acquired by "delete_volume" :: waited 0.022s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:25:42 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2188ddb9-b203-45a4-875b-e2a8f5f71b9d]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:25:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4ef64295-e150-4897-b1b8-84a630614ebd tempest-GroupsV314Test-220542306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec7249a2-ef6f-4fb4-ae16-0ec3f0d5b1d1 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:42 devstack sudo[97560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec7249a2-ef6f-4fb4-ae16-0ec3f0d5b1d1 Sep 03 14:25:42 devstack sudo[97560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:42 devstack sudo[97560]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4ef64295-e150-4897-b1b8-84a630614ebd tempest-GroupsV314Test-220542306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec7249a2-ef6f-4fb4-ae16-0ec3f0d5b1d1" returned: 0 in 0.364s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4ef64295-e150-4897-b1b8-84a630614ebd tempest-GroupsV314Test-220542306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec7249a2-ef6f-4fb4-ae16-0ec3f0d5b1d1 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:42 devstack sudo[97565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec7249a2-ef6f-4fb4-ae16-0ec3f0d5b1d1 Sep 03 14:25:42 devstack sudo[97565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:43 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a1d67f18-1148-421e-90d9-957522fc0cca tempest-VolumesListAdminTestJSON-1592582828 None] Acquiring lock "cinder-21c2e7a7-8512-4f53-839e-79c709bc5584-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:25:43 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a1d67f18-1148-421e-90d9-957522fc0cca tempest-VolumesListAdminTestJSON-1592582828 None] Lock "cinder-21c2e7a7-8512-4f53-839e-79c709bc5584-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:25:43 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a1d67f18-1148-421e-90d9-957522fc0cca tempest-VolumesListAdminTestJSON-1592582828 None] Acquiring lock "cinder-quobyte-21c2e7a7-8512-4f53-839e-79c709bc5584" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:25:43 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a1d67f18-1148-421e-90d9-957522fc0cca tempest-VolumesListAdminTestJSON-1592582828 None] Lock "cinder-quobyte-21c2e7a7-8512-4f53-839e-79c709bc5584" acquired by "delete_volume" :: waited 0.017s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:25:43 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd277bd2-9452-45c8-803a-9e6dfa611ca5]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:25:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a1d67f18-1148-421e-90d9-957522fc0cca tempest-VolumesListAdminTestJSON-1592582828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-21c2e7a7-8512-4f53-839e-79c709bc5584 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:43 devstack sudo[97565]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4ef64295-e150-4897-b1b8-84a630614ebd tempest-GroupsV314Test-220542306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec7249a2-ef6f-4fb4-ae16-0ec3f0d5b1d1" returned: 0 in 0.296s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:43 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-4ef64295-e150-4897-b1b8-84a630614ebd tempest-GroupsV314Test-220542306 None] Lock "cinder-quobyte-ec7249a2-ef6f-4fb4-ae16-0ec3f0d5b1d1" released by "delete_volume" :: held 0.718s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:25:43 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-087c2e54-0a14-4c56-8e59-c7848b58e576 tempest-VolumesListAdminTestJSON-1774154643 None] Acquiring lock "cinder-95e3bba5-1cba-479e-bc70-c1ca1a158641-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:25:43 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-087c2e54-0a14-4c56-8e59-c7848b58e576 tempest-VolumesListAdminTestJSON-1774154643 None] Lock "cinder-95e3bba5-1cba-479e-bc70-c1ca1a158641-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:25:43 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-087c2e54-0a14-4c56-8e59-c7848b58e576 tempest-VolumesListAdminTestJSON-1774154643 None] Acquiring lock "cinder-quobyte-95e3bba5-1cba-479e-bc70-c1ca1a158641" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:25:43 devstack sudo[97568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-21c2e7a7-8512-4f53-839e-79c709bc5584 Sep 03 14:25:43 devstack sudo[97568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:43 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-4ef64295-e150-4897-b1b8-84a630614ebd tempest-GroupsV314Test-220542306 None] Created reservations ['d1533af0-f5db-4d6b-89df-d63bb1c1e74b'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:25:43 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-087c2e54-0a14-4c56-8e59-c7848b58e576 tempest-VolumesListAdminTestJSON-1774154643 None] Lock "cinder-quobyte-95e3bba5-1cba-479e-bc70-c1ca1a158641" acquired by "delete_volume" :: waited 0.026s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:25:43 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a631d30-cc7f-49f6-8d79-1f4c8905af64]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:25:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-087c2e54-0a14-4c56-8e59-c7848b58e576 tempest-VolumesListAdminTestJSON-1774154643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-95e3bba5-1cba-479e-bc70-c1ca1a158641 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:43 devstack cinder-volume[87007]: WARNING cinder.quota [None req-4ef64295-e150-4897-b1b8-84a630614ebd tempest-GroupsV314Test-220542306 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1010318241 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1010318241, it is now deprecated. Please use the default quota class for default quota. Sep 03 14:25:43 devstack cinder-volume[87007]: WARNING cinder.quota [None req-4ef64295-e150-4897-b1b8-84a630614ebd tempest-GroupsV314Test-220542306 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1010318241 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1010318241, it is now deprecated. Please use the default quota class for default quota. Sep 03 14:25:43 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-4ef64295-e150-4897-b1b8-84a630614ebd tempest-GroupsV314Test-220542306 None] Created reservations ['4ae3975a-660f-4072-b8a4-c39ddbc2c62e', '967e5b0f-cf51-4798-8273-90879d67864f', 'ff258e34-988d-42e9-a3ef-b48c0e1b2e27', '78e86375-07d9-4dc9-a933-884031fc3968'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:25:43 devstack sudo[97570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-95e3bba5-1cba-479e-bc70-c1ca1a158641 Sep 03 14:25:43 devstack sudo[97570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4ef64295-e150-4897-b1b8-84a630614ebd tempest-GroupsV314Test-220542306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:25:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4ef64295-e150-4897-b1b8-84a630614ebd tempest-GroupsV314Test-220542306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:25:43 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-4ef64295-e150-4897-b1b8-84a630614ebd tempest-GroupsV314Test-220542306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:25:43 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-4ef64295-e150-4897-b1b8-84a630614ebd tempest-GroupsV314Test-220542306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:25:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4ef64295-e150-4897-b1b8-84a630614ebd tempest-GroupsV314Test-220542306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:25:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4ef64295-e150-4897-b1b8-84a630614ebd tempest-GroupsV314Test-220542306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:43 devstack sudo[97574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:25:43 devstack sudo[97574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:43 devstack sudo[97568]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a1d67f18-1148-421e-90d9-957522fc0cca tempest-VolumesListAdminTestJSON-1592582828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-21c2e7a7-8512-4f53-839e-79c709bc5584" returned: 0 in 0.442s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a1d67f18-1148-421e-90d9-957522fc0cca tempest-VolumesListAdminTestJSON-1592582828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-21c2e7a7-8512-4f53-839e-79c709bc5584 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:43 devstack sudo[97579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-21c2e7a7-8512-4f53-839e-79c709bc5584 Sep 03 14:25:43 devstack sudo[97579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:43 devstack sudo[97574]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4ef64295-e150-4897-b1b8-84a630614ebd tempest-GroupsV314Test-220542306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.328s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:43 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-4ef64295-e150-4897-b1b8-84a630614ebd tempest-GroupsV314Test-220542306 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:25:43 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-4ef64295-e150-4897-b1b8-84a630614ebd tempest-GroupsV314Test-220542306 None] Delete group completed successfully. Sep 03 14:25:43 devstack sudo[97570]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-087c2e54-0a14-4c56-8e59-c7848b58e576 tempest-VolumesListAdminTestJSON-1774154643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-95e3bba5-1cba-479e-bc70-c1ca1a158641" returned: 0 in 0.671s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-087c2e54-0a14-4c56-8e59-c7848b58e576 tempest-VolumesListAdminTestJSON-1774154643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-95e3bba5-1cba-479e-bc70-c1ca1a158641 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:44 devstack sudo[97579]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a1d67f18-1148-421e-90d9-957522fc0cca tempest-VolumesListAdminTestJSON-1592582828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-21c2e7a7-8512-4f53-839e-79c709bc5584" returned: 0 in 0.448s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:44 devstack sudo[97586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-95e3bba5-1cba-479e-bc70-c1ca1a158641 Sep 03 14:25:44 devstack sudo[97586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:44 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a1d67f18-1148-421e-90d9-957522fc0cca tempest-VolumesListAdminTestJSON-1592582828 None] Lock "cinder-quobyte-21c2e7a7-8512-4f53-839e-79c709bc5584" released by "delete_volume" :: held 0.952s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:25:44 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ba910004-219d-439e-b7ec-c269ce32fc32 tempest-GroupsV314Test-220542306 None] Acquiring lock "cinder-quobyte-28a69133-f9d1-420d-899a-12b3453c1a4f" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:25:44 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ba910004-219d-439e-b7ec-c269ce32fc32 tempest-GroupsV314Test-220542306 None] Lock "cinder-quobyte-28a69133-f9d1-420d-899a-12b3453c1a4f" acquired by "delete_volume" :: waited 0.026s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:25:44 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[312365e9-5512-4542-8e10-60f7d4f82fec]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:25:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ba910004-219d-439e-b7ec-c269ce32fc32 tempest-GroupsV314Test-220542306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:44 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-a1d67f18-1148-421e-90d9-957522fc0cca tempest-VolumesListAdminTestJSON-1592582828 None] Created reservations ['59a9829a-8bd0-44bc-97df-f41c738c0f7c', '29ca8aa8-dcb3-458e-b37c-5006b6f0e1d3', '317d0a00-5493-4ebf-95eb-1efa4b4e92ba', '6d59681c-15fd-4e72-8b33-a4b8e918fc4c'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:25:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a1d67f18-1148-421e-90d9-957522fc0cca tempest-VolumesListAdminTestJSON-1592582828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:25:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a1d67f18-1148-421e-90d9-957522fc0cca tempest-VolumesListAdminTestJSON-1592582828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:25:44 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a1d67f18-1148-421e-90d9-957522fc0cca tempest-VolumesListAdminTestJSON-1592582828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:25:44 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a1d67f18-1148-421e-90d9-957522fc0cca tempest-VolumesListAdminTestJSON-1592582828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:25:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a1d67f18-1148-421e-90d9-957522fc0cca tempest-VolumesListAdminTestJSON-1592582828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:25:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a1d67f18-1148-421e-90d9-957522fc0cca tempest-VolumesListAdminTestJSON-1592582828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:44 devstack sudo[97588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f Sep 03 14:25:44 devstack sudo[97588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:44 devstack sudo[97586]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-087c2e54-0a14-4c56-8e59-c7848b58e576 tempest-VolumesListAdminTestJSON-1774154643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-95e3bba5-1cba-479e-bc70-c1ca1a158641" returned: 0 in 0.438s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:44 devstack sudo[97591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:25:44 devstack sudo[97591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:44 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-087c2e54-0a14-4c56-8e59-c7848b58e576 tempest-VolumesListAdminTestJSON-1774154643 None] Lock "cinder-quobyte-95e3bba5-1cba-479e-bc70-c1ca1a158641" released by "delete_volume" :: held 1.172s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:25:44 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-087c2e54-0a14-4c56-8e59-c7848b58e576 tempest-VolumesListAdminTestJSON-1774154643 None] Created reservations ['fa299209-32b3-4357-beea-d9c0b7ba0c09', 'f1bda2b8-0a67-42d6-9d94-89bbfaf6f329', '62c8e220-fd35-4d37-9d39-254a519a84e8', '9a72e206-5ee3-4270-a131-96579dc3f14a'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:25:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-087c2e54-0a14-4c56-8e59-c7848b58e576 tempest-VolumesListAdminTestJSON-1774154643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:25:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-087c2e54-0a14-4c56-8e59-c7848b58e576 tempest-VolumesListAdminTestJSON-1774154643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:25:44 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-087c2e54-0a14-4c56-8e59-c7848b58e576 tempest-VolumesListAdminTestJSON-1774154643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:25:44 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-087c2e54-0a14-4c56-8e59-c7848b58e576 tempest-VolumesListAdminTestJSON-1774154643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:25:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-087c2e54-0a14-4c56-8e59-c7848b58e576 tempest-VolumesListAdminTestJSON-1774154643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:25:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-087c2e54-0a14-4c56-8e59-c7848b58e576 tempest-VolumesListAdminTestJSON-1774154643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:44 devstack sudo[97595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:25:44 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:44 devstack sudo[97591]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a1d67f18-1148-421e-90d9-957522fc0cca tempest-VolumesListAdminTestJSON-1592582828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.332s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:44 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-a1d67f18-1148-421e-90d9-957522fc0cca tempest-VolumesListAdminTestJSON-1592582828 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:25:44 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-a1d67f18-1148-421e-90d9-957522fc0cca tempest-VolumesListAdminTestJSON-1592582828 None] Deleted volume successfully. Sep 03 14:25:44 devstack sudo[97588]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ba910004-219d-439e-b7ec-c269ce32fc32 tempest-GroupsV314Test-220542306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f" returned: 0 in 0.572s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ba910004-219d-439e-b7ec-c269ce32fc32 tempest-GroupsV314Test-220542306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:44 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a1d67f18-1148-421e-90d9-957522fc0cca tempest-VolumesListAdminTestJSON-1592582828 None] Lock "cinder-21c2e7a7-8512-4f53-839e-79c709bc5584-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:25:44 devstack sudo[97599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f Sep 03 14:25:44 devstack sudo[97599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:45 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-087c2e54-0a14-4c56-8e59-c7848b58e576 tempest-VolumesListAdminTestJSON-1774154643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.354s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:45 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-087c2e54-0a14-4c56-8e59-c7848b58e576 tempest-VolumesListAdminTestJSON-1774154643 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:25:45 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-087c2e54-0a14-4c56-8e59-c7848b58e576 tempest-VolumesListAdminTestJSON-1774154643 None] Deleted volume successfully. Sep 03 14:25:45 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-087c2e54-0a14-4c56-8e59-c7848b58e576 tempest-VolumesListAdminTestJSON-1774154643 None] Lock "cinder-95e3bba5-1cba-479e-bc70-c1ca1a158641-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:25:45 devstack sudo[97599]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ba910004-219d-439e-b7ec-c269ce32fc32 tempest-GroupsV314Test-220542306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-28a69133-f9d1-420d-899a-12b3453c1a4f" returned: 0 in 0.354s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:45 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ba910004-219d-439e-b7ec-c269ce32fc32 tempest-GroupsV314Test-220542306 None] Lock "cinder-quobyte-28a69133-f9d1-420d-899a-12b3453c1a4f" released by "delete_volume" :: held 1.029s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:25:45 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-ba910004-219d-439e-b7ec-c269ce32fc32 tempest-GroupsV314Test-220542306 None] Created reservations ['0aea5bfa-0526-4861-97bd-0ecb48e0bcbe'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:25:45 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-ba910004-219d-439e-b7ec-c269ce32fc32 tempest-GroupsV314Test-220542306 None] Created reservations ['d32cbf57-7f51-4f65-a22f-fed59789e93b', '1fbda116-13f4-463b-8650-7d2489bd3ed7', '27aa556b-df45-4e5f-a1e4-17b85da4372f', '63d03faf-46b2-4760-8eab-9d7ef791d43d'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:25:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ba910004-219d-439e-b7ec-c269ce32fc32 tempest-GroupsV314Test-220542306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:25:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ba910004-219d-439e-b7ec-c269ce32fc32 tempest-GroupsV314Test-220542306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:25:45 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ba910004-219d-439e-b7ec-c269ce32fc32 tempest-GroupsV314Test-220542306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:25:45 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ba910004-219d-439e-b7ec-c269ce32fc32 tempest-GroupsV314Test-220542306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:25:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ba910004-219d-439e-b7ec-c269ce32fc32 tempest-GroupsV314Test-220542306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:25:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ba910004-219d-439e-b7ec-c269ce32fc32 tempest-GroupsV314Test-220542306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:45 devstack sudo[97603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:25:45 devstack sudo[97603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:45 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-798e1bac-1c59-498f-a706-9fa2e76b038b tempest-VolumesListAdminTestJSON-1774154643 None] Acquiring lock "cinder-f16799c8-412e-4085-8e8e-6b75abcc4988-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:25:45 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-798e1bac-1c59-498f-a706-9fa2e76b038b tempest-VolumesListAdminTestJSON-1774154643 None] Lock "cinder-f16799c8-412e-4085-8e8e-6b75abcc4988-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:25:45 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-798e1bac-1c59-498f-a706-9fa2e76b038b tempest-VolumesListAdminTestJSON-1774154643 None] Acquiring lock "cinder-quobyte-f16799c8-412e-4085-8e8e-6b75abcc4988" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:25:45 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-798e1bac-1c59-498f-a706-9fa2e76b038b tempest-VolumesListAdminTestJSON-1774154643 None] Lock "cinder-quobyte-f16799c8-412e-4085-8e8e-6b75abcc4988" acquired by "delete_volume" :: waited 0.021s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:25:45 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c9438c-06eb-4774-9f68-88742d307c96]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:25:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-798e1bac-1c59-498f-a706-9fa2e76b038b tempest-VolumesListAdminTestJSON-1774154643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f16799c8-412e-4085-8e8e-6b75abcc4988 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:45 devstack sudo[97603]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ba910004-219d-439e-b7ec-c269ce32fc32 tempest-GroupsV314Test-220542306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.348s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:45 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-ba910004-219d-439e-b7ec-c269ce32fc32 tempest-GroupsV314Test-220542306 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:25:45 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-ba910004-219d-439e-b7ec-c269ce32fc32 tempest-GroupsV314Test-220542306 None] Delete group completed successfully. Sep 03 14:25:45 devstack sudo[97606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f16799c8-412e-4085-8e8e-6b75abcc4988 Sep 03 14:25:45 devstack sudo[97606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:46 devstack sudo[97606]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-798e1bac-1c59-498f-a706-9fa2e76b038b tempest-VolumesListAdminTestJSON-1774154643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f16799c8-412e-4085-8e8e-6b75abcc4988" returned: 0 in 0.470s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-798e1bac-1c59-498f-a706-9fa2e76b038b tempest-VolumesListAdminTestJSON-1774154643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f16799c8-412e-4085-8e8e-6b75abcc4988 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:46 devstack sudo[97612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f16799c8-412e-4085-8e8e-6b75abcc4988 Sep 03 14:25:46 devstack sudo[97612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:46 devstack sudo[97612]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-798e1bac-1c59-498f-a706-9fa2e76b038b tempest-VolumesListAdminTestJSON-1774154643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f16799c8-412e-4085-8e8e-6b75abcc4988" returned: 0 in 0.371s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:46 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-798e1bac-1c59-498f-a706-9fa2e76b038b tempest-VolumesListAdminTestJSON-1774154643 None] Lock "cinder-quobyte-f16799c8-412e-4085-8e8e-6b75abcc4988" released by "delete_volume" :: held 0.905s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:25:46 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-798e1bac-1c59-498f-a706-9fa2e76b038b tempest-VolumesListAdminTestJSON-1774154643 None] Created reservations ['5f816c66-b5d2-47e1-b4a6-79e68fd6c4c1', '985cf73a-51b9-4757-a455-b92df36203cb', '67a1c94c-307f-48ab-9847-b1a11ef643cf', '47f5437b-fb3b-4549-9ade-0f2f160bd629'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:25:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-798e1bac-1c59-498f-a706-9fa2e76b038b tempest-VolumesListAdminTestJSON-1774154643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:25:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-798e1bac-1c59-498f-a706-9fa2e76b038b tempest-VolumesListAdminTestJSON-1774154643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:25:46 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-798e1bac-1c59-498f-a706-9fa2e76b038b tempest-VolumesListAdminTestJSON-1774154643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:25:46 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-798e1bac-1c59-498f-a706-9fa2e76b038b tempest-VolumesListAdminTestJSON-1774154643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:25:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-798e1bac-1c59-498f-a706-9fa2e76b038b tempest-VolumesListAdminTestJSON-1774154643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:25:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-798e1bac-1c59-498f-a706-9fa2e76b038b tempest-VolumesListAdminTestJSON-1774154643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:46 devstack sudo[97615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:25:46 devstack sudo[97615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:47 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-0f7c2a27-438c-4d33-9930-cf149ef081e9 tempest-VolumesListAdminTestJSON-1774154643 None] Acquiring lock "cinder-ba36c23b-f1c8-4855-8090-f64453a5f5dd-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:25:47 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-0f7c2a27-438c-4d33-9930-cf149ef081e9 tempest-VolumesListAdminTestJSON-1774154643 None] Lock "cinder-ba36c23b-f1c8-4855-8090-f64453a5f5dd-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:25:47 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-0f7c2a27-438c-4d33-9930-cf149ef081e9 tempest-VolumesListAdminTestJSON-1774154643 None] Acquiring lock "cinder-quobyte-ba36c23b-f1c8-4855-8090-f64453a5f5dd" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:25:47 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-0f7c2a27-438c-4d33-9930-cf149ef081e9 tempest-VolumesListAdminTestJSON-1774154643 None] Lock "cinder-quobyte-ba36c23b-f1c8-4855-8090-f64453a5f5dd" acquired by "delete_volume" :: waited 0.025s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:25:47 devstack sudo[97615]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-798e1bac-1c59-498f-a706-9fa2e76b038b tempest-VolumesListAdminTestJSON-1774154643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.431s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:47 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-798e1bac-1c59-498f-a706-9fa2e76b038b tempest-VolumesListAdminTestJSON-1774154643 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:25:47 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc557805-e6b4-447b-bf63-345f8d3f6b51]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:25:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0f7c2a27-438c-4d33-9930-cf149ef081e9 tempest-VolumesListAdminTestJSON-1774154643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ba36c23b-f1c8-4855-8090-f64453a5f5dd {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:47 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-798e1bac-1c59-498f-a706-9fa2e76b038b tempest-VolumesListAdminTestJSON-1774154643 None] Deleted volume successfully. Sep 03 14:25:47 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-798e1bac-1c59-498f-a706-9fa2e76b038b tempest-VolumesListAdminTestJSON-1774154643 None] Lock "cinder-f16799c8-412e-4085-8e8e-6b75abcc4988-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:25:47 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ba36c23b-f1c8-4855-8090-f64453a5f5dd Sep 03 14:25:47 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:47 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0f7c2a27-438c-4d33-9930-cf149ef081e9 tempest-VolumesListAdminTestJSON-1774154643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ba36c23b-f1c8-4855-8090-f64453a5f5dd" returned: 0 in 0.477s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0f7c2a27-438c-4d33-9930-cf149ef081e9 tempest-VolumesListAdminTestJSON-1774154643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ba36c23b-f1c8-4855-8090-f64453a5f5dd {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:47 devstack sudo[97623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ba36c23b-f1c8-4855-8090-f64453a5f5dd Sep 03 14:25:47 devstack sudo[97623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:48 devstack sudo[97623]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0f7c2a27-438c-4d33-9930-cf149ef081e9 tempest-VolumesListAdminTestJSON-1774154643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ba36c23b-f1c8-4855-8090-f64453a5f5dd" returned: 0 in 0.376s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:48 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-0f7c2a27-438c-4d33-9930-cf149ef081e9 tempest-VolumesListAdminTestJSON-1774154643 None] Lock "cinder-quobyte-ba36c23b-f1c8-4855-8090-f64453a5f5dd" released by "delete_volume" :: held 0.975s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:25:48 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-0f7c2a27-438c-4d33-9930-cf149ef081e9 tempest-VolumesListAdminTestJSON-1774154643 None] Created reservations ['e0fe63d7-6927-4e43-a397-cf040d98a1d1', '85847d24-2244-4205-a73b-d2522e6f9d33', '481f629c-de26-4e34-8617-6c07d21b64a0', 'b69cda29-fa98-45e4-8754-141cec484343'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:25:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-0f7c2a27-438c-4d33-9930-cf149ef081e9 tempest-VolumesListAdminTestJSON-1774154643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:25:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-0f7c2a27-438c-4d33-9930-cf149ef081e9 tempest-VolumesListAdminTestJSON-1774154643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:25:48 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-0f7c2a27-438c-4d33-9930-cf149ef081e9 tempest-VolumesListAdminTestJSON-1774154643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:25:48 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-0f7c2a27-438c-4d33-9930-cf149ef081e9 tempest-VolumesListAdminTestJSON-1774154643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:25:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-0f7c2a27-438c-4d33-9930-cf149ef081e9 tempest-VolumesListAdminTestJSON-1774154643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:25:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0f7c2a27-438c-4d33-9930-cf149ef081e9 tempest-VolumesListAdminTestJSON-1774154643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:48 devstack sudo[97626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:25:48 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:48 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0f7c2a27-438c-4d33-9930-cf149ef081e9 tempest-VolumesListAdminTestJSON-1774154643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.310s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:48 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-0f7c2a27-438c-4d33-9930-cf149ef081e9 tempest-VolumesListAdminTestJSON-1774154643 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:25:48 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-0f7c2a27-438c-4d33-9930-cf149ef081e9 tempest-VolumesListAdminTestJSON-1774154643 None] Deleted volume successfully. Sep 03 14:25:48 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-0f7c2a27-438c-4d33-9930-cf149ef081e9 tempest-VolumesListAdminTestJSON-1774154643 None] Lock "cinder-ba36c23b-f1c8-4855-8090-f64453a5f5dd-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:25:51 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-f028c307-83b5-4957-b770-2d6793cf9737 tempest-AttachVolumeNegativeTest-1835626697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:25:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f028c307-83b5-4957-b770-2d6793cf9737 tempest-AttachVolumeNegativeTest-1835626697 None] Flow 'volume_create_manager' (e1b5543d-1ea5-4ff1-a04f-0bdc3d36d986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:25:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f028c307-83b5-4957-b770-2d6793cf9737 tempest-AttachVolumeNegativeTest-1835626697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7486a7b3-04c6-47d2-a026-05e49baf7ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f028c307-83b5-4957-b770-2d6793cf9737 tempest-AttachVolumeNegativeTest-1835626697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7486a7b3-04c6-47d2-a026-05e49baf7ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-713224838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70608509-a364-4ed1-b462-cd0c31338723,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd1be5ab58fa4aa09e854306dcc6bbe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:25:51Z,use_quota=True,user_id='337e93cf223a488fa18dcadbd42fbcd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f028c307-83b5-4957-b770-2d6793cf9737 tempest-AttachVolumeNegativeTest-1835626697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2394f674-cd84-4474-8e97-1665e9ef7d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f028c307-83b5-4957-b770-2d6793cf9737 tempest-AttachVolumeNegativeTest-1835626697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2394f674-cd84-4474-8e97-1665e9ef7d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f028c307-83b5-4957-b770-2d6793cf9737 tempest-AttachVolumeNegativeTest-1835626697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed05c890-70a2-48ac-aeb9-06a6e0bc1de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f028c307-83b5-4957-b770-2d6793cf9737 tempest-AttachVolumeNegativeTest-1835626697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed05c890-70a2-48ac-aeb9-06a6e0bc1de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70608509-a364-4ed1-b462-cd0c31338723', 'volume_name': 'volume-70608509-a364-4ed1-b462-cd0c31338723', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f028c307-83b5-4957-b770-2d6793cf9737 tempest-AttachVolumeNegativeTest-1835626697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a80bdd1-c6a7-4af4-9ed7-a695a24ade67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f028c307-83b5-4957-b770-2d6793cf9737 tempest-AttachVolumeNegativeTest-1835626697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a80bdd1-c6a7-4af4-9ed7-a695a24ade67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f028c307-83b5-4957-b770-2d6793cf9737 tempest-AttachVolumeNegativeTest-1835626697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e42d1e41-47dc-4529-8ecf-411dd224ac1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:51 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-f028c307-83b5-4957-b770-2d6793cf9737 tempest-AttachVolumeNegativeTest-1835626697 None] Volume 70608509-a364-4ed1-b462-cd0c31338723: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70608509-a364-4ed1-b462-cd0c31338723', 'volume_size': 1} Sep 03 14:25:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f028c307-83b5-4957-b770-2d6793cf9737 tempest-AttachVolumeNegativeTest-1835626697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:25:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f028c307-83b5-4957-b770-2d6793cf9737 tempest-AttachVolumeNegativeTest-1835626697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:25:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f028c307-83b5-4957-b770-2d6793cf9737 tempest-AttachVolumeNegativeTest-1835626697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-713224838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70608509-a364-4ed1-b462-cd0c31338723,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd1be5ab58fa4aa09e854306dcc6bbe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:25:51Z,use_quota=True,user_id='337e93cf223a488fa18dcadbd42fbcd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:25:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-f028c307-83b5-4957-b770-2d6793cf9737 tempest-AttachVolumeNegativeTest-1835626697 None] Creating volume 70608509-a364-4ed1-b462-cd0c31338723 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:25:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f028c307-83b5-4957-b770-2d6793cf9737 tempest-AttachVolumeNegativeTest-1835626697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:25:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f028c307-83b5-4957-b770-2d6793cf9737 tempest-AttachVolumeNegativeTest-1835626697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:25:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f028c307-83b5-4957-b770-2d6793cf9737 tempest-AttachVolumeNegativeTest-1835626697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:25:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f028c307-83b5-4957-b770-2d6793cf9737 tempest-AttachVolumeNegativeTest-1835626697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:25:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f028c307-83b5-4957-b770-2d6793cf9737 tempest-AttachVolumeNegativeTest-1835626697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:25:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f028c307-83b5-4957-b770-2d6793cf9737 tempest-AttachVolumeNegativeTest-1835626697 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:25:51 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-f028c307-83b5-4957-b770-2d6793cf9737 tempest-AttachVolumeNegativeTest-1835626697 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:25:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f028c307-83b5-4957-b770-2d6793cf9737 tempest-AttachVolumeNegativeTest-1835626697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70608509-a364-4ed1-b462-cd0c31338723 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:51 devstack sudo[97631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70608509-a364-4ed1-b462-cd0c31338723 1073741824 Sep 03 14:25:51 devstack sudo[97631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:51 devstack cinder-volume[87007]: DEBUG oslo_service.periodic_task [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87007) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 14:25:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:25:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:25:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:25:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:25:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:25:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:51 devstack sudo[97633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:25:51 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:51 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.343s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:51 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:25:51 devstack cinder-volume[87007]: DEBUG oslo_service.periodic_task [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running periodic task VolumeManager._thread_info {{(pid=87007) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 14:25:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] thread count: 28 {{(pid=87007) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 14:25:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] thread info: [<_MainThread(MainThread, started 123689171054720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87007) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 14:25:51 devstack sudo[97631]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f028c307-83b5-4957-b770-2d6793cf9737 tempest-AttachVolumeNegativeTest-1835626697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70608509-a364-4ed1-b462-cd0c31338723 1073741824" returned: 0 in 0.583s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f028c307-83b5-4957-b770-2d6793cf9737 tempest-AttachVolumeNegativeTest-1835626697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70608509-a364-4ed1-b462-cd0c31338723 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:52 devstack sudo[97640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70608509-a364-4ed1-b462-cd0c31338723 Sep 03 14:25:52 devstack sudo[97640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:52 devstack sudo[97640]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f028c307-83b5-4957-b770-2d6793cf9737 tempest-AttachVolumeNegativeTest-1835626697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70608509-a364-4ed1-b462-cd0c31338723" returned: 0 in 0.398s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:52 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f028c307-83b5-4957-b770-2d6793cf9737 tempest-AttachVolumeNegativeTest-1835626697 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:25:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f028c307-83b5-4957-b770-2d6793cf9737 tempest-AttachVolumeNegativeTest-1835626697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:25:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f028c307-83b5-4957-b770-2d6793cf9737 tempest-AttachVolumeNegativeTest-1835626697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e42d1e41-47dc-4529-8ecf-411dd224ac1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70608509-a364-4ed1-b462-cd0c31338723', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f028c307-83b5-4957-b770-2d6793cf9737 tempest-AttachVolumeNegativeTest-1835626697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2667fa03-bb8a-490e-9773-82b6e9510359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:25:52 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-f028c307-83b5-4957-b770-2d6793cf9737 tempest-AttachVolumeNegativeTest-1835626697 None] Volume volume-70608509-a364-4ed1-b462-cd0c31338723 (70608509-a364-4ed1-b462-cd0c31338723): created successfully Sep 03 14:25:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f028c307-83b5-4957-b770-2d6793cf9737 tempest-AttachVolumeNegativeTest-1835626697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2667fa03-bb8a-490e-9773-82b6e9510359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:25:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f028c307-83b5-4957-b770-2d6793cf9737 tempest-AttachVolumeNegativeTest-1835626697 None] Flow 'volume_create_manager' (e1b5543d-1ea5-4ff1-a04f-0bdc3d36d986) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:25:52 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-f028c307-83b5-4957-b770-2d6793cf9737 tempest-AttachVolumeNegativeTest-1835626697 None] Created volume successfully. Sep 03 14:25:53 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-bd4a717f-12db-4fb4-b9a4-2b4c55be71ba tempest-GroupsV320Test-1087319923 None] Group tempest-GroupsV320Test-Group-877539155: creating Sep 03 14:25:53 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-bd4a717f-12db-4fb4-b9a4-2b4c55be71ba tempest-GroupsV320Test-1087319923 None] Group tempest-GroupsV320Test-Group-877539155: created successfully Sep 03 14:25:53 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-bd4a717f-12db-4fb4-b9a4-2b4c55be71ba tempest-GroupsV320Test-1087319923 None] Create group completed successfully. Sep 03 14:25:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-07837ffa-f2b4-4b79-95e8-3cfdc8ecedcf req-618ad5da-f65d-4206-b166-eac8581e7f32 tempest-AttachVolumeNegativeTest-1835626697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:25:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-07837ffa-f2b4-4b79-95e8-3cfdc8ecedcf req-618ad5da-f65d-4206-b166-eac8581e7f32 tempest-AttachVolumeNegativeTest-1835626697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:25:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-07837ffa-f2b4-4b79-95e8-3cfdc8ecedcf req-618ad5da-f65d-4206-b166-eac8581e7f32 tempest-AttachVolumeNegativeTest-1835626697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:25:54 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-07837ffa-f2b4-4b79-95e8-3cfdc8ecedcf req-618ad5da-f65d-4206-b166-eac8581e7f32 tempest-AttachVolumeNegativeTest-1835626697 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713', 'name': 'volume-70608509-a364-4ed1-b462-cd0c31338723', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0bb96ef2-5522-48ef-a695-e9f7504b2f71', 'enforce_multipath': True} {{(pid=87007) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 14:25:54 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-07837ffa-f2b4-4b79-95e8-3cfdc8ecedcf req-618ad5da-f65d-4206-b166-eac8581e7f32 tempest-AttachVolumeNegativeTest-1835626697 None] attachment_update completed successfully. Sep 03 14:25:55 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-730a9413-bb0b-4d06-babd-f71a97055117 tempest-GroupsV320Test-1087319923 None] Created reservations ['0212e262-9ab0-42ac-8e43-4bd9a21411d1'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:25:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-730a9413-bb0b-4d06-babd-f71a97055117 tempest-GroupsV320Test-1087319923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:25:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-730a9413-bb0b-4d06-babd-f71a97055117 tempest-GroupsV320Test-1087319923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:25:55 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-730a9413-bb0b-4d06-babd-f71a97055117 tempest-GroupsV320Test-1087319923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:25:55 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-730a9413-bb0b-4d06-babd-f71a97055117 tempest-GroupsV320Test-1087319923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:25:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-730a9413-bb0b-4d06-babd-f71a97055117 tempest-GroupsV320Test-1087319923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:25:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-730a9413-bb0b-4d06-babd-f71a97055117 tempest-GroupsV320Test-1087319923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:25:55 devstack sudo[98036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:25:55 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:25:55 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root Sep 03 14:25:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-730a9413-bb0b-4d06-babd-f71a97055117 tempest-GroupsV320Test-1087319923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.340s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:25:55 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-730a9413-bb0b-4d06-babd-f71a97055117 tempest-GroupsV320Test-1087319923 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:25:55 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-730a9413-bb0b-4d06-babd-f71a97055117 tempest-GroupsV320Test-1087319923 None] Delete group completed successfully. Sep 03 14:25:57 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-d5ecefa4-bebb-445f-8c7b-d25c1042c990 req-ef3ce42c-95fc-40b7-bef0-b7fb17ce4285 tempest-AttachVolumeNegativeTest-1835626697 None] Terminate volume connection completed successfully. Sep 03 14:25:57 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-d5ecefa4-bebb-445f-8c7b-d25c1042c990 req-ef3ce42c-95fc-40b7-bef0-b7fb17ce4285 tempest-AttachVolumeNegativeTest-1835626697 None] Deleting attachment 0bb96ef2-5522-48ef-a695-e9f7504b2f71. {{(pid=87007) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 14:26:03 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:SELECT=106,cinder:INSERT=30,cinder:UPDATE=141,cinder:DELETE=7 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:26:03 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-46e0762d-2ddf-4d14-82bf-14df74a80651 tempest-VolumesTransfersV355Test-507737760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:26:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-46e0762d-2ddf-4d14-82bf-14df74a80651 tempest-VolumesTransfersV355Test-507737760 None] Flow 'volume_create_manager' (7241dfb1-4192-45ab-ac0d-4c657f886a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:26:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-46e0762d-2ddf-4d14-82bf-14df74a80651 tempest-VolumesTransfersV355Test-507737760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac3e9506-7573-4730-a3a7-6b9534becadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-46e0762d-2ddf-4d14-82bf-14df74a80651 tempest-VolumesTransfersV355Test-507737760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac3e9506-7573-4730-a3a7-6b9534becadc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1359254535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d4a2323-f58a-4f81-b4a3-a2ad7ed2d4c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605ab0779aae4b06a0d3631eeb179fd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:26:04Z,use_quota=True,user_id='824273a48f364b2e93b3b33cb9be7462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-46e0762d-2ddf-4d14-82bf-14df74a80651 tempest-VolumesTransfersV355Test-507737760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a035226-4dca-44b0-b6dd-e2a2abaeeff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-46e0762d-2ddf-4d14-82bf-14df74a80651 tempest-VolumesTransfersV355Test-507737760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a035226-4dca-44b0-b6dd-e2a2abaeeff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-46e0762d-2ddf-4d14-82bf-14df74a80651 tempest-VolumesTransfersV355Test-507737760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03aba60d-2b42-4926-a64a-c543a93a27b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-46e0762d-2ddf-4d14-82bf-14df74a80651 tempest-VolumesTransfersV355Test-507737760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03aba60d-2b42-4926-a64a-c543a93a27b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d4a2323-f58a-4f81-b4a3-a2ad7ed2d4c4', 'volume_name': 'volume-9d4a2323-f58a-4f81-b4a3-a2ad7ed2d4c4', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-46e0762d-2ddf-4d14-82bf-14df74a80651 tempest-VolumesTransfersV355Test-507737760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79d57f5d-6e56-4892-9e5d-0cae4311e639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-46e0762d-2ddf-4d14-82bf-14df74a80651 tempest-VolumesTransfersV355Test-507737760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79d57f5d-6e56-4892-9e5d-0cae4311e639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-46e0762d-2ddf-4d14-82bf-14df74a80651 tempest-VolumesTransfersV355Test-507737760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8ecc605-e082-43ea-9d8e-d50cadf22af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:03 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-46e0762d-2ddf-4d14-82bf-14df74a80651 tempest-VolumesTransfersV355Test-507737760 None] Volume 9d4a2323-f58a-4f81-b4a3-a2ad7ed2d4c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d4a2323-f58a-4f81-b4a3-a2ad7ed2d4c4', 'volume_size': 1} Sep 03 14:26:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-46e0762d-2ddf-4d14-82bf-14df74a80651 tempest-VolumesTransfersV355Test-507737760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:26:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-46e0762d-2ddf-4d14-82bf-14df74a80651 tempest-VolumesTransfersV355Test-507737760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:26:03 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-46e0762d-2ddf-4d14-82bf-14df74a80651 tempest-VolumesTransfersV355Test-507737760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1359254535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d4a2323-f58a-4f81-b4a3-a2ad7ed2d4c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605ab0779aae4b06a0d3631eeb179fd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:26:04Z,use_quota=True,user_id='824273a48f364b2e93b3b33cb9be7462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:26:03 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-46e0762d-2ddf-4d14-82bf-14df74a80651 tempest-VolumesTransfersV355Test-507737760 None] Creating volume 9d4a2323-f58a-4f81-b4a3-a2ad7ed2d4c4 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:26:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-46e0762d-2ddf-4d14-82bf-14df74a80651 tempest-VolumesTransfersV355Test-507737760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:26:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-46e0762d-2ddf-4d14-82bf-14df74a80651 tempest-VolumesTransfersV355Test-507737760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:26:03 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-46e0762d-2ddf-4d14-82bf-14df74a80651 tempest-VolumesTransfersV355Test-507737760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:26:03 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-46e0762d-2ddf-4d14-82bf-14df74a80651 tempest-VolumesTransfersV355Test-507737760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:26:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-46e0762d-2ddf-4d14-82bf-14df74a80651 tempest-VolumesTransfersV355Test-507737760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:26:03 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-46e0762d-2ddf-4d14-82bf-14df74a80651 tempest-VolumesTransfersV355Test-507737760 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:26:03 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-46e0762d-2ddf-4d14-82bf-14df74a80651 tempest-VolumesTransfersV355Test-507737760 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:26:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-46e0762d-2ddf-4d14-82bf-14df74a80651 tempest-VolumesTransfersV355Test-507737760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9d4a2323-f58a-4f81-b4a3-a2ad7ed2d4c4 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:03 devstack sudo[98124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9d4a2323-f58a-4f81-b4a3-a2ad7ed2d4c4 1073741824 Sep 03 14:26:03 devstack sudo[98124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:04 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b3f01597-9c28-4229-930c-8056ebcd19fe tempest-AttachVolumeNegativeTest-1835626697 None] Acquiring lock "cinder-70608509-a364-4ed1-b462-cd0c31338723-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:26:04 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b3f01597-9c28-4229-930c-8056ebcd19fe tempest-AttachVolumeNegativeTest-1835626697 None] Lock "cinder-70608509-a364-4ed1-b462-cd0c31338723-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:26:04 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b3f01597-9c28-4229-930c-8056ebcd19fe tempest-AttachVolumeNegativeTest-1835626697 None] Acquiring lock "cinder-quobyte-70608509-a364-4ed1-b462-cd0c31338723" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:26:04 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b3f01597-9c28-4229-930c-8056ebcd19fe tempest-AttachVolumeNegativeTest-1835626697 None] Lock "cinder-quobyte-70608509-a364-4ed1-b462-cd0c31338723" acquired by "delete_volume" :: waited 0.032s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:26:04 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[5adb9298-f5d0-43c1-bfef-3a0b8cf4f7ff]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:26:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b3f01597-9c28-4229-930c-8056ebcd19fe tempest-AttachVolumeNegativeTest-1835626697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70608509-a364-4ed1-b462-cd0c31338723 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:04 devstack sudo[98133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70608509-a364-4ed1-b462-cd0c31338723 Sep 03 14:26:04 devstack sudo[98133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:04 devstack sudo[98124]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-46e0762d-2ddf-4d14-82bf-14df74a80651 tempest-VolumesTransfersV355Test-507737760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9d4a2323-f58a-4f81-b4a3-a2ad7ed2d4c4 1073741824" returned: 0 in 0.610s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-46e0762d-2ddf-4d14-82bf-14df74a80651 tempest-VolumesTransfersV355Test-507737760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9d4a2323-f58a-4f81-b4a3-a2ad7ed2d4c4 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:04 devstack sudo[98136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9d4a2323-f58a-4f81-b4a3-a2ad7ed2d4c4 Sep 03 14:26:04 devstack sudo[98136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:04 devstack sudo[98133]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b3f01597-9c28-4229-930c-8056ebcd19fe tempest-AttachVolumeNegativeTest-1835626697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70608509-a364-4ed1-b462-cd0c31338723" returned: 0 in 0.455s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b3f01597-9c28-4229-930c-8056ebcd19fe tempest-AttachVolumeNegativeTest-1835626697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70608509-a364-4ed1-b462-cd0c31338723 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:04 devstack sudo[98141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70608509-a364-4ed1-b462-cd0c31338723 Sep 03 14:26:04 devstack sudo[98141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:04 devstack sudo[98136]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-46e0762d-2ddf-4d14-82bf-14df74a80651 tempest-VolumesTransfersV355Test-507737760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9d4a2323-f58a-4f81-b4a3-a2ad7ed2d4c4" returned: 0 in 0.311s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:04 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-46e0762d-2ddf-4d14-82bf-14df74a80651 tempest-VolumesTransfersV355Test-507737760 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:26:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-46e0762d-2ddf-4d14-82bf-14df74a80651 tempest-VolumesTransfersV355Test-507737760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:26:04 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-46e0762d-2ddf-4d14-82bf-14df74a80651 tempest-VolumesTransfersV355Test-507737760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8ecc605-e082-43ea-9d8e-d50cadf22af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d4a2323-f58a-4f81-b4a3-a2ad7ed2d4c4', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:04 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-46e0762d-2ddf-4d14-82bf-14df74a80651 tempest-VolumesTransfersV355Test-507737760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d40bd7be-7efc-4f90-ac6a-eef18b606b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:04 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-46e0762d-2ddf-4d14-82bf-14df74a80651 tempest-VolumesTransfersV355Test-507737760 None] Volume volume-9d4a2323-f58a-4f81-b4a3-a2ad7ed2d4c4 (9d4a2323-f58a-4f81-b4a3-a2ad7ed2d4c4): created successfully Sep 03 14:26:04 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-46e0762d-2ddf-4d14-82bf-14df74a80651 tempest-VolumesTransfersV355Test-507737760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d40bd7be-7efc-4f90-ac6a-eef18b606b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:04 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-46e0762d-2ddf-4d14-82bf-14df74a80651 tempest-VolumesTransfersV355Test-507737760 None] Flow 'volume_create_manager' (7241dfb1-4192-45ab-ac0d-4c657f886a91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:26:04 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-46e0762d-2ddf-4d14-82bf-14df74a80651 tempest-VolumesTransfersV355Test-507737760 None] Created volume successfully. Sep 03 14:26:04 devstack sudo[98141]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b3f01597-9c28-4229-930c-8056ebcd19fe tempest-AttachVolumeNegativeTest-1835626697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70608509-a364-4ed1-b462-cd0c31338723" returned: 0 in 0.301s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:04 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b3f01597-9c28-4229-930c-8056ebcd19fe tempest-AttachVolumeNegativeTest-1835626697 None] Lock "cinder-quobyte-70608509-a364-4ed1-b462-cd0c31338723" released by "delete_volume" :: held 0.799s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:26:05 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-b3f01597-9c28-4229-930c-8056ebcd19fe tempest-AttachVolumeNegativeTest-1835626697 None] Created reservations ['17877650-b1bb-4419-8d7b-c09cee4358df', 'f3051cea-d012-4d04-b773-3a819c269ba7', 'd19af8e5-f460-43c3-af8d-176ff45252de', '896cc13b-5f2d-4cde-b90d-3ac10db9c75f'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:26:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b3f01597-9c28-4229-930c-8056ebcd19fe tempest-AttachVolumeNegativeTest-1835626697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:26:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b3f01597-9c28-4229-930c-8056ebcd19fe tempest-AttachVolumeNegativeTest-1835626697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:26:05 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b3f01597-9c28-4229-930c-8056ebcd19fe tempest-AttachVolumeNegativeTest-1835626697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:26:05 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b3f01597-9c28-4229-930c-8056ebcd19fe tempest-AttachVolumeNegativeTest-1835626697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:26:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b3f01597-9c28-4229-930c-8056ebcd19fe tempest-AttachVolumeNegativeTest-1835626697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:26:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b3f01597-9c28-4229-930c-8056ebcd19fe tempest-AttachVolumeNegativeTest-1835626697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:05 devstack sudo[98145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:26:05 devstack sudo[98145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:05 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-0461cc04-54c5-42e8-925d-9d8a754938b7 tempest-AttachVolumeNegativeTest-1835626697 None] Acquiring lock "cinder-c34a5dd2-0054-4e18-8c4f-fb46301fa957-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:26:05 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-0461cc04-54c5-42e8-925d-9d8a754938b7 tempest-AttachVolumeNegativeTest-1835626697 None] Lock "cinder-c34a5dd2-0054-4e18-8c4f-fb46301fa957-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:26:05 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-0461cc04-54c5-42e8-925d-9d8a754938b7 tempest-AttachVolumeNegativeTest-1835626697 None] Acquiring lock "cinder-quobyte-c34a5dd2-0054-4e18-8c4f-fb46301fa957" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:26:05 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-0461cc04-54c5-42e8-925d-9d8a754938b7 tempest-AttachVolumeNegativeTest-1835626697 None] Lock "cinder-quobyte-c34a5dd2-0054-4e18-8c4f-fb46301fa957" acquired by "delete_volume" :: waited 0.032s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:26:05 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd5c9a0-d1c5-4ccd-bfad-301e0780a02b]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:26:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0461cc04-54c5-42e8-925d-9d8a754938b7 tempest-AttachVolumeNegativeTest-1835626697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c34a5dd2-0054-4e18-8c4f-fb46301fa957 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:05 devstack sudo[98145]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b3f01597-9c28-4229-930c-8056ebcd19fe tempest-AttachVolumeNegativeTest-1835626697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.479s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:05 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-b3f01597-9c28-4229-930c-8056ebcd19fe tempest-AttachVolumeNegativeTest-1835626697 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:26:05 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-b3f01597-9c28-4229-930c-8056ebcd19fe tempest-AttachVolumeNegativeTest-1835626697 None] Deleted volume successfully. Sep 03 14:26:05 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b3f01597-9c28-4229-930c-8056ebcd19fe tempest-AttachVolumeNegativeTest-1835626697 None] Lock "cinder-70608509-a364-4ed1-b462-cd0c31338723-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:26:05 devstack sudo[98148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c34a5dd2-0054-4e18-8c4f-fb46301fa957 Sep 03 14:26:05 devstack sudo[98148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:06 devstack sudo[98148]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0461cc04-54c5-42e8-925d-9d8a754938b7 tempest-AttachVolumeNegativeTest-1835626697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c34a5dd2-0054-4e18-8c4f-fb46301fa957" returned: 0 in 0.529s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0461cc04-54c5-42e8-925d-9d8a754938b7 tempest-AttachVolumeNegativeTest-1835626697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c34a5dd2-0054-4e18-8c4f-fb46301fa957 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:06 devstack sudo[98165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c34a5dd2-0054-4e18-8c4f-fb46301fa957 Sep 03 14:26:06 devstack sudo[98165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:06 devstack sudo[98165]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0461cc04-54c5-42e8-925d-9d8a754938b7 tempest-AttachVolumeNegativeTest-1835626697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c34a5dd2-0054-4e18-8c4f-fb46301fa957" returned: 0 in 0.454s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:06 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-90e9ffbf-0dbb-4a84-b97c-ebc17e4edb04 tempest-VolumesTransfersV355Test-1109002002 None] Transfer volume completed successfully. Sep 03 14:26:06 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-0461cc04-54c5-42e8-925d-9d8a754938b7 tempest-AttachVolumeNegativeTest-1835626697 None] Lock "cinder-quobyte-c34a5dd2-0054-4e18-8c4f-fb46301fa957" released by "delete_volume" :: held 1.089s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:26:06 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-0461cc04-54c5-42e8-925d-9d8a754938b7 tempest-AttachVolumeNegativeTest-1835626697 None] Created reservations ['01ec5333-acc0-4406-8e51-661122d256a9', 'df352aeb-ec32-4182-a0bc-55a61a33eb95', '422f9d20-cb39-44f9-a688-ae68b96fdfb4', 'e3561cfd-acc6-4a68-a374-2b01dfe66240'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:26:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-0461cc04-54c5-42e8-925d-9d8a754938b7 tempest-AttachVolumeNegativeTest-1835626697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:26:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-0461cc04-54c5-42e8-925d-9d8a754938b7 tempest-AttachVolumeNegativeTest-1835626697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:26:06 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-0461cc04-54c5-42e8-925d-9d8a754938b7 tempest-AttachVolumeNegativeTest-1835626697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:26:06 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-0461cc04-54c5-42e8-925d-9d8a754938b7 tempest-AttachVolumeNegativeTest-1835626697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:26:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-0461cc04-54c5-42e8-925d-9d8a754938b7 tempest-AttachVolumeNegativeTest-1835626697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:26:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0461cc04-54c5-42e8-925d-9d8a754938b7 tempest-AttachVolumeNegativeTest-1835626697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:06 devstack sudo[98173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:26:06 devstack sudo[98173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:07 devstack sudo[98173]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0461cc04-54c5-42e8-925d-9d8a754938b7 tempest-AttachVolumeNegativeTest-1835626697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.324s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:07 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-0461cc04-54c5-42e8-925d-9d8a754938b7 tempest-AttachVolumeNegativeTest-1835626697 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:26:07 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-0461cc04-54c5-42e8-925d-9d8a754938b7 tempest-AttachVolumeNegativeTest-1835626697 None] Deleted volume successfully. Sep 03 14:26:07 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-0461cc04-54c5-42e8-925d-9d8a754938b7 tempest-AttachVolumeNegativeTest-1835626697 None] Lock "cinder-c34a5dd2-0054-4e18-8c4f-fb46301fa957-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:26:07 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-087ba6b1-5c1d-4bd0-9422-49f873d9903f tempest-VolumesTransfersV355Test-1459868000 None] Acquiring lock "cinder-9d4a2323-f58a-4f81-b4a3-a2ad7ed2d4c4-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:26:07 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-087ba6b1-5c1d-4bd0-9422-49f873d9903f tempest-VolumesTransfersV355Test-1459868000 None] Lock "cinder-9d4a2323-f58a-4f81-b4a3-a2ad7ed2d4c4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:26:07 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-087ba6b1-5c1d-4bd0-9422-49f873d9903f tempest-VolumesTransfersV355Test-1459868000 None] Acquiring lock "cinder-quobyte-9d4a2323-f58a-4f81-b4a3-a2ad7ed2d4c4" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:26:07 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-087ba6b1-5c1d-4bd0-9422-49f873d9903f tempest-VolumesTransfersV355Test-1459868000 None] Lock "cinder-quobyte-9d4a2323-f58a-4f81-b4a3-a2ad7ed2d4c4" acquired by "delete_volume" :: waited 0.016s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:26:07 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf7aa6b-db2f-4562-8eca-d1fafcef5bbf]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:26:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-087ba6b1-5c1d-4bd0-9422-49f873d9903f tempest-VolumesTransfersV355Test-1459868000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9d4a2323-f58a-4f81-b4a3-a2ad7ed2d4c4 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:07 devstack sudo[98176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9d4a2323-f58a-4f81-b4a3-a2ad7ed2d4c4 Sep 03 14:26:07 devstack sudo[98176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:08 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8a645185-0171-4369-b779-3c09b466b41c tempest-AttachVolumeNegativeTest-1835626697 None] Acquiring lock "cinder-08c84741-c587-421e-a584-52b6a6c4b0b6-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:26:08 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8a645185-0171-4369-b779-3c09b466b41c tempest-AttachVolumeNegativeTest-1835626697 None] Lock "cinder-08c84741-c587-421e-a584-52b6a6c4b0b6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:26:08 devstack sudo[98176]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-087ba6b1-5c1d-4bd0-9422-49f873d9903f tempest-VolumesTransfersV355Test-1459868000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9d4a2323-f58a-4f81-b4a3-a2ad7ed2d4c4" returned: 0 in 0.577s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-087ba6b1-5c1d-4bd0-9422-49f873d9903f tempest-VolumesTransfersV355Test-1459868000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9d4a2323-f58a-4f81-b4a3-a2ad7ed2d4c4 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:08 devstack sudo[98182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9d4a2323-f58a-4f81-b4a3-a2ad7ed2d4c4 Sep 03 14:26:08 devstack sudo[98182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:08 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8a645185-0171-4369-b779-3c09b466b41c tempest-AttachVolumeNegativeTest-1835626697 None] Acquiring lock "cinder-quobyte-08c84741-c587-421e-a584-52b6a6c4b0b6" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:26:08 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8a645185-0171-4369-b779-3c09b466b41c tempest-AttachVolumeNegativeTest-1835626697 None] Lock "cinder-quobyte-08c84741-c587-421e-a584-52b6a6c4b0b6" acquired by "delete_volume" :: waited 0.019s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:26:08 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c85008-d92d-4a12-b623-b6940bf696dd]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:26:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8a645185-0171-4369-b779-3c09b466b41c tempest-AttachVolumeNegativeTest-1835626697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-08c84741-c587-421e-a584-52b6a6c4b0b6 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:08 devstack sudo[98184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-08c84741-c587-421e-a584-52b6a6c4b0b6 Sep 03 14:26:08 devstack sudo[98184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:08 devstack sudo[98182]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-087ba6b1-5c1d-4bd0-9422-49f873d9903f tempest-VolumesTransfersV355Test-1459868000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9d4a2323-f58a-4f81-b4a3-a2ad7ed2d4c4" returned: 0 in 0.266s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:08 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-087ba6b1-5c1d-4bd0-9422-49f873d9903f tempest-VolumesTransfersV355Test-1459868000 None] Lock "cinder-quobyte-9d4a2323-f58a-4f81-b4a3-a2ad7ed2d4c4" released by "delete_volume" :: held 0.892s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:26:08 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-087ba6b1-5c1d-4bd0-9422-49f873d9903f tempest-VolumesTransfersV355Test-1459868000 None] Created reservations ['d9bfc630-1d4e-42c4-80b2-1658a9f1d2b5', '4ab917a7-3397-47b7-9dfd-4d439cd6a11d', 'f25a9e77-0a0e-4dfd-b332-a98b9c7bb4f4', '0d569113-0f2a-494a-a526-fd0a96e66955'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:26:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-087ba6b1-5c1d-4bd0-9422-49f873d9903f tempest-VolumesTransfersV355Test-1459868000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:26:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-087ba6b1-5c1d-4bd0-9422-49f873d9903f tempest-VolumesTransfersV355Test-1459868000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:26:08 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-087ba6b1-5c1d-4bd0-9422-49f873d9903f tempest-VolumesTransfersV355Test-1459868000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:26:08 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-087ba6b1-5c1d-4bd0-9422-49f873d9903f tempest-VolumesTransfersV355Test-1459868000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:26:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-087ba6b1-5c1d-4bd0-9422-49f873d9903f tempest-VolumesTransfersV355Test-1459868000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:26:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-087ba6b1-5c1d-4bd0-9422-49f873d9903f tempest-VolumesTransfersV355Test-1459868000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:08 devstack sudo[98191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:26:08 devstack sudo[98191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:08 devstack sudo[98184]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8a645185-0171-4369-b779-3c09b466b41c tempest-AttachVolumeNegativeTest-1835626697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-08c84741-c587-421e-a584-52b6a6c4b0b6" returned: 0 in 0.432s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8a645185-0171-4369-b779-3c09b466b41c tempest-AttachVolumeNegativeTest-1835626697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-08c84741-c587-421e-a584-52b6a6c4b0b6 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:08 devstack sudo[98193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-08c84741-c587-421e-a584-52b6a6c4b0b6 Sep 03 14:26:08 devstack sudo[98193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:09 devstack sudo[98191]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-087ba6b1-5c1d-4bd0-9422-49f873d9903f tempest-VolumesTransfersV355Test-1459868000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.571s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:09 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-087ba6b1-5c1d-4bd0-9422-49f873d9903f tempest-VolumesTransfersV355Test-1459868000 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:26:09 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-087ba6b1-5c1d-4bd0-9422-49f873d9903f tempest-VolumesTransfersV355Test-1459868000 None] Deleted volume successfully. Sep 03 14:26:09 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-087ba6b1-5c1d-4bd0-9422-49f873d9903f tempest-VolumesTransfersV355Test-1459868000 None] Lock "cinder-9d4a2323-f58a-4f81-b4a3-a2ad7ed2d4c4-delete_volume" released by "delete_volume" :: held 1.808s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:26:09 devstack sudo[98193]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8a645185-0171-4369-b779-3c09b466b41c tempest-AttachVolumeNegativeTest-1835626697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-08c84741-c587-421e-a584-52b6a6c4b0b6" returned: 0 in 0.663s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:09 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8a645185-0171-4369-b779-3c09b466b41c tempest-AttachVolumeNegativeTest-1835626697 None] Lock "cinder-quobyte-08c84741-c587-421e-a584-52b6a6c4b0b6" released by "delete_volume" :: held 1.187s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:26:09 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-8a645185-0171-4369-b779-3c09b466b41c tempest-AttachVolumeNegativeTest-1835626697 None] Created reservations ['0378a7de-6fe8-40f5-a3b5-e97ca1abd409', '21c37dd2-eb3f-40b9-be41-0e5e9c0a6f72', '1f1ccfce-63c6-4973-b472-13894f58be51', '7abe8d23-02fb-45d3-a915-261d12287c2e'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:26:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8a645185-0171-4369-b779-3c09b466b41c tempest-AttachVolumeNegativeTest-1835626697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:26:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8a645185-0171-4369-b779-3c09b466b41c tempest-AttachVolumeNegativeTest-1835626697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:26:09 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-8a645185-0171-4369-b779-3c09b466b41c tempest-AttachVolumeNegativeTest-1835626697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:26:09 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-8a645185-0171-4369-b779-3c09b466b41c tempest-AttachVolumeNegativeTest-1835626697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:26:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8a645185-0171-4369-b779-3c09b466b41c tempest-AttachVolumeNegativeTest-1835626697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:26:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8a645185-0171-4369-b779-3c09b466b41c tempest-AttachVolumeNegativeTest-1835626697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:10 devstack sudo[98258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:26:10 devstack sudo[98258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:10 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-218cc744-887d-4ecc-a95b-ec464e53d0fa tempest-VolumesTransfersV355Test-507737760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:26:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-218cc744-887d-4ecc-a95b-ec464e53d0fa tempest-VolumesTransfersV355Test-507737760 None] Flow 'volume_create_manager' (3f46c906-e62b-4af6-b4f9-ae6c27b6c02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:26:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-218cc744-887d-4ecc-a95b-ec464e53d0fa tempest-VolumesTransfersV355Test-507737760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b9c95b7-33d5-47fd-99c5-c8ebf87bcaef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-218cc744-887d-4ecc-a95b-ec464e53d0fa tempest-VolumesTransfersV355Test-507737760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b9c95b7-33d5-47fd-99c5-c8ebf87bcaef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1911005610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b933781-ce57-4b9a-8d32-dce3e5ed80bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605ab0779aae4b06a0d3631eeb179fd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:26:10Z,use_quota=True,user_id='824273a48f364b2e93b3b33cb9be7462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-218cc744-887d-4ecc-a95b-ec464e53d0fa tempest-VolumesTransfersV355Test-507737760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49c520cf-ef37-47a8-8c8a-46e82801f4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:10 devstack sudo[98258]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-218cc744-887d-4ecc-a95b-ec464e53d0fa tempest-VolumesTransfersV355Test-507737760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49c520cf-ef37-47a8-8c8a-46e82801f4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-218cc744-887d-4ecc-a95b-ec464e53d0fa tempest-VolumesTransfersV355Test-507737760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa8d6729-b292-4217-b7c4-8058e749bd25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-218cc744-887d-4ecc-a95b-ec464e53d0fa tempest-VolumesTransfersV355Test-507737760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa8d6729-b292-4217-b7c4-8058e749bd25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b933781-ce57-4b9a-8d32-dce3e5ed80bc', 'volume_name': 'volume-6b933781-ce57-4b9a-8d32-dce3e5ed80bc', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-218cc744-887d-4ecc-a95b-ec464e53d0fa tempest-VolumesTransfersV355Test-507737760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc4c16fa-2de4-4d9f-b5e7-0c8ddccbac55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-218cc744-887d-4ecc-a95b-ec464e53d0fa tempest-VolumesTransfersV355Test-507737760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc4c16fa-2de4-4d9f-b5e7-0c8ddccbac55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-218cc744-887d-4ecc-a95b-ec464e53d0fa tempest-VolumesTransfersV355Test-507737760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (701bb60e-ce73-4df2-b1dc-db8b71d45d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:10 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-218cc744-887d-4ecc-a95b-ec464e53d0fa tempest-VolumesTransfersV355Test-507737760 None] Volume 6b933781-ce57-4b9a-8d32-dce3e5ed80bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b933781-ce57-4b9a-8d32-dce3e5ed80bc', 'volume_size': 1} Sep 03 14:26:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-218cc744-887d-4ecc-a95b-ec464e53d0fa tempest-VolumesTransfersV355Test-507737760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:26:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-218cc744-887d-4ecc-a95b-ec464e53d0fa tempest-VolumesTransfersV355Test-507737760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:26:10 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-218cc744-887d-4ecc-a95b-ec464e53d0fa tempest-VolumesTransfersV355Test-507737760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1911005610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b933781-ce57-4b9a-8d32-dce3e5ed80bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605ab0779aae4b06a0d3631eeb179fd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:26:10Z,use_quota=True,user_id='824273a48f364b2e93b3b33cb9be7462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:26:10 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-218cc744-887d-4ecc-a95b-ec464e53d0fa tempest-VolumesTransfersV355Test-507737760 None] Creating volume 6b933781-ce57-4b9a-8d32-dce3e5ed80bc {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:26:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-218cc744-887d-4ecc-a95b-ec464e53d0fa tempest-VolumesTransfersV355Test-507737760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:26:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-218cc744-887d-4ecc-a95b-ec464e53d0fa tempest-VolumesTransfersV355Test-507737760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:26:10 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-218cc744-887d-4ecc-a95b-ec464e53d0fa tempest-VolumesTransfersV355Test-507737760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:26:10 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-218cc744-887d-4ecc-a95b-ec464e53d0fa tempest-VolumesTransfersV355Test-507737760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:26:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-218cc744-887d-4ecc-a95b-ec464e53d0fa tempest-VolumesTransfersV355Test-507737760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:26:10 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-218cc744-887d-4ecc-a95b-ec464e53d0fa tempest-VolumesTransfersV355Test-507737760 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:26:10 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-218cc744-887d-4ecc-a95b-ec464e53d0fa tempest-VolumesTransfersV355Test-507737760 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:26:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-218cc744-887d-4ecc-a95b-ec464e53d0fa tempest-VolumesTransfersV355Test-507737760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6b933781-ce57-4b9a-8d32-dce3e5ed80bc 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8a645185-0171-4369-b779-3c09b466b41c tempest-AttachVolumeNegativeTest-1835626697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.725s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:10 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-8a645185-0171-4369-b779-3c09b466b41c tempest-AttachVolumeNegativeTest-1835626697 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:26:10 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-8a645185-0171-4369-b779-3c09b466b41c tempest-AttachVolumeNegativeTest-1835626697 None] Deleted volume successfully. Sep 03 14:26:10 devstack sudo[98267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6b933781-ce57-4b9a-8d32-dce3e5ed80bc 1073741824 Sep 03 14:26:10 devstack sudo[98267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:10 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8a645185-0171-4369-b779-3c09b466b41c tempest-AttachVolumeNegativeTest-1835626697 None] Lock "cinder-08c84741-c587-421e-a584-52b6a6c4b0b6-delete_volume" released by "delete_volume" :: held 2.574s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:26:11 devstack sudo[98267]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-218cc744-887d-4ecc-a95b-ec464e53d0fa tempest-VolumesTransfersV355Test-507737760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6b933781-ce57-4b9a-8d32-dce3e5ed80bc 1073741824" returned: 0 in 0.723s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-218cc744-887d-4ecc-a95b-ec464e53d0fa tempest-VolumesTransfersV355Test-507737760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6b933781-ce57-4b9a-8d32-dce3e5ed80bc {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:11 devstack sudo[98277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6b933781-ce57-4b9a-8d32-dce3e5ed80bc Sep 03 14:26:11 devstack sudo[98277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:11 devstack sudo[98277]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-218cc744-887d-4ecc-a95b-ec464e53d0fa tempest-VolumesTransfersV355Test-507737760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6b933781-ce57-4b9a-8d32-dce3e5ed80bc" returned: 0 in 0.407s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:11 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-218cc744-887d-4ecc-a95b-ec464e53d0fa tempest-VolumesTransfersV355Test-507737760 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:26:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-218cc744-887d-4ecc-a95b-ec464e53d0fa tempest-VolumesTransfersV355Test-507737760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:26:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-218cc744-887d-4ecc-a95b-ec464e53d0fa tempest-VolumesTransfersV355Test-507737760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (701bb60e-ce73-4df2-b1dc-db8b71d45d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b933781-ce57-4b9a-8d32-dce3e5ed80bc', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-218cc744-887d-4ecc-a95b-ec464e53d0fa tempest-VolumesTransfersV355Test-507737760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4521524-e52e-4c2b-bef2-96af1e2198e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:11 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-218cc744-887d-4ecc-a95b-ec464e53d0fa tempest-VolumesTransfersV355Test-507737760 None] Volume volume-6b933781-ce57-4b9a-8d32-dce3e5ed80bc (6b933781-ce57-4b9a-8d32-dce3e5ed80bc): created successfully Sep 03 14:26:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-218cc744-887d-4ecc-a95b-ec464e53d0fa tempest-VolumesTransfersV355Test-507737760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4521524-e52e-4c2b-bef2-96af1e2198e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-218cc744-887d-4ecc-a95b-ec464e53d0fa tempest-VolumesTransfersV355Test-507737760 None] Flow 'volume_create_manager' (3f46c906-e62b-4af6-b4f9-ae6c27b6c02b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:26:11 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-218cc744-887d-4ecc-a95b-ec464e53d0fa tempest-VolumesTransfersV355Test-507737760 None] Created volume successfully. Sep 03 14:26:13 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-96510f42-d256-4534-9e75-28df623b4e11 tempest-VolumesTransfersV355Test-1459868000 None] Acquiring lock "cinder-6b933781-ce57-4b9a-8d32-dce3e5ed80bc-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:26:13 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-96510f42-d256-4534-9e75-28df623b4e11 tempest-VolumesTransfersV355Test-1459868000 None] Lock "cinder-6b933781-ce57-4b9a-8d32-dce3e5ed80bc-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:26:13 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-96510f42-d256-4534-9e75-28df623b4e11 tempest-VolumesTransfersV355Test-1459868000 None] Acquiring lock "cinder-quobyte-6b933781-ce57-4b9a-8d32-dce3e5ed80bc" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:26:13 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-96510f42-d256-4534-9e75-28df623b4e11 tempest-VolumesTransfersV355Test-1459868000 None] Lock "cinder-quobyte-6b933781-ce57-4b9a-8d32-dce3e5ed80bc" acquired by "delete_volume" :: waited 0.021s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:26:13 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf35e03-b32d-4815-aede-fac540023eb7]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:26:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-96510f42-d256-4534-9e75-28df623b4e11 tempest-VolumesTransfersV355Test-1459868000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6b933781-ce57-4b9a-8d32-dce3e5ed80bc {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:13 devstack sudo[98281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6b933781-ce57-4b9a-8d32-dce3e5ed80bc Sep 03 14:26:13 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:13 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-96510f42-d256-4534-9e75-28df623b4e11 tempest-VolumesTransfersV355Test-1459868000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6b933781-ce57-4b9a-8d32-dce3e5ed80bc" returned: 0 in 0.474s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-96510f42-d256-4534-9e75-28df623b4e11 tempest-VolumesTransfersV355Test-1459868000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6b933781-ce57-4b9a-8d32-dce3e5ed80bc {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:13 devstack sudo[98286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6b933781-ce57-4b9a-8d32-dce3e5ed80bc Sep 03 14:26:13 devstack sudo[98286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:14 devstack sudo[98286]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-96510f42-d256-4534-9e75-28df623b4e11 tempest-VolumesTransfersV355Test-1459868000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6b933781-ce57-4b9a-8d32-dce3e5ed80bc" returned: 0 in 0.404s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:14 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-96510f42-d256-4534-9e75-28df623b4e11 tempest-VolumesTransfersV355Test-1459868000 None] Lock "cinder-quobyte-6b933781-ce57-4b9a-8d32-dce3e5ed80bc" released by "delete_volume" :: held 0.938s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:26:14 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-96510f42-d256-4534-9e75-28df623b4e11 tempest-VolumesTransfersV355Test-1459868000 None] Created reservations ['f6c788e3-7e41-4fa8-8052-cfd39a19c108', '6f4a2dda-3a4b-49ea-bb92-7460f0858ac1', '299707cd-2251-48d3-8e2b-374a49d38216', '56509196-2630-4242-a82b-8953b5d7b3cd'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:26:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-96510f42-d256-4534-9e75-28df623b4e11 tempest-VolumesTransfersV355Test-1459868000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:26:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-96510f42-d256-4534-9e75-28df623b4e11 tempest-VolumesTransfersV355Test-1459868000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:26:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-96510f42-d256-4534-9e75-28df623b4e11 tempest-VolumesTransfersV355Test-1459868000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:26:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-96510f42-d256-4534-9e75-28df623b4e11 tempest-VolumesTransfersV355Test-1459868000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:26:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-96510f42-d256-4534-9e75-28df623b4e11 tempest-VolumesTransfersV355Test-1459868000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:26:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-96510f42-d256-4534-9e75-28df623b4e11 tempest-VolumesTransfersV355Test-1459868000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:14 devstack sudo[98289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:26:14 devstack sudo[98289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:14 devstack sudo[98289]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-96510f42-d256-4534-9e75-28df623b4e11 tempest-VolumesTransfersV355Test-1459868000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.383s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:14 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-96510f42-d256-4534-9e75-28df623b4e11 tempest-VolumesTransfersV355Test-1459868000 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:26:14 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-96510f42-d256-4534-9e75-28df623b4e11 tempest-VolumesTransfersV355Test-1459868000 None] Deleted volume successfully. Sep 03 14:26:14 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-96510f42-d256-4534-9e75-28df623b4e11 tempest-VolumesTransfersV355Test-1459868000 None] Lock "cinder-6b933781-ce57-4b9a-8d32-dce3e5ed80bc-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:26:22 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [req-53ed7e62-8246-4be4-b2c1-0607d04d130b req-7bfb9de1-6f20-4b56-b0e6-45f9c62717b0 tempest-VolumesGetTestJSON-1952070396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:26:22 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-53ed7e62-8246-4be4-b2c1-0607d04d130b req-7bfb9de1-6f20-4b56-b0e6-45f9c62717b0 tempest-VolumesGetTestJSON-1952070396 None] Flow 'volume_create_manager' (e991174f-97f1-491e-bfb4-ec999e35f70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:26:22 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-53ed7e62-8246-4be4-b2c1-0607d04d130b req-7bfb9de1-6f20-4b56-b0e6-45f9c62717b0 tempest-VolumesGetTestJSON-1952070396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (121155eb-0b4e-4bee-bdf9-ef8c51034901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:22 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-53ed7e62-8246-4be4-b2c1-0607d04d130b req-7bfb9de1-6f20-4b56-b0e6-45f9c62717b0 tempest-VolumesGetTestJSON-1952070396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (121155eb-0b4e-4bee-bdf9-ef8c51034901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1246176448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd32b91b-9df3-4a37-b723-72ee9bf6cfb5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0bcc1c33c6c546b88309d23790d70b2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:26:23Z,use_quota=True,user_id='e8ae58d890e846fcae4d2ae6f1dcb03d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:22 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-53ed7e62-8246-4be4-b2c1-0607d04d130b req-7bfb9de1-6f20-4b56-b0e6-45f9c62717b0 tempest-VolumesGetTestJSON-1952070396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b9a88a6-db9c-4b13-99ed-803df50530dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:22 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-53ed7e62-8246-4be4-b2c1-0607d04d130b req-7bfb9de1-6f20-4b56-b0e6-45f9c62717b0 tempest-VolumesGetTestJSON-1952070396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b9a88a6-db9c-4b13-99ed-803df50530dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:22 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-53ed7e62-8246-4be4-b2c1-0607d04d130b req-7bfb9de1-6f20-4b56-b0e6-45f9c62717b0 tempest-VolumesGetTestJSON-1952070396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11c6c9cd-449c-44f0-905e-935ceb3c56f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:22 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-53ed7e62-8246-4be4-b2c1-0607d04d130b req-7bfb9de1-6f20-4b56-b0e6-45f9c62717b0 tempest-VolumesGetTestJSON-1952070396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11c6c9cd-449c-44f0-905e-935ceb3c56f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd32b91b-9df3-4a37-b723-72ee9bf6cfb5', 'volume_name': 'volume-fd32b91b-9df3-4a37-b723-72ee9bf6cfb5', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:23 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-53ed7e62-8246-4be4-b2c1-0607d04d130b req-7bfb9de1-6f20-4b56-b0e6-45f9c62717b0 tempest-VolumesGetTestJSON-1952070396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2041d7c4-0af9-4ff0-8686-eeb45bb85804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:23 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-53ed7e62-8246-4be4-b2c1-0607d04d130b req-7bfb9de1-6f20-4b56-b0e6-45f9c62717b0 tempest-VolumesGetTestJSON-1952070396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2041d7c4-0af9-4ff0-8686-eeb45bb85804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:23 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-53ed7e62-8246-4be4-b2c1-0607d04d130b req-7bfb9de1-6f20-4b56-b0e6-45f9c62717b0 tempest-VolumesGetTestJSON-1952070396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0ea1abe-a7dc-47c1-951c-6e63ceb99612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:23 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [req-53ed7e62-8246-4be4-b2c1-0607d04d130b req-7bfb9de1-6f20-4b56-b0e6-45f9c62717b0 tempest-VolumesGetTestJSON-1952070396 None] Volume fd32b91b-9df3-4a37-b723-72ee9bf6cfb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd32b91b-9df3-4a37-b723-72ee9bf6cfb5', 'volume_size': 1} Sep 03 14:26:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-53ed7e62-8246-4be4-b2c1-0607d04d130b req-7bfb9de1-6f20-4b56-b0e6-45f9c62717b0 tempest-VolumesGetTestJSON-1952070396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:26:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-53ed7e62-8246-4be4-b2c1-0607d04d130b req-7bfb9de1-6f20-4b56-b0e6-45f9c62717b0 tempest-VolumesGetTestJSON-1952070396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:26:23 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [req-53ed7e62-8246-4be4-b2c1-0607d04d130b req-7bfb9de1-6f20-4b56-b0e6-45f9c62717b0 tempest-VolumesGetTestJSON-1952070396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1246176448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd32b91b-9df3-4a37-b723-72ee9bf6cfb5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0bcc1c33c6c546b88309d23790d70b2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:26:23Z,use_quota=True,user_id='e8ae58d890e846fcae4d2ae6f1dcb03d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:26:23 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [req-53ed7e62-8246-4be4-b2c1-0607d04d130b req-7bfb9de1-6f20-4b56-b0e6-45f9c62717b0 tempest-VolumesGetTestJSON-1952070396 None] Creating volume fd32b91b-9df3-4a37-b723-72ee9bf6cfb5 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:26:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-53ed7e62-8246-4be4-b2c1-0607d04d130b req-7bfb9de1-6f20-4b56-b0e6-45f9c62717b0 tempest-VolumesGetTestJSON-1952070396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:26:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-53ed7e62-8246-4be4-b2c1-0607d04d130b req-7bfb9de1-6f20-4b56-b0e6-45f9c62717b0 tempest-VolumesGetTestJSON-1952070396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:26:23 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [req-53ed7e62-8246-4be4-b2c1-0607d04d130b req-7bfb9de1-6f20-4b56-b0e6-45f9c62717b0 tempest-VolumesGetTestJSON-1952070396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:26:23 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [req-53ed7e62-8246-4be4-b2c1-0607d04d130b req-7bfb9de1-6f20-4b56-b0e6-45f9c62717b0 tempest-VolumesGetTestJSON-1952070396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:26:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-53ed7e62-8246-4be4-b2c1-0607d04d130b req-7bfb9de1-6f20-4b56-b0e6-45f9c62717b0 tempest-VolumesGetTestJSON-1952070396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:26:23 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [req-53ed7e62-8246-4be4-b2c1-0607d04d130b req-7bfb9de1-6f20-4b56-b0e6-45f9c62717b0 tempest-VolumesGetTestJSON-1952070396 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:26:23 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [req-53ed7e62-8246-4be4-b2c1-0607d04d130b req-7bfb9de1-6f20-4b56-b0e6-45f9c62717b0 tempest-VolumesGetTestJSON-1952070396 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:26:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-53ed7e62-8246-4be4-b2c1-0607d04d130b req-7bfb9de1-6f20-4b56-b0e6-45f9c62717b0 tempest-VolumesGetTestJSON-1952070396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fd32b91b-9df3-4a37-b723-72ee9bf6cfb5 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:23 devstack sudo[98305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fd32b91b-9df3-4a37-b723-72ee9bf6cfb5 1073741824 Sep 03 14:26:23 devstack sudo[98305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:23 devstack sudo[98305]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-53ed7e62-8246-4be4-b2c1-0607d04d130b req-7bfb9de1-6f20-4b56-b0e6-45f9c62717b0 tempest-VolumesGetTestJSON-1952070396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fd32b91b-9df3-4a37-b723-72ee9bf6cfb5 1073741824" returned: 0 in 0.686s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-53ed7e62-8246-4be4-b2c1-0607d04d130b req-7bfb9de1-6f20-4b56-b0e6-45f9c62717b0 tempest-VolumesGetTestJSON-1952070396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fd32b91b-9df3-4a37-b723-72ee9bf6cfb5 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:23 devstack sudo[98328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fd32b91b-9df3-4a37-b723-72ee9bf6cfb5 Sep 03 14:26:23 devstack sudo[98328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:24 devstack sudo[98328]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-53ed7e62-8246-4be4-b2c1-0607d04d130b req-7bfb9de1-6f20-4b56-b0e6-45f9c62717b0 tempest-VolumesGetTestJSON-1952070396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fd32b91b-9df3-4a37-b723-72ee9bf6cfb5" returned: 0 in 0.354s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:24 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [req-53ed7e62-8246-4be4-b2c1-0607d04d130b req-7bfb9de1-6f20-4b56-b0e6-45f9c62717b0 tempest-VolumesGetTestJSON-1952070396 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:26:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-53ed7e62-8246-4be4-b2c1-0607d04d130b req-7bfb9de1-6f20-4b56-b0e6-45f9c62717b0 tempest-VolumesGetTestJSON-1952070396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:26:24 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-53ed7e62-8246-4be4-b2c1-0607d04d130b req-7bfb9de1-6f20-4b56-b0e6-45f9c62717b0 tempest-VolumesGetTestJSON-1952070396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0ea1abe-a7dc-47c1-951c-6e63ceb99612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd32b91b-9df3-4a37-b723-72ee9bf6cfb5', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:24 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-53ed7e62-8246-4be4-b2c1-0607d04d130b req-7bfb9de1-6f20-4b56-b0e6-45f9c62717b0 tempest-VolumesGetTestJSON-1952070396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbdec2c1-b293-4603-97e3-6007ba9a8229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:24 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [req-53ed7e62-8246-4be4-b2c1-0607d04d130b req-7bfb9de1-6f20-4b56-b0e6-45f9c62717b0 tempest-VolumesGetTestJSON-1952070396 None] Volume volume-fd32b91b-9df3-4a37-b723-72ee9bf6cfb5 (fd32b91b-9df3-4a37-b723-72ee9bf6cfb5): created successfully Sep 03 14:26:24 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-53ed7e62-8246-4be4-b2c1-0607d04d130b req-7bfb9de1-6f20-4b56-b0e6-45f9c62717b0 tempest-VolumesGetTestJSON-1952070396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbdec2c1-b293-4603-97e3-6007ba9a8229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:24 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-53ed7e62-8246-4be4-b2c1-0607d04d130b req-7bfb9de1-6f20-4b56-b0e6-45f9c62717b0 tempest-VolumesGetTestJSON-1952070396 None] Flow 'volume_create_manager' (e991174f-97f1-491e-bfb4-ec999e35f70a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:26:24 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-53ed7e62-8246-4be4-b2c1-0607d04d130b req-7bfb9de1-6f20-4b56-b0e6-45f9c62717b0 tempest-VolumesGetTestJSON-1952070396 None] Created volume successfully. Sep 03 14:26:25 devstack cinder-volume[87007]: DEBUG cinder.coordination [req-237b435b-16f3-4fe7-82a5-2178a8cec945 req-519cf9db-0f4f-41ce-b748-cbcc2e579990 tempest-VolumesGetTestJSON-1952070396 None] Acquiring lock "cinder-fd32b91b-9df3-4a37-b723-72ee9bf6cfb5-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:26:25 devstack cinder-volume[87007]: DEBUG cinder.coordination [req-237b435b-16f3-4fe7-82a5-2178a8cec945 req-519cf9db-0f4f-41ce-b748-cbcc2e579990 tempest-VolumesGetTestJSON-1952070396 None] Lock "cinder-fd32b91b-9df3-4a37-b723-72ee9bf6cfb5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:26:25 devstack cinder-volume[87007]: DEBUG cinder.coordination [req-237b435b-16f3-4fe7-82a5-2178a8cec945 req-519cf9db-0f4f-41ce-b748-cbcc2e579990 tempest-VolumesGetTestJSON-1952070396 None] Acquiring lock "cinder-quobyte-fd32b91b-9df3-4a37-b723-72ee9bf6cfb5" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:26:25 devstack cinder-volume[87007]: DEBUG cinder.coordination [req-237b435b-16f3-4fe7-82a5-2178a8cec945 req-519cf9db-0f4f-41ce-b748-cbcc2e579990 tempest-VolumesGetTestJSON-1952070396 None] Lock "cinder-quobyte-fd32b91b-9df3-4a37-b723-72ee9bf6cfb5" acquired by "delete_volume" :: waited 0.024s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:26:25 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[944679da-6aab-4431-9b77-c28d97e1260e]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:26:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-237b435b-16f3-4fe7-82a5-2178a8cec945 req-519cf9db-0f4f-41ce-b748-cbcc2e579990 tempest-VolumesGetTestJSON-1952070396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fd32b91b-9df3-4a37-b723-72ee9bf6cfb5 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:25 devstack sudo[98338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fd32b91b-9df3-4a37-b723-72ee9bf6cfb5 Sep 03 14:26:25 devstack sudo[98338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:26 devstack sudo[98338]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-237b435b-16f3-4fe7-82a5-2178a8cec945 req-519cf9db-0f4f-41ce-b748-cbcc2e579990 tempest-VolumesGetTestJSON-1952070396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fd32b91b-9df3-4a37-b723-72ee9bf6cfb5" returned: 0 in 0.472s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-237b435b-16f3-4fe7-82a5-2178a8cec945 req-519cf9db-0f4f-41ce-b748-cbcc2e579990 tempest-VolumesGetTestJSON-1952070396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fd32b91b-9df3-4a37-b723-72ee9bf6cfb5 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:26 devstack sudo[98344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fd32b91b-9df3-4a37-b723-72ee9bf6cfb5 Sep 03 14:26:26 devstack sudo[98344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:26 devstack sudo[98344]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-237b435b-16f3-4fe7-82a5-2178a8cec945 req-519cf9db-0f4f-41ce-b748-cbcc2e579990 tempest-VolumesGetTestJSON-1952070396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fd32b91b-9df3-4a37-b723-72ee9bf6cfb5" returned: 0 in 0.290s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:26 devstack cinder-volume[87007]: DEBUG cinder.coordination [req-237b435b-16f3-4fe7-82a5-2178a8cec945 req-519cf9db-0f4f-41ce-b748-cbcc2e579990 tempest-VolumesGetTestJSON-1952070396 None] Lock "cinder-quobyte-fd32b91b-9df3-4a37-b723-72ee9bf6cfb5" released by "delete_volume" :: held 0.808s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:26:26 devstack cinder-volume[87007]: DEBUG cinder.quota [req-237b435b-16f3-4fe7-82a5-2178a8cec945 req-519cf9db-0f4f-41ce-b748-cbcc2e579990 tempest-VolumesGetTestJSON-1952070396 None] Created reservations ['c4dcf72f-f557-49a9-a0d5-8c890568ca2f', 'a49b39e3-44bb-499b-ae02-12ee1ba6f104', 'c41ede60-fb76-4d50-a9e9-29d00cf3b2f9', '495e4a38-3ee1-45fc-9e43-70a77cf92967'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:26:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-237b435b-16f3-4fe7-82a5-2178a8cec945 req-519cf9db-0f4f-41ce-b748-cbcc2e579990 tempest-VolumesGetTestJSON-1952070396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:26:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-237b435b-16f3-4fe7-82a5-2178a8cec945 req-519cf9db-0f4f-41ce-b748-cbcc2e579990 tempest-VolumesGetTestJSON-1952070396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:26:26 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [req-237b435b-16f3-4fe7-82a5-2178a8cec945 req-519cf9db-0f4f-41ce-b748-cbcc2e579990 tempest-VolumesGetTestJSON-1952070396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:26:26 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [req-237b435b-16f3-4fe7-82a5-2178a8cec945 req-519cf9db-0f4f-41ce-b748-cbcc2e579990 tempest-VolumesGetTestJSON-1952070396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:26:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-237b435b-16f3-4fe7-82a5-2178a8cec945 req-519cf9db-0f4f-41ce-b748-cbcc2e579990 tempest-VolumesGetTestJSON-1952070396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:26:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-237b435b-16f3-4fe7-82a5-2178a8cec945 req-519cf9db-0f4f-41ce-b748-cbcc2e579990 tempest-VolumesGetTestJSON-1952070396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:26 devstack sudo[98347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:26:26 devstack sudo[98347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:26 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:26:26 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Flow 'volume_create_manager' (affd447c-575b-4a59-9a7f-38ba9739c4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:26:26 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff3e60f-3a6b-43c3-9f19-b90f2880bdea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:26 devstack sudo[98347]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-237b435b-16f3-4fe7-82a5-2178a8cec945 req-519cf9db-0f4f-41ce-b748-cbcc2e579990 tempest-VolumesGetTestJSON-1952070396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.388s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:27 devstack cinder-volume[87007]: DEBUG cinder.manager [req-237b435b-16f3-4fe7-82a5-2178a8cec945 req-519cf9db-0f4f-41ce-b748-cbcc2e579990 tempest-VolumesGetTestJSON-1952070396 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:26:27 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-237b435b-16f3-4fe7-82a5-2178a8cec945 req-519cf9db-0f4f-41ce-b748-cbcc2e579990 tempest-VolumesGetTestJSON-1952070396 None] Deleted volume successfully. Sep 03 14:26:27 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff3e60f-3a6b-43c3-9f19-b90f2880bdea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-65305041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48453574-9bc5-4f0a-bed5-d3cabd5be584,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fb4759ae6da4ed699515b1252ac28eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:26:27Z,use_quota=True,user_id='68fcc4533e584764bb09e5c63f529ab9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:27 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (918582b4-9347-4a6f-bf1a-284538f6969c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:27 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (918582b4-9347-4a6f-bf1a-284538f6969c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:27 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e33bed71-8dc3-4425-bf5a-d41841bb6056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:27 devstack cinder-volume[87007]: DEBUG cinder.image.glance [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Creating Keystone auth plugin from conf {{(pid=87007) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 14:26:27 devstack cinder-volume[87007]: DEBUG cinder.coordination [req-237b435b-16f3-4fe7-82a5-2178a8cec945 req-519cf9db-0f4f-41ce-b748-cbcc2e579990 tempest-VolumesGetTestJSON-1952070396 None] Lock "cinder-fd32b91b-9df3-4a37-b723-72ee9bf6cfb5-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:26:27 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e33bed71-8dc3-4425-bf5a-d41841bb6056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '48453574-9bc5-4f0a-bed5-d3cabd5be584', 'volume_name': 'volume-48453574-9bc5-4f0a-bed5-d3cabd5be584', 'volume_size': 1, 'image_id': '49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd4e87261137045028f09a9da96d0acd8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'created_at': datetime.datetime(2026, 9, 3, 12, 12, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 12, 12, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/49981579-d0a4-4b4a-9bc6-bd809c76cea9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:27 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c73c633-b4b2-4e08-9bfe-db873fb0a0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:27 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c73c633-b4b2-4e08-9bfe-db873fb0a0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:27 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78a21609-50cc-4506-b71a-bd35db9c8bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:27 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Volume 48453574-9bc5-4f0a-bed5-d3cabd5be584: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-48453574-9bc5-4f0a-bed5-d3cabd5be584', 'volume_size': 1, 'image_id': '49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd4e87261137045028f09a9da96d0acd8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'created_at': datetime.datetime(2026, 9, 3, 12, 12, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 12, 12, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/49981579-d0a4-4b4a-9bc6-bd809c76cea9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 03 14:26:27 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Trying to clone 48453574-9bc5-4f0a-bed5-d3cabd5be584 from image 49981579-d0a4-4b4a-9bc6-bd809c76cea9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'metadata': {}}]). {{(pid=87007) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 14:26:28 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9__rlvww37devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87007) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 14:26:28 devstack cinder-volume[87007]: INFO cinder.image.image_utils [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Image download 20.69 MB at 20.69 MB/s Sep 03 14:26:28 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be58ed1-53e2-41c8-9826-a64850b1f3cc]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:26:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9__rlvww37devstack@QuobyteHD {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:28 devstack sudo[98351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9__rlvww37devstack@QuobyteHD Sep 03 14:26:28 devstack sudo[98351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:28 devstack sudo[98351]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9__rlvww37devstack@QuobyteHD" returned: 0 in 0.446s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:28 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Temporary image 49981579-d0a4-4b4a-9bc6-bd809c76cea9 is fetched for user 68fcc4533e584764bb09e5c63f529ab9. {{(pid=87007) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 14:26:28 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e307377-6b9b-4687-95ea-9674280a7b2c]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:26:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9__rlvww37devstack@QuobyteHD {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:29 devstack sudo[98356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9__rlvww37devstack@QuobyteHD Sep 03 14:26:29 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:29 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9__rlvww37devstack@QuobyteHD" returned: 0 in 0.433s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:26:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:26:29 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-65305041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48453574-9bc5-4f0a-bed5-d3cabd5be584,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fb4759ae6da4ed699515b1252ac28eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:26:27Z,use_quota=True,user_id='68fcc4533e584764bb09e5c63f529ab9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:26:29 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Creating volume 48453574-9bc5-4f0a-bed5-d3cabd5be584 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:26:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:26:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:26:29 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:26:29 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:26:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:26:29 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:26:29 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:26:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-48453574-9bc5-4f0a-bed5-d3cabd5be584 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:29 devstack sudo[98361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-48453574-9bc5-4f0a-bed5-d3cabd5be584 1073741824 Sep 03 14:26:29 devstack sudo[98361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:29 devstack sudo[98361]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-48453574-9bc5-4f0a-bed5-d3cabd5be584 1073741824" returned: 0 in 0.506s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-48453574-9bc5-4f0a-bed5-d3cabd5be584 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:29 devstack sudo[98367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-48453574-9bc5-4f0a-bed5-d3cabd5be584 Sep 03 14:26:29 devstack sudo[98367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:30 devstack sudo[98367]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-48453574-9bc5-4f0a-bed5-d3cabd5be584" returned: 0 in 0.317s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:30 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:26:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:26:30 devstack cinder-volume[87007]: DEBUG cinder.volume.volume_utils [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Attempting download of 49981579-d0a4-4b4a-9bc6-bd809c76cea9 ((None, [{'url': 'file:///opt/stack/data/glance/images/49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'metadata': {}}])) to volume 48453574-9bc5-4f0a-bed5-d3cabd5be584. {{(pid=87007) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 14:26:30 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[25857111-d194-413d-b496-1b26287d02c9]: (4, 'raw') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:26:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_49981579-d0a4-4b4a-9bc6-bd809c76cea9_u4crwbj5 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:30 devstack sudo[98370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_49981579-d0a4-4b4a-9bc6-bd809c76cea9_u4crwbj5 Sep 03 14:26:30 devstack sudo[98370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:30 devstack sudo[98370]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_49981579-d0a4-4b4a-9bc6-bd809c76cea9_u4crwbj5" returned: 0 in 0.368s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49981579-d0a4-4b4a-9bc6-bd809c76cea9_u4crwbj5 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:30 devstack sudo[98374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49981579-d0a4-4b4a-9bc6-bd809c76cea9_u4crwbj5 Sep 03 14:26:30 devstack sudo[98374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:31 devstack sudo[98374]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49981579-d0a4-4b4a-9bc6-bd809c76cea9_u4crwbj5" returned: 1 in 0.395s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49981579-d0a4-4b4a-9bc6-bd809c76cea9_u4crwbj5' failed. Not Retrying. {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 14:26:31 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[724f4806-6fc9-45f1-8b4f-52b41ce58f56]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:26:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9__rlvww37devstack@QuobyteHD {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:31 devstack sudo[98378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9__rlvww37devstack@QuobyteHD Sep 03 14:26:31 devstack sudo[98378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:31 devstack sudo[98378]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9__rlvww37devstack@QuobyteHD" returned: 0 in 0.424s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:31 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] 49981579-d0a4-4b4a-9bc6-bd809c76cea9 was qcow2, converting to qcow2 {{(pid=87007) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 14:26:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9__rlvww37devstack@QuobyteHD /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-48453574-9bc5-4f0a-bed5-d3cabd5be584 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:31 devstack sudo[98383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9__rlvww37devstack@QuobyteHD /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-48453574-9bc5-4f0a-bed5-d3cabd5be584 Sep 03 14:26:31 devstack sudo[98383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:31 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-70af3026-d612-4299-a043-d97e9184e6de tempest-VolumesTestJSON-568021321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:26:31 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-70af3026-d612-4299-a043-d97e9184e6de tempest-VolumesTestJSON-568021321 None] Flow 'volume_create_manager' (1be25a9b-fcbc-4a50-ad11-7604931c41ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:26:31 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-70af3026-d612-4299-a043-d97e9184e6de tempest-VolumesTestJSON-568021321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b3a2366-a26c-4d89-8fc2-f5d07830a875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:31 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-70af3026-d612-4299-a043-d97e9184e6de tempest-VolumesTestJSON-568021321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b3a2366-a26c-4d89-8fc2-f5d07830a875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1096849477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f384185-b961-42e6-8bfc-8789d8affbe2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d594bb815cd3452284bdf63b8d4c8476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:26:32Z,use_quota=True,user_id='303c1fdaac3a47a490e85bb34134ff15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:31 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-70af3026-d612-4299-a043-d97e9184e6de tempest-VolumesTestJSON-568021321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (407a8ff3-76f9-4b57-9181-27534e1e0c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:31 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-70af3026-d612-4299-a043-d97e9184e6de tempest-VolumesTestJSON-568021321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (407a8ff3-76f9-4b57-9181-27534e1e0c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:31 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-70af3026-d612-4299-a043-d97e9184e6de tempest-VolumesTestJSON-568021321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9841baf7-2cc8-4b8d-867d-cfbcda8f795d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:31 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-70af3026-d612-4299-a043-d97e9184e6de tempest-VolumesTestJSON-568021321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9841baf7-2cc8-4b8d-867d-cfbcda8f795d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f384185-b961-42e6-8bfc-8789d8affbe2', 'volume_name': 'volume-6f384185-b961-42e6-8bfc-8789d8affbe2', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:31 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-70af3026-d612-4299-a043-d97e9184e6de tempest-VolumesTestJSON-568021321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e8d3e3a-6e90-4e89-9d6c-b3fe0ffa9751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:31 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-70af3026-d612-4299-a043-d97e9184e6de tempest-VolumesTestJSON-568021321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e8d3e3a-6e90-4e89-9d6c-b3fe0ffa9751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:31 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-70af3026-d612-4299-a043-d97e9184e6de tempest-VolumesTestJSON-568021321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dabb5735-9a32-4a4d-a746-83762dc4eff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:31 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-70af3026-d612-4299-a043-d97e9184e6de tempest-VolumesTestJSON-568021321 None] Volume 6f384185-b961-42e6-8bfc-8789d8affbe2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f384185-b961-42e6-8bfc-8789d8affbe2', 'volume_size': 1} Sep 03 14:26:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-70af3026-d612-4299-a043-d97e9184e6de tempest-VolumesTestJSON-568021321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:26:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-70af3026-d612-4299-a043-d97e9184e6de tempest-VolumesTestJSON-568021321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:26:31 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-70af3026-d612-4299-a043-d97e9184e6de tempest-VolumesTestJSON-568021321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1096849477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f384185-b961-42e6-8bfc-8789d8affbe2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d594bb815cd3452284bdf63b8d4c8476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:26:32Z,use_quota=True,user_id='303c1fdaac3a47a490e85bb34134ff15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:26:31 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-70af3026-d612-4299-a043-d97e9184e6de tempest-VolumesTestJSON-568021321 None] Creating volume 6f384185-b961-42e6-8bfc-8789d8affbe2 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:26:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-70af3026-d612-4299-a043-d97e9184e6de tempest-VolumesTestJSON-568021321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:26:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-70af3026-d612-4299-a043-d97e9184e6de tempest-VolumesTestJSON-568021321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:26:31 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-70af3026-d612-4299-a043-d97e9184e6de tempest-VolumesTestJSON-568021321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:26:31 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-70af3026-d612-4299-a043-d97e9184e6de tempest-VolumesTestJSON-568021321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:26:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-70af3026-d612-4299-a043-d97e9184e6de tempest-VolumesTestJSON-568021321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:26:31 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-70af3026-d612-4299-a043-d97e9184e6de tempest-VolumesTestJSON-568021321 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:26:31 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-70af3026-d612-4299-a043-d97e9184e6de tempest-VolumesTestJSON-568021321 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:26:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-70af3026-d612-4299-a043-d97e9184e6de tempest-VolumesTestJSON-568021321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6f384185-b961-42e6-8bfc-8789d8affbe2 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:31 devstack sudo[98388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6f384185-b961-42e6-8bfc-8789d8affbe2 1073741824 Sep 03 14:26:31 devstack sudo[98388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:32 devstack sudo[98388]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-70af3026-d612-4299-a043-d97e9184e6de tempest-VolumesTestJSON-568021321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6f384185-b961-42e6-8bfc-8789d8affbe2 1073741824" returned: 0 in 0.571s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-70af3026-d612-4299-a043-d97e9184e6de tempest-VolumesTestJSON-568021321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6f384185-b961-42e6-8bfc-8789d8affbe2 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:32 devstack sudo[98396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6f384185-b961-42e6-8bfc-8789d8affbe2 Sep 03 14:26:32 devstack sudo[98396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:32 devstack sudo[98396]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-70af3026-d612-4299-a043-d97e9184e6de tempest-VolumesTestJSON-568021321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6f384185-b961-42e6-8bfc-8789d8affbe2" returned: 0 in 0.333s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:32 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-70af3026-d612-4299-a043-d97e9184e6de tempest-VolumesTestJSON-568021321 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:26:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-70af3026-d612-4299-a043-d97e9184e6de tempest-VolumesTestJSON-568021321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:26:32 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-70af3026-d612-4299-a043-d97e9184e6de tempest-VolumesTestJSON-568021321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dabb5735-9a32-4a4d-a746-83762dc4eff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f384185-b961-42e6-8bfc-8789d8affbe2', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:32 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-70af3026-d612-4299-a043-d97e9184e6de tempest-VolumesTestJSON-568021321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (873654dd-5cf5-4a11-9689-b686f73396b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:32 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-70af3026-d612-4299-a043-d97e9184e6de tempest-VolumesTestJSON-568021321 None] Volume volume-6f384185-b961-42e6-8bfc-8789d8affbe2 (6f384185-b961-42e6-8bfc-8789d8affbe2): created successfully Sep 03 14:26:32 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-70af3026-d612-4299-a043-d97e9184e6de tempest-VolumesTestJSON-568021321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (873654dd-5cf5-4a11-9689-b686f73396b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:32 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-70af3026-d612-4299-a043-d97e9184e6de tempest-VolumesTestJSON-568021321 None] Flow 'volume_create_manager' (1be25a9b-fcbc-4a50-ad11-7604931c41ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:26:32 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-70af3026-d612-4299-a043-d97e9184e6de tempest-VolumesTestJSON-568021321 None] Created volume successfully. Sep 03 14:26:33 devstack sudo[98383]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:33 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9__rlvww37devstack@QuobyteHD /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-48453574-9bc5-4f0a-bed5-d3cabd5be584" returned: 0 in 2.054s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:33 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9__rlvww37devstack@QuobyteHD, size 112.00 MB, duration 2.06 sec, destination /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-48453574-9bc5-4f0a-bed5-d3cabd5be584 {{(pid=87007) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 14:26:33 devstack cinder-volume[87007]: INFO cinder.image.image_utils [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Converted 112.00 MB image at 54.50 MB/s Sep 03 14:26:33 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-48453574-9bc5-4f0a-bed5-d3cabd5be584 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:33 devstack sudo[98400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-48453574-9bc5-4f0a-bed5-d3cabd5be584 1G Sep 03 14:26:33 devstack sudo[98400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:33 devstack sudo[98400]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:33 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-48453574-9bc5-4f0a-bed5-d3cabd5be584 1G" returned: 0 in 0.356s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:33 devstack cinder-volume[87007]: DEBUG cinder.volume.volume_utils [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Downloaded image 49981579-d0a4-4b4a-9bc6-bd809c76cea9 ((None, [{'url': 'file:///opt/stack/data/glance/images/49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'metadata': {}}])) to volume 48453574-9bc5-4f0a-bed5-d3cabd5be584 successfully. {{(pid=87007) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 14:26:33 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Temporary image 49981579-d0a4-4b4a-9bc6-bd809c76cea9 for user 68fcc4533e584764bb09e5c63f529ab9 is deleted. {{(pid=87007) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 14:26:33 devstack cinder-volume[87007]: DEBUG cinder.volume.volume_utils [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Marking volume 48453574-9bc5-4f0a-bed5-d3cabd5be584 as bootable. {{(pid=87007) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 14:26:33 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Copying metadata from image 49981579-d0a4-4b4a-9bc6-bd809c76cea9 to 48453574-9bc5-4f0a-bed5-d3cabd5be584. {{(pid=87007) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 14:26:33 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Creating volume glance metadata for volume 48453574-9bc5-4f0a-bed5-d3cabd5be584 backed by image 49981579-d0a4-4b4a-9bc6-bd809c76cea9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87007) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 14:26:34 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78a21609-50cc-4506-b71a-bd35db9c8bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48453574-9bc5-4f0a-bed5-d3cabd5be584', 'volume_size': 1, 'image_id': '49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd4e87261137045028f09a9da96d0acd8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'created_at': datetime.datetime(2026, 9, 3, 12, 12, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 12, 12, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/49981579-d0a4-4b4a-9bc6-bd809c76cea9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:34 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e54e7a4-c98a-4f24-8328-f94a8cdc89de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:34 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Volume volume-48453574-9bc5-4f0a-bed5-d3cabd5be584 (48453574-9bc5-4f0a-bed5-d3cabd5be584): created successfully Sep 03 14:26:34 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e54e7a4-c98a-4f24-8328-f94a8cdc89de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:34 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Flow 'volume_create_manager' (affd447c-575b-4a59-9a7f-38ba9739c4c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:26:34 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-503c1dbb-ff7a-4c70-a97c-88bde9e6ea03 tempest-VolumesImageMetadata-1484709053 None] Created volume successfully. Sep 03 14:26:34 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-39c87408-aee3-49aa-8484-389aca50017f tempest-VolumesTestJSON-568021321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:26:34 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-39c87408-aee3-49aa-8484-389aca50017f tempest-VolumesTestJSON-568021321 None] Flow 'volume_create_manager' (e2d40e41-6890-4ab5-821a-d7aa2ae95daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:26:34 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-39c87408-aee3-49aa-8484-389aca50017f tempest-VolumesTestJSON-568021321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67a77f76-d693-459a-9ced-e1188bd675ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:34 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-39c87408-aee3-49aa-8484-389aca50017f tempest-VolumesTestJSON-568021321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67a77f76-d693-459a-9ced-e1188bd675ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-964869990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=051fb879-f117-4682-aa7c-8d3a4d06cda8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d594bb815cd3452284bdf63b8d4c8476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:26:34Z,use_quota=True,user_id='303c1fdaac3a47a490e85bb34134ff15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:34 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-39c87408-aee3-49aa-8484-389aca50017f tempest-VolumesTestJSON-568021321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12a60ae6-3a92-4689-8c9b-bf8d59a0a2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:34 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-39c87408-aee3-49aa-8484-389aca50017f tempest-VolumesTestJSON-568021321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12a60ae6-3a92-4689-8c9b-bf8d59a0a2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:34 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-39c87408-aee3-49aa-8484-389aca50017f tempest-VolumesTestJSON-568021321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c37a6754-3878-40a8-929c-b9211cad24e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:34 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-39c87408-aee3-49aa-8484-389aca50017f tempest-VolumesTestJSON-568021321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c37a6754-3878-40a8-929c-b9211cad24e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '051fb879-f117-4682-aa7c-8d3a4d06cda8', 'volume_name': 'volume-051fb879-f117-4682-aa7c-8d3a4d06cda8', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:34 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-39c87408-aee3-49aa-8484-389aca50017f tempest-VolumesTestJSON-568021321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d0dab61-9e03-423f-b9ea-73c166b53b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:34 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-39c87408-aee3-49aa-8484-389aca50017f tempest-VolumesTestJSON-568021321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d0dab61-9e03-423f-b9ea-73c166b53b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:34 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-39c87408-aee3-49aa-8484-389aca50017f tempest-VolumesTestJSON-568021321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8940641a-182c-4ed3-8d16-c696a4c87527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:34 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-39c87408-aee3-49aa-8484-389aca50017f tempest-VolumesTestJSON-568021321 None] Volume 051fb879-f117-4682-aa7c-8d3a4d06cda8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-051fb879-f117-4682-aa7c-8d3a4d06cda8', 'volume_size': 1} Sep 03 14:26:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-39c87408-aee3-49aa-8484-389aca50017f tempest-VolumesTestJSON-568021321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:26:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-39c87408-aee3-49aa-8484-389aca50017f tempest-VolumesTestJSON-568021321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:26:34 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-39c87408-aee3-49aa-8484-389aca50017f tempest-VolumesTestJSON-568021321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-964869990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=051fb879-f117-4682-aa7c-8d3a4d06cda8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d594bb815cd3452284bdf63b8d4c8476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:26:34Z,use_quota=True,user_id='303c1fdaac3a47a490e85bb34134ff15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:26:34 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-39c87408-aee3-49aa-8484-389aca50017f tempest-VolumesTestJSON-568021321 None] Creating volume 051fb879-f117-4682-aa7c-8d3a4d06cda8 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:26:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-39c87408-aee3-49aa-8484-389aca50017f tempest-VolumesTestJSON-568021321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:26:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-39c87408-aee3-49aa-8484-389aca50017f tempest-VolumesTestJSON-568021321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:26:34 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-39c87408-aee3-49aa-8484-389aca50017f tempest-VolumesTestJSON-568021321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:26:34 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-39c87408-aee3-49aa-8484-389aca50017f tempest-VolumesTestJSON-568021321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:26:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-39c87408-aee3-49aa-8484-389aca50017f tempest-VolumesTestJSON-568021321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:26:34 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-39c87408-aee3-49aa-8484-389aca50017f tempest-VolumesTestJSON-568021321 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:26:34 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-39c87408-aee3-49aa-8484-389aca50017f tempest-VolumesTestJSON-568021321 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:26:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-39c87408-aee3-49aa-8484-389aca50017f tempest-VolumesTestJSON-568021321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-051fb879-f117-4682-aa7c-8d3a4d06cda8 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:34 devstack sudo[98406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-051fb879-f117-4682-aa7c-8d3a4d06cda8 1073741824 Sep 03 14:26:34 devstack sudo[98406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:34 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b435a660-7bfc-4278-ad14-44560a94ba7c tempest-VolumesImageMetadata-1484709053 None] Acquiring lock "cinder-48453574-9bc5-4f0a-bed5-d3cabd5be584-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:26:35 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b435a660-7bfc-4278-ad14-44560a94ba7c tempest-VolumesImageMetadata-1484709053 None] Lock "cinder-48453574-9bc5-4f0a-bed5-d3cabd5be584-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:26:35 devstack sudo[98406]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-39c87408-aee3-49aa-8484-389aca50017f tempest-VolumesTestJSON-568021321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-051fb879-f117-4682-aa7c-8d3a4d06cda8 1073741824" returned: 0 in 0.607s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:35 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b435a660-7bfc-4278-ad14-44560a94ba7c tempest-VolumesImageMetadata-1484709053 None] Acquiring lock "cinder-quobyte-48453574-9bc5-4f0a-bed5-d3cabd5be584" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:26:35 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b435a660-7bfc-4278-ad14-44560a94ba7c tempest-VolumesImageMetadata-1484709053 None] Lock "cinder-quobyte-48453574-9bc5-4f0a-bed5-d3cabd5be584" acquired by "delete_volume" :: waited 0.030s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:26:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-39c87408-aee3-49aa-8484-389aca50017f tempest-VolumesTestJSON-568021321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-051fb879-f117-4682-aa7c-8d3a4d06cda8 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:35 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ffece0-3827-43a2-a467-4a96a6b1b8ab]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:26:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b435a660-7bfc-4278-ad14-44560a94ba7c tempest-VolumesImageMetadata-1484709053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-48453574-9bc5-4f0a-bed5-d3cabd5be584 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:35 devstack sudo[98414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-051fb879-f117-4682-aa7c-8d3a4d06cda8 Sep 03 14:26:35 devstack sudo[98414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:35 devstack sudo[98415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-48453574-9bc5-4f0a-bed5-d3cabd5be584 Sep 03 14:26:35 devstack sudo[98415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:35 devstack sudo[98414]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-39c87408-aee3-49aa-8484-389aca50017f tempest-VolumesTestJSON-568021321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-051fb879-f117-4682-aa7c-8d3a4d06cda8" returned: 0 in 0.311s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:35 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-39c87408-aee3-49aa-8484-389aca50017f tempest-VolumesTestJSON-568021321 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:26:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-39c87408-aee3-49aa-8484-389aca50017f tempest-VolumesTestJSON-568021321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:26:35 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-39c87408-aee3-49aa-8484-389aca50017f tempest-VolumesTestJSON-568021321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8940641a-182c-4ed3-8d16-c696a4c87527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-051fb879-f117-4682-aa7c-8d3a4d06cda8', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:35 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-39c87408-aee3-49aa-8484-389aca50017f tempest-VolumesTestJSON-568021321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (361e5ad8-03d2-4fc2-af69-72fc0ffb52e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:35 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-39c87408-aee3-49aa-8484-389aca50017f tempest-VolumesTestJSON-568021321 None] Volume volume-051fb879-f117-4682-aa7c-8d3a4d06cda8 (051fb879-f117-4682-aa7c-8d3a4d06cda8): created successfully Sep 03 14:26:35 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-39c87408-aee3-49aa-8484-389aca50017f tempest-VolumesTestJSON-568021321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (361e5ad8-03d2-4fc2-af69-72fc0ffb52e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:35 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-39c87408-aee3-49aa-8484-389aca50017f tempest-VolumesTestJSON-568021321 None] Flow 'volume_create_manager' (e2d40e41-6890-4ab5-821a-d7aa2ae95daa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:26:35 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-39c87408-aee3-49aa-8484-389aca50017f tempest-VolumesTestJSON-568021321 None] Created volume successfully. Sep 03 14:26:35 devstack sudo[98415]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b435a660-7bfc-4278-ad14-44560a94ba7c tempest-VolumesImageMetadata-1484709053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-48453574-9bc5-4f0a-bed5-d3cabd5be584" returned: 0 in 0.460s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b435a660-7bfc-4278-ad14-44560a94ba7c tempest-VolumesImageMetadata-1484709053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-48453574-9bc5-4f0a-bed5-d3cabd5be584 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:35 devstack sudo[98422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-48453574-9bc5-4f0a-bed5-d3cabd5be584 Sep 03 14:26:35 devstack sudo[98422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:35 devstack sudo[98422]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b435a660-7bfc-4278-ad14-44560a94ba7c tempest-VolumesImageMetadata-1484709053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-48453574-9bc5-4f0a-bed5-d3cabd5be584" returned: 0 in 0.291s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:35 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b435a660-7bfc-4278-ad14-44560a94ba7c tempest-VolumesImageMetadata-1484709053 None] Lock "cinder-quobyte-48453574-9bc5-4f0a-bed5-d3cabd5be584" released by "delete_volume" :: held 0.820s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:26:36 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-b435a660-7bfc-4278-ad14-44560a94ba7c tempest-VolumesImageMetadata-1484709053 None] Created reservations ['7036a3f3-3c86-4bcc-9a86-36c97f58e3b3', '17e8baee-edd9-48a4-b019-218ee163a291', '6218aaeb-5e81-4399-8d66-6a23bd3c4b0f', 'ff11c635-04ac-441a-993a-e14784ebfc62'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:26:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b435a660-7bfc-4278-ad14-44560a94ba7c tempest-VolumesImageMetadata-1484709053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:26:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b435a660-7bfc-4278-ad14-44560a94ba7c tempest-VolumesImageMetadata-1484709053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:26:36 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b435a660-7bfc-4278-ad14-44560a94ba7c tempest-VolumesImageMetadata-1484709053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:26:36 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b435a660-7bfc-4278-ad14-44560a94ba7c tempest-VolumesImageMetadata-1484709053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:26:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b435a660-7bfc-4278-ad14-44560a94ba7c tempest-VolumesImageMetadata-1484709053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:26:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b435a660-7bfc-4278-ad14-44560a94ba7c tempest-VolumesImageMetadata-1484709053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:36 devstack sudo[98426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:26:36 devstack sudo[98426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:36 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-922ec7e4-566f-4b56-b8e6-9228f74855bc tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:26:36 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-922ec7e4-566f-4b56-b8e6-9228f74855bc tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Flow 'volume_create_manager' (9538e923-e649-440b-8789-b1b5938f8bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:26:36 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-922ec7e4-566f-4b56-b8e6-9228f74855bc tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b37c84c-3dbd-4f80-a0c3-45bfcd0b68b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:36 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-922ec7e4-566f-4b56-b8e6-9228f74855bc tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b37c84c-3dbd-4f80-a0c3-45bfcd0b68b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:26:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-175003533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f329944c-541b-4f17-ab38-9b54c024fa9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2cab96229054aa6a4758352d9c70bac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:26:36Z,use_quota=True,user_id='68677841c1b941b1aaa8683d7b7dbb4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:36 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-922ec7e4-566f-4b56-b8e6-9228f74855bc tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28887440-0eb7-4d41-81eb-7d2a69b2c2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:36 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-922ec7e4-566f-4b56-b8e6-9228f74855bc tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28887440-0eb7-4d41-81eb-7d2a69b2c2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:36 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-922ec7e4-566f-4b56-b8e6-9228f74855bc tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb7df1ca-220e-40f7-8fdc-29dd43a02b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:36 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-922ec7e4-566f-4b56-b8e6-9228f74855bc tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb7df1ca-220e-40f7-8fdc-29dd43a02b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f329944c-541b-4f17-ab38-9b54c024fa9f', 'volume_name': 'volume-f329944c-541b-4f17-ab38-9b54c024fa9f', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:36 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-922ec7e4-566f-4b56-b8e6-9228f74855bc tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afda6d0e-8ca0-47a2-a1e3-aeb5fdc889e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:36 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-922ec7e4-566f-4b56-b8e6-9228f74855bc tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afda6d0e-8ca0-47a2-a1e3-aeb5fdc889e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:36 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-922ec7e4-566f-4b56-b8e6-9228f74855bc tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9df6c44-c10b-4409-8f0a-fe4b6638e232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:36 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-922ec7e4-566f-4b56-b8e6-9228f74855bc tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Volume f329944c-541b-4f17-ab38-9b54c024fa9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f329944c-541b-4f17-ab38-9b54c024fa9f', 'volume_size': 1} Sep 03 14:26:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-922ec7e4-566f-4b56-b8e6-9228f74855bc tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:26:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-922ec7e4-566f-4b56-b8e6-9228f74855bc tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:26:36 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-922ec7e4-566f-4b56-b8e6-9228f74855bc tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:26:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-175003533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f329944c-541b-4f17-ab38-9b54c024fa9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2cab96229054aa6a4758352d9c70bac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:26:36Z,use_quota=True,user_id='68677841c1b941b1aaa8683d7b7dbb4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:26:36 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-922ec7e4-566f-4b56-b8e6-9228f74855bc tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Creating volume f329944c-541b-4f17-ab38-9b54c024fa9f {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:26:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-922ec7e4-566f-4b56-b8e6-9228f74855bc tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:26:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-922ec7e4-566f-4b56-b8e6-9228f74855bc tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:26:36 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-922ec7e4-566f-4b56-b8e6-9228f74855bc tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:26:36 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-922ec7e4-566f-4b56-b8e6-9228f74855bc tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:26:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-922ec7e4-566f-4b56-b8e6-9228f74855bc tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:26:36 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-922ec7e4-566f-4b56-b8e6-9228f74855bc tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:26:36 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-922ec7e4-566f-4b56-b8e6-9228f74855bc tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:26:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-922ec7e4-566f-4b56-b8e6-9228f74855bc tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f329944c-541b-4f17-ab38-9b54c024fa9f 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:36 devstack sudo[98428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f329944c-541b-4f17-ab38-9b54c024fa9f 1073741824 Sep 03 14:26:36 devstack sudo[98428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:36 devstack sudo[98426]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b435a660-7bfc-4278-ad14-44560a94ba7c tempest-VolumesImageMetadata-1484709053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.340s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:36 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-b435a660-7bfc-4278-ad14-44560a94ba7c tempest-VolumesImageMetadata-1484709053 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:26:36 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-b435a660-7bfc-4278-ad14-44560a94ba7c tempest-VolumesImageMetadata-1484709053 None] Deleted volume successfully. Sep 03 14:26:36 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b435a660-7bfc-4278-ad14-44560a94ba7c tempest-VolumesImageMetadata-1484709053 None] Lock "cinder-48453574-9bc5-4f0a-bed5-d3cabd5be584-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:26:37 devstack sudo[98428]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-922ec7e4-566f-4b56-b8e6-9228f74855bc tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f329944c-541b-4f17-ab38-9b54c024fa9f 1073741824" returned: 0 in 0.650s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-922ec7e4-566f-4b56-b8e6-9228f74855bc tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f329944c-541b-4f17-ab38-9b54c024fa9f {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:37 devstack sudo[98435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f329944c-541b-4f17-ab38-9b54c024fa9f Sep 03 14:26:37 devstack sudo[98435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:37 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef3570da-549f-4aee-af63-678cebd2996f tempest-VolumesTestJSON-568021321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:26:37 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ef3570da-549f-4aee-af63-678cebd2996f tempest-VolumesTestJSON-568021321 None] Flow 'volume_create_manager' (8e11b5dd-6f77-48dd-a49b-8069e6d51ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:26:37 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ef3570da-549f-4aee-af63-678cebd2996f tempest-VolumesTestJSON-568021321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7591d791-dba4-45b7-aa68-d2a386bdcbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:37 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ef3570da-549f-4aee-af63-678cebd2996f tempest-VolumesTestJSON-568021321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7591d791-dba4-45b7-aa68-d2a386bdcbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1524689240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dad10928-d930-4162-a904-daf4b017bb4f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d594bb815cd3452284bdf63b8d4c8476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:26:37Z,use_quota=True,user_id='303c1fdaac3a47a490e85bb34134ff15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:37 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ef3570da-549f-4aee-af63-678cebd2996f tempest-VolumesTestJSON-568021321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceeeea10-258a-4a5c-b9a3-117376ee877b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:37 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ef3570da-549f-4aee-af63-678cebd2996f tempest-VolumesTestJSON-568021321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceeeea10-258a-4a5c-b9a3-117376ee877b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:37 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ef3570da-549f-4aee-af63-678cebd2996f tempest-VolumesTestJSON-568021321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c057d339-8e9b-468e-ac05-8b6404ada365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:37 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ef3570da-549f-4aee-af63-678cebd2996f tempest-VolumesTestJSON-568021321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c057d339-8e9b-468e-ac05-8b6404ada365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dad10928-d930-4162-a904-daf4b017bb4f', 'volume_name': 'volume-dad10928-d930-4162-a904-daf4b017bb4f', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:37 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ef3570da-549f-4aee-af63-678cebd2996f tempest-VolumesTestJSON-568021321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (265300a2-6c7a-45a5-aa52-168255f2f92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:37 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ef3570da-549f-4aee-af63-678cebd2996f tempest-VolumesTestJSON-568021321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (265300a2-6c7a-45a5-aa52-168255f2f92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:37 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ef3570da-549f-4aee-af63-678cebd2996f tempest-VolumesTestJSON-568021321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bd8e209-1831-4563-981d-456c6f4042e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:37 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-ef3570da-549f-4aee-af63-678cebd2996f tempest-VolumesTestJSON-568021321 None] Volume dad10928-d930-4162-a904-daf4b017bb4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dad10928-d930-4162-a904-daf4b017bb4f', 'volume_size': 1} Sep 03 14:26:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ef3570da-549f-4aee-af63-678cebd2996f tempest-VolumesTestJSON-568021321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:26:37 devstack sudo[98435]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-922ec7e4-566f-4b56-b8e6-9228f74855bc tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f329944c-541b-4f17-ab38-9b54c024fa9f" returned: 0 in 0.356s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:37 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-922ec7e4-566f-4b56-b8e6-9228f74855bc tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:26:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-922ec7e4-566f-4b56-b8e6-9228f74855bc tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:26:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ef3570da-549f-4aee-af63-678cebd2996f tempest-VolumesTestJSON-568021321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.140s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:26:37 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ef3570da-549f-4aee-af63-678cebd2996f tempest-VolumesTestJSON-568021321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1524689240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dad10928-d930-4162-a904-daf4b017bb4f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d594bb815cd3452284bdf63b8d4c8476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:26:37Z,use_quota=True,user_id='303c1fdaac3a47a490e85bb34134ff15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:26:37 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-ef3570da-549f-4aee-af63-678cebd2996f tempest-VolumesTestJSON-568021321 None] Creating volume dad10928-d930-4162-a904-daf4b017bb4f {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:26:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ef3570da-549f-4aee-af63-678cebd2996f tempest-VolumesTestJSON-568021321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:26:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ef3570da-549f-4aee-af63-678cebd2996f tempest-VolumesTestJSON-568021321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:26:37 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ef3570da-549f-4aee-af63-678cebd2996f tempest-VolumesTestJSON-568021321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:26:37 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ef3570da-549f-4aee-af63-678cebd2996f tempest-VolumesTestJSON-568021321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:26:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ef3570da-549f-4aee-af63-678cebd2996f tempest-VolumesTestJSON-568021321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:26:37 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ef3570da-549f-4aee-af63-678cebd2996f tempest-VolumesTestJSON-568021321 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:26:37 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-ef3570da-549f-4aee-af63-678cebd2996f tempest-VolumesTestJSON-568021321 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:26:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ef3570da-549f-4aee-af63-678cebd2996f tempest-VolumesTestJSON-568021321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dad10928-d930-4162-a904-daf4b017bb4f 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:37 devstack sudo[98438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dad10928-d930-4162-a904-daf4b017bb4f 1073741824 Sep 03 14:26:37 devstack sudo[98438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:37 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-922ec7e4-566f-4b56-b8e6-9228f74855bc tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9df6c44-c10b-4409-8f0a-fe4b6638e232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f329944c-541b-4f17-ab38-9b54c024fa9f', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:37 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-922ec7e4-566f-4b56-b8e6-9228f74855bc tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0840a7ae-91a5-4b17-bda6-e1ed56735d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:37 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-922ec7e4-566f-4b56-b8e6-9228f74855bc tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Volume volume-f329944c-541b-4f17-ab38-9b54c024fa9f (f329944c-541b-4f17-ab38-9b54c024fa9f): created successfully Sep 03 14:26:37 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-922ec7e4-566f-4b56-b8e6-9228f74855bc tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0840a7ae-91a5-4b17-bda6-e1ed56735d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:37 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-922ec7e4-566f-4b56-b8e6-9228f74855bc tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Flow 'volume_create_manager' (9538e923-e649-440b-8789-b1b5938f8bf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:26:37 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-922ec7e4-566f-4b56-b8e6-9228f74855bc tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Created volume successfully. Sep 03 14:26:37 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfa84464-7e24-4783-8dd3-8ceb3dc1417c tempest-VolumesActionsTest-1610054353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:26:37 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cfa84464-7e24-4783-8dd3-8ceb3dc1417c tempest-VolumesActionsTest-1610054353 None] Flow 'volume_create_manager' (782195ad-8094-4e1b-9265-de6688311f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:26:37 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cfa84464-7e24-4783-8dd3-8ceb3dc1417c tempest-VolumesActionsTest-1610054353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b49af00a-eee8-4d1c-8c18-ed3b2779867a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:37 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cfa84464-7e24-4783-8dd3-8ceb3dc1417c tempest-VolumesActionsTest-1610054353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b49af00a-eee8-4d1c-8c18-ed3b2779867a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1201722363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e27ea23-97c4-4101-95f3-2966c899cc60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4520f509d9ac4c518507dc856ba08488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:26:38Z,use_quota=True,user_id='e64252e593714edcae1197e197d4a860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:37 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cfa84464-7e24-4783-8dd3-8ceb3dc1417c tempest-VolumesActionsTest-1610054353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45edcc01-5da5-4e14-8f81-057446df0ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:37 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cfa84464-7e24-4783-8dd3-8ceb3dc1417c tempest-VolumesActionsTest-1610054353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45edcc01-5da5-4e14-8f81-057446df0ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:37 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cfa84464-7e24-4783-8dd3-8ceb3dc1417c tempest-VolumesActionsTest-1610054353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16359ae0-a8e5-46cb-9bee-6868ccc4bd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:37 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cfa84464-7e24-4783-8dd3-8ceb3dc1417c tempest-VolumesActionsTest-1610054353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16359ae0-a8e5-46cb-9bee-6868ccc4bd94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e27ea23-97c4-4101-95f3-2966c899cc60', 'volume_name': 'volume-5e27ea23-97c4-4101-95f3-2966c899cc60', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:37 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cfa84464-7e24-4783-8dd3-8ceb3dc1417c tempest-VolumesActionsTest-1610054353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40371637-668c-43f2-9664-32d1cabd28fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:37 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cfa84464-7e24-4783-8dd3-8ceb3dc1417c tempest-VolumesActionsTest-1610054353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40371637-668c-43f2-9664-32d1cabd28fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:37 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cfa84464-7e24-4783-8dd3-8ceb3dc1417c tempest-VolumesActionsTest-1610054353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b066be4a-da6a-41dd-ad4d-ab054c054083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:37 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-cfa84464-7e24-4783-8dd3-8ceb3dc1417c tempest-VolumesActionsTest-1610054353 None] Volume 5e27ea23-97c4-4101-95f3-2966c899cc60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e27ea23-97c4-4101-95f3-2966c899cc60', 'volume_size': 1} Sep 03 14:26:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-cfa84464-7e24-4783-8dd3-8ceb3dc1417c tempest-VolumesActionsTest-1610054353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:26:38 devstack sudo[98438]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ef3570da-549f-4aee-af63-678cebd2996f tempest-VolumesTestJSON-568021321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dad10928-d930-4162-a904-daf4b017bb4f 1073741824" returned: 0 in 0.540s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ef3570da-549f-4aee-af63-678cebd2996f tempest-VolumesTestJSON-568021321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dad10928-d930-4162-a904-daf4b017bb4f {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:38 devstack sudo[98444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dad10928-d930-4162-a904-daf4b017bb4f Sep 03 14:26:38 devstack sudo[98444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:38 devstack sudo[98444]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ef3570da-549f-4aee-af63-678cebd2996f tempest-VolumesTestJSON-568021321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dad10928-d930-4162-a904-daf4b017bb4f" returned: 0 in 0.262s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:38 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ef3570da-549f-4aee-af63-678cebd2996f tempest-VolumesTestJSON-568021321 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:26:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ef3570da-549f-4aee-af63-678cebd2996f tempest-VolumesTestJSON-568021321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:26:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-cfa84464-7e24-4783-8dd3-8ceb3dc1417c tempest-VolumesActionsTest-1610054353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.395s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:26:38 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-cfa84464-7e24-4783-8dd3-8ceb3dc1417c tempest-VolumesActionsTest-1610054353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1201722363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e27ea23-97c4-4101-95f3-2966c899cc60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4520f509d9ac4c518507dc856ba08488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:26:38Z,use_quota=True,user_id='e64252e593714edcae1197e197d4a860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:26:38 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-cfa84464-7e24-4783-8dd3-8ceb3dc1417c tempest-VolumesActionsTest-1610054353 None] Creating volume 5e27ea23-97c4-4101-95f3-2966c899cc60 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:26:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-cfa84464-7e24-4783-8dd3-8ceb3dc1417c tempest-VolumesActionsTest-1610054353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:26:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-cfa84464-7e24-4783-8dd3-8ceb3dc1417c tempest-VolumesActionsTest-1610054353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:26:38 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-cfa84464-7e24-4783-8dd3-8ceb3dc1417c tempest-VolumesActionsTest-1610054353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:26:38 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-cfa84464-7e24-4783-8dd3-8ceb3dc1417c tempest-VolumesActionsTest-1610054353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:26:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-cfa84464-7e24-4783-8dd3-8ceb3dc1417c tempest-VolumesActionsTest-1610054353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:26:38 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-cfa84464-7e24-4783-8dd3-8ceb3dc1417c tempest-VolumesActionsTest-1610054353 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:26:38 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-cfa84464-7e24-4783-8dd3-8ceb3dc1417c tempest-VolumesActionsTest-1610054353 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:26:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-cfa84464-7e24-4783-8dd3-8ceb3dc1417c tempest-VolumesActionsTest-1610054353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e27ea23-97c4-4101-95f3-2966c899cc60 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:38 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ef3570da-549f-4aee-af63-678cebd2996f tempest-VolumesTestJSON-568021321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bd8e209-1831-4563-981d-456c6f4042e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dad10928-d930-4162-a904-daf4b017bb4f', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:38 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ef3570da-549f-4aee-af63-678cebd2996f tempest-VolumesTestJSON-568021321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66e88b86-2839-4354-976d-261c3ab0f4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:38 devstack sudo[98447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e27ea23-97c4-4101-95f3-2966c899cc60 1073741824 Sep 03 14:26:38 devstack sudo[98447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:38 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-ef3570da-549f-4aee-af63-678cebd2996f tempest-VolumesTestJSON-568021321 None] Volume volume-dad10928-d930-4162-a904-daf4b017bb4f (dad10928-d930-4162-a904-daf4b017bb4f): created successfully Sep 03 14:26:38 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ef3570da-549f-4aee-af63-678cebd2996f tempest-VolumesTestJSON-568021321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66e88b86-2839-4354-976d-261c3ab0f4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:38 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ef3570da-549f-4aee-af63-678cebd2996f tempest-VolumesTestJSON-568021321 None] Flow 'volume_create_manager' (8e11b5dd-6f77-48dd-a49b-8069e6d51ea2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:26:38 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-ef3570da-549f-4aee-af63-678cebd2996f tempest-VolumesTestJSON-568021321 None] Created volume successfully. Sep 03 14:26:38 devstack sudo[98447]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-cfa84464-7e24-4783-8dd3-8ceb3dc1417c tempest-VolumesActionsTest-1610054353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e27ea23-97c4-4101-95f3-2966c899cc60 1073741824" returned: 0 in 0.584s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-cfa84464-7e24-4783-8dd3-8ceb3dc1417c tempest-VolumesActionsTest-1610054353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e27ea23-97c4-4101-95f3-2966c899cc60 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:39 devstack sudo[98462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e27ea23-97c4-4101-95f3-2966c899cc60 Sep 03 14:26:39 devstack sudo[98462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-eedb95c7-664e-4b2c-853c-b17ac30f5f0c req-fbd3f713-81d6-4ff8-8933-7679a03aacbf tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:26:39 devstack sudo[98462]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-cfa84464-7e24-4783-8dd3-8ceb3dc1417c tempest-VolumesActionsTest-1610054353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e27ea23-97c4-4101-95f3-2966c899cc60" returned: 0 in 0.297s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:39 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-cfa84464-7e24-4783-8dd3-8ceb3dc1417c tempest-VolumesActionsTest-1610054353 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:26:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-cfa84464-7e24-4783-8dd3-8ceb3dc1417c tempest-VolumesActionsTest-1610054353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:26:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-eedb95c7-664e-4b2c-853c-b17ac30f5f0c req-fbd3f713-81d6-4ff8-8933-7679a03aacbf tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.111s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:26:39 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cfa84464-7e24-4783-8dd3-8ceb3dc1417c tempest-VolumesActionsTest-1610054353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b066be4a-da6a-41dd-ad4d-ab054c054083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e27ea23-97c4-4101-95f3-2966c899cc60', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:39 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cfa84464-7e24-4783-8dd3-8ceb3dc1417c tempest-VolumesActionsTest-1610054353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (859a0193-8923-4456-98a1-1374e1e40e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-eedb95c7-664e-4b2c-853c-b17ac30f5f0c req-fbd3f713-81d6-4ff8-8933-7679a03aacbf tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.044s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:26:39 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-cfa84464-7e24-4783-8dd3-8ceb3dc1417c tempest-VolumesActionsTest-1610054353 None] Volume volume-5e27ea23-97c4-4101-95f3-2966c899cc60 (5e27ea23-97c4-4101-95f3-2966c899cc60): created successfully Sep 03 14:26:39 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cfa84464-7e24-4783-8dd3-8ceb3dc1417c tempest-VolumesActionsTest-1610054353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (859a0193-8923-4456-98a1-1374e1e40e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:39 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cfa84464-7e24-4783-8dd3-8ceb3dc1417c tempest-VolumesActionsTest-1610054353 None] Flow 'volume_create_manager' (782195ad-8094-4e1b-9265-de6688311f75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:26:39 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-cfa84464-7e24-4783-8dd3-8ceb3dc1417c tempest-VolumesActionsTest-1610054353 None] Created volume successfully. Sep 03 14:26:39 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-eedb95c7-664e-4b2c-853c-b17ac30f5f0c req-fbd3f713-81d6-4ff8-8933-7679a03aacbf tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713', 'name': 'volume-f329944c-541b-4f17-ab38-9b54c024fa9f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '17afd673-413f-4271-9be7-e6c7c066bb5c', 'enforce_multipath': True} {{(pid=87007) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 14:26:39 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-eedb95c7-664e-4b2c-853c-b17ac30f5f0c req-fbd3f713-81d6-4ff8-8933-7679a03aacbf tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] attachment_update completed successfully. Sep 03 14:26:40 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-0cd8b6f3-c962-4844-8b26-7d0b36cf70f7 tempest-VolumesTestJSON-568021321 None] Acquiring lock "cinder-dad10928-d930-4162-a904-daf4b017bb4f-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:26:40 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-0cd8b6f3-c962-4844-8b26-7d0b36cf70f7 tempest-VolumesTestJSON-568021321 None] Lock "cinder-dad10928-d930-4162-a904-daf4b017bb4f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:26:40 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-0cd8b6f3-c962-4844-8b26-7d0b36cf70f7 tempest-VolumesTestJSON-568021321 None] Acquiring lock "cinder-quobyte-dad10928-d930-4162-a904-daf4b017bb4f" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:26:40 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-0cd8b6f3-c962-4844-8b26-7d0b36cf70f7 tempest-VolumesTestJSON-568021321 None] Lock "cinder-quobyte-dad10928-d930-4162-a904-daf4b017bb4f" acquired by "delete_volume" :: waited 0.027s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:26:40 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82f6ecf-9e70-4cb9-9a92-8d17157cc686]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:26:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0cd8b6f3-c962-4844-8b26-7d0b36cf70f7 tempest-VolumesTestJSON-568021321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dad10928-d930-4162-a904-daf4b017bb4f {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:40 devstack sudo[98850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dad10928-d930-4162-a904-daf4b017bb4f Sep 03 14:26:40 devstack sudo[98850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:41 devstack sudo[98850]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0cd8b6f3-c962-4844-8b26-7d0b36cf70f7 tempest-VolumesTestJSON-568021321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dad10928-d930-4162-a904-daf4b017bb4f" returned: 0 in 0.415s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0cd8b6f3-c962-4844-8b26-7d0b36cf70f7 tempest-VolumesTestJSON-568021321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dad10928-d930-4162-a904-daf4b017bb4f {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:41 devstack sudo[98859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dad10928-d930-4162-a904-daf4b017bb4f Sep 03 14:26:41 devstack sudo[98859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:41 devstack sudo[98859]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0cd8b6f3-c962-4844-8b26-7d0b36cf70f7 tempest-VolumesTestJSON-568021321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dad10928-d930-4162-a904-daf4b017bb4f" returned: 0 in 0.331s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:41 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-0cd8b6f3-c962-4844-8b26-7d0b36cf70f7 tempest-VolumesTestJSON-568021321 None] Lock "cinder-quobyte-dad10928-d930-4162-a904-daf4b017bb4f" released by "delete_volume" :: held 0.820s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:26:41 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:UPDATE=152,cinder:SELECT=123,cinder:INSERT=40,cinder:DELETE=13 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:26:41 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-0cd8b6f3-c962-4844-8b26-7d0b36cf70f7 tempest-VolumesTestJSON-568021321 None] Created reservations ['412d934f-0db2-4b00-abb3-703054a5e16b', '5b3a4455-4bc0-453c-b8ae-8606bc21774e', '84b6da96-5b76-4ebf-8d5d-65b62552dead', '249de44f-38f1-4596-8b70-bc20374545d0'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:26:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-0cd8b6f3-c962-4844-8b26-7d0b36cf70f7 tempest-VolumesTestJSON-568021321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:26:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-0cd8b6f3-c962-4844-8b26-7d0b36cf70f7 tempest-VolumesTestJSON-568021321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:26:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-0cd8b6f3-c962-4844-8b26-7d0b36cf70f7 tempest-VolumesTestJSON-568021321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:26:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-0cd8b6f3-c962-4844-8b26-7d0b36cf70f7 tempest-VolumesTestJSON-568021321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:26:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-0cd8b6f3-c962-4844-8b26-7d0b36cf70f7 tempest-VolumesTestJSON-568021321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:26:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0cd8b6f3-c962-4844-8b26-7d0b36cf70f7 tempest-VolumesTestJSON-568021321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:41 devstack sudo[98862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:26:41 devstack sudo[98862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:41 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-880514b9-4548-4421-9221-4be8e83ef677 tempest-VolumesTestJSON-568021321 None] Acquiring lock "cinder-051fb879-f117-4682-aa7c-8d3a4d06cda8-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:26:41 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0822678-7e77-48ee-a5f5-8bb2cd1eaee8 tempest-VolumesTransfersTest-1403417477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:26:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a0822678-7e77-48ee-a5f5-8bb2cd1eaee8 tempest-VolumesTransfersTest-1403417477 None] Flow 'volume_create_manager' (2aabc525-6092-43a5-8012-4757aaa713bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:26:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a0822678-7e77-48ee-a5f5-8bb2cd1eaee8 tempest-VolumesTransfersTest-1403417477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1f290f7-5687-4f05-9c06-be86f2ff19fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:42 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-880514b9-4548-4421-9221-4be8e83ef677 tempest-VolumesTestJSON-568021321 None] Lock "cinder-051fb879-f117-4682-aa7c-8d3a4d06cda8-delete_volume" acquired by "delete_volume" :: waited 0.134s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:26:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a0822678-7e77-48ee-a5f5-8bb2cd1eaee8 tempest-VolumesTransfersTest-1403417477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1f290f7-5687-4f05-9c06-be86f2ff19fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1857517732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aa5dd67-f02a-483d-b654-66e9abf0bd85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90044fc664284138b8e877a4873b31f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:26:42Z,use_quota=True,user_id='6248449fa2db484496721e49757a3fea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a0822678-7e77-48ee-a5f5-8bb2cd1eaee8 tempest-VolumesTransfersTest-1403417477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72915c91-488b-4ce3-b729-b281c75dd950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a0822678-7e77-48ee-a5f5-8bb2cd1eaee8 tempest-VolumesTransfersTest-1403417477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72915c91-488b-4ce3-b729-b281c75dd950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a0822678-7e77-48ee-a5f5-8bb2cd1eaee8 tempest-VolumesTransfersTest-1403417477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d813d18c-0914-4d3f-bcde-535cb3daa06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a0822678-7e77-48ee-a5f5-8bb2cd1eaee8 tempest-VolumesTransfersTest-1403417477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d813d18c-0914-4d3f-bcde-535cb3daa06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0aa5dd67-f02a-483d-b654-66e9abf0bd85', 'volume_name': 'volume-0aa5dd67-f02a-483d-b654-66e9abf0bd85', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a0822678-7e77-48ee-a5f5-8bb2cd1eaee8 tempest-VolumesTransfersTest-1403417477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8115e3f2-80ec-4403-a901-11bfae66903b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a0822678-7e77-48ee-a5f5-8bb2cd1eaee8 tempest-VolumesTransfersTest-1403417477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8115e3f2-80ec-4403-a901-11bfae66903b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a0822678-7e77-48ee-a5f5-8bb2cd1eaee8 tempest-VolumesTransfersTest-1403417477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fc807f1-1ba9-432e-bced-ace575a8a156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:42 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-a0822678-7e77-48ee-a5f5-8bb2cd1eaee8 tempest-VolumesTransfersTest-1403417477 None] Volume 0aa5dd67-f02a-483d-b654-66e9abf0bd85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0aa5dd67-f02a-483d-b654-66e9abf0bd85', 'volume_size': 1} Sep 03 14:26:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a0822678-7e77-48ee-a5f5-8bb2cd1eaee8 tempest-VolumesTransfersTest-1403417477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:26:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a0822678-7e77-48ee-a5f5-8bb2cd1eaee8 tempest-VolumesTransfersTest-1403417477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:26:42 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a0822678-7e77-48ee-a5f5-8bb2cd1eaee8 tempest-VolumesTransfersTest-1403417477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1857517732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aa5dd67-f02a-483d-b654-66e9abf0bd85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90044fc664284138b8e877a4873b31f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:26:42Z,use_quota=True,user_id='6248449fa2db484496721e49757a3fea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:26:42 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-a0822678-7e77-48ee-a5f5-8bb2cd1eaee8 tempest-VolumesTransfersTest-1403417477 None] Creating volume 0aa5dd67-f02a-483d-b654-66e9abf0bd85 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:26:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a0822678-7e77-48ee-a5f5-8bb2cd1eaee8 tempest-VolumesTransfersTest-1403417477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:26:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a0822678-7e77-48ee-a5f5-8bb2cd1eaee8 tempest-VolumesTransfersTest-1403417477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:26:42 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a0822678-7e77-48ee-a5f5-8bb2cd1eaee8 tempest-VolumesTransfersTest-1403417477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:26:42 devstack sudo[98862]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:42 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a0822678-7e77-48ee-a5f5-8bb2cd1eaee8 tempest-VolumesTransfersTest-1403417477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:26:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a0822678-7e77-48ee-a5f5-8bb2cd1eaee8 tempest-VolumesTransfersTest-1403417477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:26:42 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a0822678-7e77-48ee-a5f5-8bb2cd1eaee8 tempest-VolumesTransfersTest-1403417477 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:26:42 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-a0822678-7e77-48ee-a5f5-8bb2cd1eaee8 tempest-VolumesTransfersTest-1403417477 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:26:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a0822678-7e77-48ee-a5f5-8bb2cd1eaee8 tempest-VolumesTransfersTest-1403417477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-0aa5dd67-f02a-483d-b654-66e9abf0bd85 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0cd8b6f3-c962-4844-8b26-7d0b36cf70f7 tempest-VolumesTestJSON-568021321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.486s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:42 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-0cd8b6f3-c962-4844-8b26-7d0b36cf70f7 tempest-VolumesTestJSON-568021321 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:26:42 devstack sudo[98865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-0aa5dd67-f02a-483d-b654-66e9abf0bd85 1073741824 Sep 03 14:26:42 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-0cd8b6f3-c962-4844-8b26-7d0b36cf70f7 tempest-VolumesTestJSON-568021321 None] Deleted volume successfully. Sep 03 14:26:42 devstack sudo[98865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:42 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-880514b9-4548-4421-9221-4be8e83ef677 tempest-VolumesTestJSON-568021321 None] Acquiring lock "cinder-quobyte-051fb879-f117-4682-aa7c-8d3a4d06cda8" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:26:42 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-0cd8b6f3-c962-4844-8b26-7d0b36cf70f7 tempest-VolumesTestJSON-568021321 None] Lock "cinder-dad10928-d930-4162-a904-daf4b017bb4f-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:26:42 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-880514b9-4548-4421-9221-4be8e83ef677 tempest-VolumesTestJSON-568021321 None] Lock "cinder-quobyte-051fb879-f117-4682-aa7c-8d3a4d06cda8" acquired by "delete_volume" :: waited 0.025s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:26:42 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[809d5c6c-8b2c-46ca-bf19-308013538a10]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:26:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-880514b9-4548-4421-9221-4be8e83ef677 tempest-VolumesTestJSON-568021321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-051fb879-f117-4682-aa7c-8d3a4d06cda8 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:42 devstack sudo[98867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-051fb879-f117-4682-aa7c-8d3a4d06cda8 Sep 03 14:26:42 devstack sudo[98867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:42 devstack sudo[98865]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a0822678-7e77-48ee-a5f5-8bb2cd1eaee8 tempest-VolumesTransfersTest-1403417477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-0aa5dd67-f02a-483d-b654-66e9abf0bd85 1073741824" returned: 0 in 0.649s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a0822678-7e77-48ee-a5f5-8bb2cd1eaee8 tempest-VolumesTransfersTest-1403417477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-0aa5dd67-f02a-483d-b654-66e9abf0bd85 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:42 devstack sudo[98876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-0aa5dd67-f02a-483d-b654-66e9abf0bd85 Sep 03 14:26:42 devstack sudo[98876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:42 devstack sudo[98867]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-880514b9-4548-4421-9221-4be8e83ef677 tempest-VolumesTestJSON-568021321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-051fb879-f117-4682-aa7c-8d3a4d06cda8" returned: 0 in 0.609s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-880514b9-4548-4421-9221-4be8e83ef677 tempest-VolumesTestJSON-568021321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-051fb879-f117-4682-aa7c-8d3a4d06cda8 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:42 devstack sudo[98878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-051fb879-f117-4682-aa7c-8d3a4d06cda8 Sep 03 14:26:42 devstack sudo[98878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:43 devstack sudo[98878]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-880514b9-4548-4421-9221-4be8e83ef677 tempest-VolumesTestJSON-568021321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-051fb879-f117-4682-aa7c-8d3a4d06cda8" returned: 0 in 0.324s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:43 devstack sudo[98876]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a0822678-7e77-48ee-a5f5-8bb2cd1eaee8 tempest-VolumesTransfersTest-1403417477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-0aa5dd67-f02a-483d-b654-66e9abf0bd85" returned: 0 in 0.431s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:43 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a0822678-7e77-48ee-a5f5-8bb2cd1eaee8 tempest-VolumesTransfersTest-1403417477 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:26:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a0822678-7e77-48ee-a5f5-8bb2cd1eaee8 tempest-VolumesTransfersTest-1403417477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:26:43 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-880514b9-4548-4421-9221-4be8e83ef677 tempest-VolumesTestJSON-568021321 None] Lock "cinder-quobyte-051fb879-f117-4682-aa7c-8d3a4d06cda8" released by "delete_volume" :: held 1.036s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:26:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a0822678-7e77-48ee-a5f5-8bb2cd1eaee8 tempest-VolumesTransfersTest-1403417477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fc807f1-1ba9-432e-bced-ace575a8a156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0aa5dd67-f02a-483d-b654-66e9abf0bd85', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a0822678-7e77-48ee-a5f5-8bb2cd1eaee8 tempest-VolumesTransfersTest-1403417477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ca0560b-58f8-4255-b5c0-df17aee06657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:43 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-a0822678-7e77-48ee-a5f5-8bb2cd1eaee8 tempest-VolumesTransfersTest-1403417477 None] Volume volume-0aa5dd67-f02a-483d-b654-66e9abf0bd85 (0aa5dd67-f02a-483d-b654-66e9abf0bd85): created successfully Sep 03 14:26:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a0822678-7e77-48ee-a5f5-8bb2cd1eaee8 tempest-VolumesTransfersTest-1403417477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ca0560b-58f8-4255-b5c0-df17aee06657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a0822678-7e77-48ee-a5f5-8bb2cd1eaee8 tempest-VolumesTransfersTest-1403417477 None] Flow 'volume_create_manager' (2aabc525-6092-43a5-8012-4757aaa713bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:26:43 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-a0822678-7e77-48ee-a5f5-8bb2cd1eaee8 tempest-VolumesTransfersTest-1403417477 None] Created volume successfully. Sep 03 14:26:43 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-880514b9-4548-4421-9221-4be8e83ef677 tempest-VolumesTestJSON-568021321 None] Created reservations ['cf3df49b-1a12-4fc5-b817-ee36142e8361', 'd8c80ba2-0ef4-4473-b048-9198c1fa26e0', '5c363702-59c0-4bfa-8181-dec5a346157c', '03d67d0f-5b49-4b69-97e4-ce0b883ccaf0'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:26:43 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-51d003c4-ad30-485f-83d2-b9c76e2cb4fe req-b88b5ef8-7a8c-4457-afd2-d56665827cc3 tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Terminate volume connection completed successfully. Sep 03 14:26:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-51d003c4-ad30-485f-83d2-b9c76e2cb4fe req-b88b5ef8-7a8c-4457-afd2-d56665827cc3 tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Deleting attachment 17afd673-413f-4271-9be7-e6c7c066bb5c. {{(pid=87007) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 14:26:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-880514b9-4548-4421-9221-4be8e83ef677 tempest-VolumesTestJSON-568021321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:26:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-880514b9-4548-4421-9221-4be8e83ef677 tempest-VolumesTestJSON-568021321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:26:43 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-880514b9-4548-4421-9221-4be8e83ef677 tempest-VolumesTestJSON-568021321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:26:43 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-880514b9-4548-4421-9221-4be8e83ef677 tempest-VolumesTestJSON-568021321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:26:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-880514b9-4548-4421-9221-4be8e83ef677 tempest-VolumesTestJSON-568021321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:26:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-880514b9-4548-4421-9221-4be8e83ef677 tempest-VolumesTestJSON-568021321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:43 devstack sudo[98918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:26:43 devstack sudo[98918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:43 devstack sudo[98918]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-880514b9-4548-4421-9221-4be8e83ef677 tempest-VolumesTestJSON-568021321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.307s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:43 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-880514b9-4548-4421-9221-4be8e83ef677 tempest-VolumesTestJSON-568021321 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:26:43 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-880514b9-4548-4421-9221-4be8e83ef677 tempest-VolumesTestJSON-568021321 None] Deleted volume successfully. Sep 03 14:26:43 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-880514b9-4548-4421-9221-4be8e83ef677 tempest-VolumesTestJSON-568021321 None] Lock "cinder-051fb879-f117-4682-aa7c-8d3a4d06cda8-delete_volume" released by "delete_volume" :: held 1.891s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:26:44 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a791f958-b8b3-42ff-b4e8-8b25157082ee tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Acquiring lock "cinder-f329944c-541b-4f17-ab38-9b54c024fa9f-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:26:44 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a791f958-b8b3-42ff-b4e8-8b25157082ee tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Lock "cinder-f329944c-541b-4f17-ab38-9b54c024fa9f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:26:44 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a791f958-b8b3-42ff-b4e8-8b25157082ee tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Acquiring lock "cinder-quobyte-f329944c-541b-4f17-ab38-9b54c024fa9f" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:26:44 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9e49faee-4e6b-4215-995d-9463345ffd6d tempest-VolumesTestJSON-568021321 None] Acquiring lock "cinder-6f384185-b961-42e6-8bfc-8789d8affbe2-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:26:44 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a791f958-b8b3-42ff-b4e8-8b25157082ee tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Lock "cinder-quobyte-f329944c-541b-4f17-ab38-9b54c024fa9f" acquired by "delete_volume" :: waited 0.040s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:26:44 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9e49faee-4e6b-4215-995d-9463345ffd6d tempest-VolumesTestJSON-568021321 None] Lock "cinder-6f384185-b961-42e6-8bfc-8789d8affbe2-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:26:44 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e306f77-4d8b-4398-b491-2beaf4d220aa]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:26:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a791f958-b8b3-42ff-b4e8-8b25157082ee tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f329944c-541b-4f17-ab38-9b54c024fa9f {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:44 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9e49faee-4e6b-4215-995d-9463345ffd6d tempest-VolumesTestJSON-568021321 None] Acquiring lock "cinder-quobyte-6f384185-b961-42e6-8bfc-8789d8affbe2" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:26:44 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9e49faee-4e6b-4215-995d-9463345ffd6d tempest-VolumesTestJSON-568021321 None] Lock "cinder-quobyte-6f384185-b961-42e6-8bfc-8789d8affbe2" acquired by "delete_volume" :: waited 0.020s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:26:44 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6abfbf-f27e-47ee-b4d1-e34de9a460e2]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:26:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9e49faee-4e6b-4215-995d-9463345ffd6d tempest-VolumesTestJSON-568021321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6f384185-b961-42e6-8bfc-8789d8affbe2 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:44 devstack sudo[98930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f329944c-541b-4f17-ab38-9b54c024fa9f Sep 03 14:26:44 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:44 devstack sudo[98931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6f384185-b961-42e6-8bfc-8789d8affbe2 Sep 03 14:26:44 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:44 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a791f958-b8b3-42ff-b4e8-8b25157082ee tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f329944c-541b-4f17-ab38-9b54c024fa9f" returned: 0 in 0.468s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a791f958-b8b3-42ff-b4e8-8b25157082ee tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f329944c-541b-4f17-ab38-9b54c024fa9f {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:44 devstack sudo[98939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f329944c-541b-4f17-ab38-9b54c024fa9f Sep 03 14:26:44 devstack sudo[98939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:44 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-abb88902-08ad-4cb3-9abd-e50ddff155f5 tempest-VolumesTransfersTest-850554865 None] Transfer volume completed successfully. Sep 03 14:26:45 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9e49faee-4e6b-4215-995d-9463345ffd6d tempest-VolumesTestJSON-568021321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6f384185-b961-42e6-8bfc-8789d8affbe2" returned: 0 in 0.484s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9e49faee-4e6b-4215-995d-9463345ffd6d tempest-VolumesTestJSON-568021321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6f384185-b961-42e6-8bfc-8789d8affbe2 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:45 devstack sudo[98942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6f384185-b961-42e6-8bfc-8789d8affbe2 Sep 03 14:26:45 devstack sudo[98942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:45 devstack sudo[98939]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a791f958-b8b3-42ff-b4e8-8b25157082ee tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f329944c-541b-4f17-ab38-9b54c024fa9f" returned: 0 in 0.327s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:45 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a791f958-b8b3-42ff-b4e8-8b25157082ee tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Lock "cinder-quobyte-f329944c-541b-4f17-ab38-9b54c024fa9f" released by "delete_volume" :: held 0.869s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:26:45 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-a791f958-b8b3-42ff-b4e8-8b25157082ee tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Created reservations ['9202c802-dd0f-40dd-a0ac-6031dfbef2f6', '77b9f3f3-d1c9-40c7-8cf0-b1061b8b9d03', '6c2bb331-a14b-4540-87f8-ee908e1478af', 'ffc7fe8c-909e-4189-adf3-d68eb1d9f3fc'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:26:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a791f958-b8b3-42ff-b4e8-8b25157082ee tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:26:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a791f958-b8b3-42ff-b4e8-8b25157082ee tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:26:45 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a791f958-b8b3-42ff-b4e8-8b25157082ee tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:26:45 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a791f958-b8b3-42ff-b4e8-8b25157082ee tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:26:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a791f958-b8b3-42ff-b4e8-8b25157082ee tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:26:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a791f958-b8b3-42ff-b4e8-8b25157082ee tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:45 devstack sudo[98946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:26:45 devstack sudo[98946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:45 devstack sudo[98942]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9e49faee-4e6b-4215-995d-9463345ffd6d tempest-VolumesTestJSON-568021321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6f384185-b961-42e6-8bfc-8789d8affbe2" returned: 0 in 0.531s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:45 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9e49faee-4e6b-4215-995d-9463345ffd6d tempest-VolumesTestJSON-568021321 None] Lock "cinder-quobyte-6f384185-b961-42e6-8bfc-8789d8affbe2" released by "delete_volume" :: held 1.073s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:26:45 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-9e49faee-4e6b-4215-995d-9463345ffd6d tempest-VolumesTestJSON-568021321 None] Created reservations ['ab5114a2-7915-4a52-b66b-e57d4ae946e5', 'b92073d4-6e1f-46a6-9de1-96d83f47696b', '1e31b4b9-553a-42c5-9a15-32164e4d7b7d', 'bfe95542-a7f2-4b13-9ee7-303df567bdb6'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:26:45 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-934349a7-9a4f-4c46-9333-8513f7c07b35 tempest-VolumesTransfersTest-405311643 None] Acquiring lock "cinder-0aa5dd67-f02a-483d-b654-66e9abf0bd85-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:26:45 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-934349a7-9a4f-4c46-9333-8513f7c07b35 tempest-VolumesTransfersTest-405311643 None] Lock "cinder-0aa5dd67-f02a-483d-b654-66e9abf0bd85-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:26:45 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-934349a7-9a4f-4c46-9333-8513f7c07b35 tempest-VolumesTransfersTest-405311643 None] Acquiring lock "cinder-quobyte-0aa5dd67-f02a-483d-b654-66e9abf0bd85" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:26:45 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-934349a7-9a4f-4c46-9333-8513f7c07b35 tempest-VolumesTransfersTest-405311643 None] Lock "cinder-quobyte-0aa5dd67-f02a-483d-b654-66e9abf0bd85" acquired by "delete_volume" :: waited 0.026s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:26:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-9e49faee-4e6b-4215-995d-9463345ffd6d tempest-VolumesTestJSON-568021321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:26:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-9e49faee-4e6b-4215-995d-9463345ffd6d tempest-VolumesTestJSON-568021321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:26:45 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-9e49faee-4e6b-4215-995d-9463345ffd6d tempest-VolumesTestJSON-568021321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:26:45 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-9e49faee-4e6b-4215-995d-9463345ffd6d tempest-VolumesTestJSON-568021321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:26:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-9e49faee-4e6b-4215-995d-9463345ffd6d tempest-VolumesTestJSON-568021321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:26:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9e49faee-4e6b-4215-995d-9463345ffd6d tempest-VolumesTestJSON-568021321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:45 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed93cd5-4c70-4be9-9973-ca23bd187263]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:26:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-934349a7-9a4f-4c46-9333-8513f7c07b35 tempest-VolumesTransfersTest-405311643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-0aa5dd67-f02a-483d-b654-66e9abf0bd85 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:45 devstack sudo[98950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:26:45 devstack sudo[98946]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:45 devstack sudo[98950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a791f958-b8b3-42ff-b4e8-8b25157082ee tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.343s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:45 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-a791f958-b8b3-42ff-b4e8-8b25157082ee tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:26:45 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-a791f958-b8b3-42ff-b4e8-8b25157082ee tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Deleted volume successfully. Sep 03 14:26:45 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a791f958-b8b3-42ff-b4e8-8b25157082ee tempest-TestServerVolumeAttachScenarioOldVersion-777821036 None] Lock "cinder-f329944c-541b-4f17-ab38-9b54c024fa9f-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:26:45 devstack sudo[98951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-0aa5dd67-f02a-483d-b654-66e9abf0bd85 Sep 03 14:26:45 devstack sudo[98951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:46 devstack sudo[98950]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9e49faee-4e6b-4215-995d-9463345ffd6d tempest-VolumesTestJSON-568021321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.292s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:46 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-9e49faee-4e6b-4215-995d-9463345ffd6d tempest-VolumesTestJSON-568021321 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:26:46 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-9e49faee-4e6b-4215-995d-9463345ffd6d tempest-VolumesTestJSON-568021321 None] Deleted volume successfully. Sep 03 14:26:46 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9e49faee-4e6b-4215-995d-9463345ffd6d tempest-VolumesTestJSON-568021321 None] Lock "cinder-6f384185-b961-42e6-8bfc-8789d8affbe2-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:26:46 devstack sudo[98951]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-934349a7-9a4f-4c46-9333-8513f7c07b35 tempest-VolumesTransfersTest-405311643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-0aa5dd67-f02a-483d-b654-66e9abf0bd85" returned: 0 in 0.436s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-934349a7-9a4f-4c46-9333-8513f7c07b35 tempest-VolumesTransfersTest-405311643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-0aa5dd67-f02a-483d-b654-66e9abf0bd85 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:46 devstack sudo[98960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-0aa5dd67-f02a-483d-b654-66e9abf0bd85 Sep 03 14:26:46 devstack sudo[98960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:46 devstack sudo[98960]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-934349a7-9a4f-4c46-9333-8513f7c07b35 tempest-VolumesTransfersTest-405311643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-0aa5dd67-f02a-483d-b654-66e9abf0bd85" returned: 0 in 0.634s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:46 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-934349a7-9a4f-4c46-9333-8513f7c07b35 tempest-VolumesTransfersTest-405311643 None] Lock "cinder-quobyte-0aa5dd67-f02a-483d-b654-66e9abf0bd85" released by "delete_volume" :: held 1.171s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:26:47 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-934349a7-9a4f-4c46-9333-8513f7c07b35 tempest-VolumesTransfersTest-405311643 None] Created reservations ['22cefe55-1133-4788-b192-faf71bd6cffd', '64d99216-40f6-495b-adee-b85168a949bc', '7c585399-83dd-4966-ac7d-cd67d6486aad', 'c31464ff-4af0-418c-ada2-ef15241d97d9'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:26:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-934349a7-9a4f-4c46-9333-8513f7c07b35 tempest-VolumesTransfersTest-405311643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:26:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-934349a7-9a4f-4c46-9333-8513f7c07b35 tempest-VolumesTransfersTest-405311643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:26:47 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-934349a7-9a4f-4c46-9333-8513f7c07b35 tempest-VolumesTransfersTest-405311643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:26:47 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-934349a7-9a4f-4c46-9333-8513f7c07b35 tempest-VolumesTransfersTest-405311643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:26:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-934349a7-9a4f-4c46-9333-8513f7c07b35 tempest-VolumesTransfersTest-405311643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:26:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-934349a7-9a4f-4c46-9333-8513f7c07b35 tempest-VolumesTransfersTest-405311643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:47 devstack sudo[99021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:26:47 devstack sudo[99021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:47 devstack sudo[99021]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-934349a7-9a4f-4c46-9333-8513f7c07b35 tempest-VolumesTransfersTest-405311643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.554s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:47 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-934349a7-9a4f-4c46-9333-8513f7c07b35 tempest-VolumesTransfersTest-405311643 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:26:47 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-934349a7-9a4f-4c46-9333-8513f7c07b35 tempest-VolumesTransfersTest-405311643 None] Deleted volume successfully. Sep 03 14:26:47 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-934349a7-9a4f-4c46-9333-8513f7c07b35 tempest-VolumesTransfersTest-405311643 None] Lock "cinder-0aa5dd67-f02a-483d-b654-66e9abf0bd85-delete_volume" released by "delete_volume" :: held 2.233s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:26:49 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-76fadccf-bdda-49ec-b806-1758c36cbaa4 tempest-VolumesTransfersTest-1403417477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:26:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-76fadccf-bdda-49ec-b806-1758c36cbaa4 tempest-VolumesTransfersTest-1403417477 None] Flow 'volume_create_manager' (d97e8043-3d98-4e4d-8250-addaf225cc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:26:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-76fadccf-bdda-49ec-b806-1758c36cbaa4 tempest-VolumesTransfersTest-1403417477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e540c58-bc68-4987-b942-5d908aca77de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-76fadccf-bdda-49ec-b806-1758c36cbaa4 tempest-VolumesTransfersTest-1403417477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e540c58-bc68-4987-b942-5d908aca77de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-768997764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bde323df-f7fe-4af4-bb60-f240ce950bc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90044fc664284138b8e877a4873b31f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:26:49Z,use_quota=True,user_id='6248449fa2db484496721e49757a3fea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-76fadccf-bdda-49ec-b806-1758c36cbaa4 tempest-VolumesTransfersTest-1403417477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff3f61dd-1132-46ab-bd2d-52f467aca030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-76fadccf-bdda-49ec-b806-1758c36cbaa4 tempest-VolumesTransfersTest-1403417477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff3f61dd-1132-46ab-bd2d-52f467aca030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-76fadccf-bdda-49ec-b806-1758c36cbaa4 tempest-VolumesTransfersTest-1403417477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (512e61f9-f2a7-4715-bff3-12f04ed5f508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-76fadccf-bdda-49ec-b806-1758c36cbaa4 tempest-VolumesTransfersTest-1403417477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (512e61f9-f2a7-4715-bff3-12f04ed5f508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bde323df-f7fe-4af4-bb60-f240ce950bc0', 'volume_name': 'volume-bde323df-f7fe-4af4-bb60-f240ce950bc0', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-76fadccf-bdda-49ec-b806-1758c36cbaa4 tempest-VolumesTransfersTest-1403417477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd56944-fe5a-47c9-bed1-e881a74216ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-76fadccf-bdda-49ec-b806-1758c36cbaa4 tempest-VolumesTransfersTest-1403417477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd56944-fe5a-47c9-bed1-e881a74216ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-76fadccf-bdda-49ec-b806-1758c36cbaa4 tempest-VolumesTransfersTest-1403417477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab50fbe9-5ffe-4377-8922-12266bd9b4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:49 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-76fadccf-bdda-49ec-b806-1758c36cbaa4 tempest-VolumesTransfersTest-1403417477 None] Volume bde323df-f7fe-4af4-bb60-f240ce950bc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bde323df-f7fe-4af4-bb60-f240ce950bc0', 'volume_size': 1} Sep 03 14:26:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-76fadccf-bdda-49ec-b806-1758c36cbaa4 tempest-VolumesTransfersTest-1403417477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:26:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-76fadccf-bdda-49ec-b806-1758c36cbaa4 tempest-VolumesTransfersTest-1403417477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:26:49 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-76fadccf-bdda-49ec-b806-1758c36cbaa4 tempest-VolumesTransfersTest-1403417477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-768997764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bde323df-f7fe-4af4-bb60-f240ce950bc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90044fc664284138b8e877a4873b31f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:26:49Z,use_quota=True,user_id='6248449fa2db484496721e49757a3fea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:26:49 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-76fadccf-bdda-49ec-b806-1758c36cbaa4 tempest-VolumesTransfersTest-1403417477 None] Creating volume bde323df-f7fe-4af4-bb60-f240ce950bc0 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:26:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-76fadccf-bdda-49ec-b806-1758c36cbaa4 tempest-VolumesTransfersTest-1403417477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:26:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-76fadccf-bdda-49ec-b806-1758c36cbaa4 tempest-VolumesTransfersTest-1403417477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:26:49 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-76fadccf-bdda-49ec-b806-1758c36cbaa4 tempest-VolumesTransfersTest-1403417477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:26:49 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-76fadccf-bdda-49ec-b806-1758c36cbaa4 tempest-VolumesTransfersTest-1403417477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:26:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-76fadccf-bdda-49ec-b806-1758c36cbaa4 tempest-VolumesTransfersTest-1403417477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:26:49 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-76fadccf-bdda-49ec-b806-1758c36cbaa4 tempest-VolumesTransfersTest-1403417477 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:26:49 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-76fadccf-bdda-49ec-b806-1758c36cbaa4 tempest-VolumesTransfersTest-1403417477 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:26:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-76fadccf-bdda-49ec-b806-1758c36cbaa4 tempest-VolumesTransfersTest-1403417477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bde323df-f7fe-4af4-bb60-f240ce950bc0 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:49 devstack sudo[99052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bde323df-f7fe-4af4-bb60-f240ce950bc0 1073741824 Sep 03 14:26:49 devstack sudo[99052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:50 devstack sudo[99052]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-76fadccf-bdda-49ec-b806-1758c36cbaa4 tempest-VolumesTransfersTest-1403417477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bde323df-f7fe-4af4-bb60-f240ce950bc0 1073741824" returned: 0 in 0.705s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-76fadccf-bdda-49ec-b806-1758c36cbaa4 tempest-VolumesTransfersTest-1403417477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bde323df-f7fe-4af4-bb60-f240ce950bc0 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:50 devstack sudo[99060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bde323df-f7fe-4af4-bb60-f240ce950bc0 Sep 03 14:26:50 devstack sudo[99060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:50 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-e0cae7c8-1d0f-4888-b528-4acb91a30aaf tempest-VolumesActionsTest-1610054353 None] Acquiring lock "cinder-5e27ea23-97c4-4101-95f3-2966c899cc60" by "attach_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:26:50 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-e0cae7c8-1d0f-4888-b528-4acb91a30aaf tempest-VolumesActionsTest-1610054353 None] Lock "cinder-5e27ea23-97c4-4101-95f3-2966c899cc60" acquired by "attach_volume" :: waited 0.048s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:26:50 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-e0cae7c8-1d0f-4888-b528-4acb91a30aaf tempest-VolumesActionsTest-1610054353 None] Attaching volume 5e27ea23-97c4-4101-95f3-2966c899cc60 to instance 6f608ec2-fd5b-495b-a6c5-924ded95c927 at mountpoint /dev/vdb on host None. Sep 03 14:26:50 devstack sudo[99060]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-76fadccf-bdda-49ec-b806-1758c36cbaa4 tempest-VolumesTransfersTest-1403417477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bde323df-f7fe-4af4-bb60-f240ce950bc0" returned: 0 in 0.485s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:50 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-76fadccf-bdda-49ec-b806-1758c36cbaa4 tempest-VolumesTransfersTest-1403417477 None] <== create_volume: return (1306ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:26:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-76fadccf-bdda-49ec-b806-1758c36cbaa4 tempest-VolumesTransfersTest-1403417477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:26:50 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-e0cae7c8-1d0f-4888-b528-4acb91a30aaf tempest-VolumesActionsTest-1610054353 None] Attach volume completed successfully. Sep 03 14:26:50 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-e0cae7c8-1d0f-4888-b528-4acb91a30aaf tempest-VolumesActionsTest-1610054353 None] Lock "cinder-5e27ea23-97c4-4101-95f3-2966c899cc60" released by "attach_volume" :: held 0.230s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:26:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-76fadccf-bdda-49ec-b806-1758c36cbaa4 tempest-VolumesTransfersTest-1403417477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab50fbe9-5ffe-4377-8922-12266bd9b4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bde323df-f7fe-4af4-bb60-f240ce950bc0', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-76fadccf-bdda-49ec-b806-1758c36cbaa4 tempest-VolumesTransfersTest-1403417477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25bfe94e-b62f-4240-89c5-8d1ed9878cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:26:50 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-76fadccf-bdda-49ec-b806-1758c36cbaa4 tempest-VolumesTransfersTest-1403417477 None] Volume volume-bde323df-f7fe-4af4-bb60-f240ce950bc0 (bde323df-f7fe-4af4-bb60-f240ce950bc0): created successfully Sep 03 14:26:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-76fadccf-bdda-49ec-b806-1758c36cbaa4 tempest-VolumesTransfersTest-1403417477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25bfe94e-b62f-4240-89c5-8d1ed9878cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:26:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-76fadccf-bdda-49ec-b806-1758c36cbaa4 tempest-VolumesTransfersTest-1403417477 None] Flow 'volume_create_manager' (d97e8043-3d98-4e4d-8250-addaf225cc5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:26:50 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-76fadccf-bdda-49ec-b806-1758c36cbaa4 tempest-VolumesTransfersTest-1403417477 None] Created volume successfully. Sep 03 14:26:51 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-854eecbc-71a9-4f43-8dcc-40ca46c05751 tempest-VolumesActionsTest-1610054353 None] Acquiring lock "cinder-5e27ea23-97c4-4101-95f3-2966c899cc60-detach_volume" by "detach_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:26:51 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-854eecbc-71a9-4f43-8dcc-40ca46c05751 tempest-VolumesActionsTest-1610054353 None] Lock "cinder-5e27ea23-97c4-4101-95f3-2966c899cc60-detach_volume" acquired by "detach_volume" :: waited 0.043s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:26:51 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-854eecbc-71a9-4f43-8dcc-40ca46c05751 tempest-VolumesActionsTest-1610054353 None] Detaching volume 5e27ea23-97c4-4101-95f3-2966c899cc60 from instance 6f608ec2-fd5b-495b-a6c5-924ded95c927. Sep 03 14:26:51 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-854eecbc-71a9-4f43-8dcc-40ca46c05751 tempest-VolumesActionsTest-1610054353 None] Detach volume completed successfully. Sep 03 14:26:51 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-854eecbc-71a9-4f43-8dcc-40ca46c05751 tempest-VolumesActionsTest-1610054353 None] Lock "cinder-5e27ea23-97c4-4101-95f3-2966c899cc60-detach_volume" released by "detach_volume" :: held 0.139s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:26:51 devstack cinder-volume[87007]: DEBUG oslo_service.periodic_task [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87007) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 14:26:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:26:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:26:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:26:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:26:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:26:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:51 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:26:51 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:52 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-32311a29-028d-4674-9f8e-ad989f1757d4 tempest-VolumesTransfersTest-405311643 None] Acquiring lock "cinder-bde323df-f7fe-4af4-bb60-f240ce950bc0-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:26:52 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-32311a29-028d-4674-9f8e-ad989f1757d4 tempest-VolumesTransfersTest-405311643 None] Lock "cinder-bde323df-f7fe-4af4-bb60-f240ce950bc0-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:26:52 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.767s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:52 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:26:52 devstack cinder-volume[87007]: DEBUG oslo_service.periodic_task [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running periodic task VolumeManager._thread_info {{(pid=87007) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 14:26:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] thread count: 28 {{(pid=87007) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 14:26:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] thread info: [<_MainThread(MainThread, started 123689171054720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87007) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 14:26:52 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-32311a29-028d-4674-9f8e-ad989f1757d4 tempest-VolumesTransfersTest-405311643 None] Acquiring lock "cinder-quobyte-bde323df-f7fe-4af4-bb60-f240ce950bc0" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:26:52 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-32311a29-028d-4674-9f8e-ad989f1757d4 tempest-VolumesTransfersTest-405311643 None] Lock "cinder-quobyte-bde323df-f7fe-4af4-bb60-f240ce950bc0" acquired by "delete_volume" :: waited 0.024s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:26:52 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[282db8be-c894-41a5-b7c1-e3c1de35a971]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:26:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-32311a29-028d-4674-9f8e-ad989f1757d4 tempest-VolumesTransfersTest-405311643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bde323df-f7fe-4af4-bb60-f240ce950bc0 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:52 devstack sudo[99084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bde323df-f7fe-4af4-bb60-f240ce950bc0 Sep 03 14:26:52 devstack sudo[99084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:53 devstack sudo[99084]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-32311a29-028d-4674-9f8e-ad989f1757d4 tempest-VolumesTransfersTest-405311643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bde323df-f7fe-4af4-bb60-f240ce950bc0" returned: 0 in 0.529s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-32311a29-028d-4674-9f8e-ad989f1757d4 tempest-VolumesTransfersTest-405311643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bde323df-f7fe-4af4-bb60-f240ce950bc0 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:53 devstack sudo[99093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bde323df-f7fe-4af4-bb60-f240ce950bc0 Sep 03 14:26:53 devstack sudo[99093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:53 devstack sudo[99093]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-32311a29-028d-4674-9f8e-ad989f1757d4 tempest-VolumesTransfersTest-405311643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bde323df-f7fe-4af4-bb60-f240ce950bc0" returned: 0 in 0.264s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:53 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-32311a29-028d-4674-9f8e-ad989f1757d4 tempest-VolumesTransfersTest-405311643 None] Lock "cinder-quobyte-bde323df-f7fe-4af4-bb60-f240ce950bc0" released by "delete_volume" :: held 0.852s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:26:53 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-32311a29-028d-4674-9f8e-ad989f1757d4 tempest-VolumesTransfersTest-405311643 None] Created reservations ['2260c7a6-e9ae-49c6-96ee-0db60c0dd3dc', 'bf9a4ed3-afa9-4a43-8f44-96a22a21e2d7', '232611ab-ddd6-471c-9a36-5e79e4a71f8a', 'e2956b80-936a-41e7-a73f-0e0dec0de7ea'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:26:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-32311a29-028d-4674-9f8e-ad989f1757d4 tempest-VolumesTransfersTest-405311643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:26:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-32311a29-028d-4674-9f8e-ad989f1757d4 tempest-VolumesTransfersTest-405311643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:26:53 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-32311a29-028d-4674-9f8e-ad989f1757d4 tempest-VolumesTransfersTest-405311643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:26:53 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-32311a29-028d-4674-9f8e-ad989f1757d4 tempest-VolumesTransfersTest-405311643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:26:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-32311a29-028d-4674-9f8e-ad989f1757d4 tempest-VolumesTransfersTest-405311643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:26:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-32311a29-028d-4674-9f8e-ad989f1757d4 tempest-VolumesTransfersTest-405311643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:26:53 devstack sudo[99097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:26:53 devstack sudo[99097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:26:53 devstack sudo[99097]: pam_unix(sudo:session): session closed for user root Sep 03 14:26:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-32311a29-028d-4674-9f8e-ad989f1757d4 tempest-VolumesTransfersTest-405311643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.326s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:26:53 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-32311a29-028d-4674-9f8e-ad989f1757d4 tempest-VolumesTransfersTest-405311643 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:26:53 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-32311a29-028d-4674-9f8e-ad989f1757d4 tempest-VolumesTransfersTest-405311643 None] Deleted volume successfully. Sep 03 14:26:53 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-32311a29-028d-4674-9f8e-ad989f1757d4 tempest-VolumesTransfersTest-405311643 None] Lock "cinder-bde323df-f7fe-4af4-bb60-f240ce950bc0-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:27:01 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-582f6ff1-955b-4112-9423-49e2d0c2580a tempest-GroupSnapshotsV319Test-73661233 None] Group tempest-GroupSnapshotsV319Test-Group-1448226904: creating Sep 03 14:27:01 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-582f6ff1-955b-4112-9423-49e2d0c2580a tempest-GroupSnapshotsV319Test-73661233 None] Group tempest-GroupSnapshotsV319Test-Group-1448226904: created successfully Sep 03 14:27:01 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-582f6ff1-955b-4112-9423-49e2d0c2580a tempest-GroupSnapshotsV319Test-73661233 None] Create group completed successfully. Sep 03 14:27:03 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-a64f6dc1-0da7-472b-bc14-2b516b902a78 tempest-GroupSnapshotsV319Test-73661233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:27:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a64f6dc1-0da7-472b-bc14-2b516b902a78 tempest-GroupSnapshotsV319Test-73661233 None] Flow 'volume_create_manager' (0791d711-98d0-4f13-9455-2d67b8901a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:27:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a64f6dc1-0da7-472b-bc14-2b516b902a78 tempest-GroupSnapshotsV319Test-73661233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (202900f3-7c66-4291-a92f-722145b28d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a64f6dc1-0da7-472b-bc14-2b516b902a78 tempest-GroupSnapshotsV319Test-73661233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (202900f3-7c66-4291-a92f-722145b28d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1039177015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a8cb3cb7-c8f1-4050-a721-0f6bff5ae4c9,host='devstack@QuobyteHD#QuobyteHD',id=40866377-0134-4325-920e-eb2baeb3afc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2de777dadf454ddab1abb7d738a40cbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:27:03Z,use_quota=True,user_id='0570265150fe45c29105797175bee47a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(77fd19d0-e5f3-412d-ad07-e5165b04029d),volume_type_id=77fd19d0-e5f3-412d-ad07-e5165b04029d)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a64f6dc1-0da7-472b-bc14-2b516b902a78 tempest-GroupSnapshotsV319Test-73661233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4ea260b-98fd-4247-b82c-cb583ddc079b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a64f6dc1-0da7-472b-bc14-2b516b902a78 tempest-GroupSnapshotsV319Test-73661233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4ea260b-98fd-4247-b82c-cb583ddc079b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a64f6dc1-0da7-472b-bc14-2b516b902a78 tempest-GroupSnapshotsV319Test-73661233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3481ea9-0830-4402-94d4-157d26767e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a64f6dc1-0da7-472b-bc14-2b516b902a78 tempest-GroupSnapshotsV319Test-73661233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3481ea9-0830-4402-94d4-157d26767e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40866377-0134-4325-920e-eb2baeb3afc0', 'volume_name': 'volume-40866377-0134-4325-920e-eb2baeb3afc0', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a64f6dc1-0da7-472b-bc14-2b516b902a78 tempest-GroupSnapshotsV319Test-73661233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb8acbff-e45a-4863-9b9d-f221aa60f6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a64f6dc1-0da7-472b-bc14-2b516b902a78 tempest-GroupSnapshotsV319Test-73661233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb8acbff-e45a-4863-9b9d-f221aa60f6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a64f6dc1-0da7-472b-bc14-2b516b902a78 tempest-GroupSnapshotsV319Test-73661233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c169719e-8848-40d6-a19b-c49cc5157dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:03 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-a64f6dc1-0da7-472b-bc14-2b516b902a78 tempest-GroupSnapshotsV319Test-73661233 None] Volume 40866377-0134-4325-920e-eb2baeb3afc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40866377-0134-4325-920e-eb2baeb3afc0', 'volume_size': 1} Sep 03 14:27:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a64f6dc1-0da7-472b-bc14-2b516b902a78 tempest-GroupSnapshotsV319Test-73661233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:27:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a64f6dc1-0da7-472b-bc14-2b516b902a78 tempest-GroupSnapshotsV319Test-73661233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:27:03 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a64f6dc1-0da7-472b-bc14-2b516b902a78 tempest-GroupSnapshotsV319Test-73661233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a8cb3cb7-c8f1-4050-a721-0f6bff5ae4c9,created_at=2026-09-03T12:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1039177015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a8cb3cb7-c8f1-4050-a721-0f6bff5ae4c9,host='devstack@QuobyteHD#QuobyteHD',id=40866377-0134-4325-920e-eb2baeb3afc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2de777dadf454ddab1abb7d738a40cbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:27:03Z,use_quota=True,user_id='0570265150fe45c29105797175bee47a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(77fd19d0-e5f3-412d-ad07-e5165b04029d),volume_type_id=77fd19d0-e5f3-412d-ad07-e5165b04029d)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:27:03 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-a64f6dc1-0da7-472b-bc14-2b516b902a78 tempest-GroupSnapshotsV319Test-73661233 None] Creating volume 40866377-0134-4325-920e-eb2baeb3afc0 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:27:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a64f6dc1-0da7-472b-bc14-2b516b902a78 tempest-GroupSnapshotsV319Test-73661233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:27:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a64f6dc1-0da7-472b-bc14-2b516b902a78 tempest-GroupSnapshotsV319Test-73661233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:27:03 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a64f6dc1-0da7-472b-bc14-2b516b902a78 tempest-GroupSnapshotsV319Test-73661233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:27:03 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a64f6dc1-0da7-472b-bc14-2b516b902a78 tempest-GroupSnapshotsV319Test-73661233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:27:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a64f6dc1-0da7-472b-bc14-2b516b902a78 tempest-GroupSnapshotsV319Test-73661233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:27:03 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a64f6dc1-0da7-472b-bc14-2b516b902a78 tempest-GroupSnapshotsV319Test-73661233 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:27:03 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-a64f6dc1-0da7-472b-bc14-2b516b902a78 tempest-GroupSnapshotsV319Test-73661233 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:27:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a64f6dc1-0da7-472b-bc14-2b516b902a78 tempest-GroupSnapshotsV319Test-73661233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-40866377-0134-4325-920e-eb2baeb3afc0 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:27:03 devstack sudo[99125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-40866377-0134-4325-920e-eb2baeb3afc0 1073741824 Sep 03 14:27:03 devstack sudo[99125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:27:04 devstack sudo[99125]: pam_unix(sudo:session): session closed for user root Sep 03 14:27:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a64f6dc1-0da7-472b-bc14-2b516b902a78 tempest-GroupSnapshotsV319Test-73661233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-40866377-0134-4325-920e-eb2baeb3afc0 1073741824" returned: 0 in 1.224s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:27:04 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:SELECT=111,cinder:UPDATE=143,cinder:INSERT=45,cinder:DELETE=13 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:27:04 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-07b6dc22-4c9f-4798-be15-7d52e5ea2b52 tempest-VolumesTransfersV357Test-24968037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:27:04 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-07b6dc22-4c9f-4798-be15-7d52e5ea2b52 tempest-VolumesTransfersV357Test-24968037 None] Flow 'volume_create_manager' (a11610f0-0b4f-45c4-8ddc-860649ddf569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:27:04 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-07b6dc22-4c9f-4798-be15-7d52e5ea2b52 tempest-VolumesTransfersV357Test-24968037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f85a9ed1-1faa-4e59-8666-cf7b166817a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:05 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-07b6dc22-4c9f-4798-be15-7d52e5ea2b52 tempest-VolumesTransfersV357Test-24968037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f85a9ed1-1faa-4e59-8666-cf7b166817a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-588419747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d57b3947-674f-4a75-ba54-b704beda2d66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df36d4984be04f8aa212ad78c2587d93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:27:05Z,use_quota=True,user_id='79d009d363004db3b34f3b14dfc790c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:05 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-07b6dc22-4c9f-4798-be15-7d52e5ea2b52 tempest-VolumesTransfersV357Test-24968037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05eb7730-b387-47c4-a84e-1d6a0cc4dc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:05 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-07b6dc22-4c9f-4798-be15-7d52e5ea2b52 tempest-VolumesTransfersV357Test-24968037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05eb7730-b387-47c4-a84e-1d6a0cc4dc27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:05 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-07b6dc22-4c9f-4798-be15-7d52e5ea2b52 tempest-VolumesTransfersV357Test-24968037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9370ff64-57d0-4aa9-8e2f-f051a6271fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:05 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-07b6dc22-4c9f-4798-be15-7d52e5ea2b52 tempest-VolumesTransfersV357Test-24968037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9370ff64-57d0-4aa9-8e2f-f051a6271fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd57b3947-674f-4a75-ba54-b704beda2d66', 'volume_name': 'volume-d57b3947-674f-4a75-ba54-b704beda2d66', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:05 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-07b6dc22-4c9f-4798-be15-7d52e5ea2b52 tempest-VolumesTransfersV357Test-24968037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40da9649-f73c-42e4-bc0f-f2e01cd37274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:05 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-07b6dc22-4c9f-4798-be15-7d52e5ea2b52 tempest-VolumesTransfersV357Test-24968037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40da9649-f73c-42e4-bc0f-f2e01cd37274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:05 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-07b6dc22-4c9f-4798-be15-7d52e5ea2b52 tempest-VolumesTransfersV357Test-24968037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a434beb-638b-4fe4-a1b3-4df367c4726a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:05 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-07b6dc22-4c9f-4798-be15-7d52e5ea2b52 tempest-VolumesTransfersV357Test-24968037 None] Volume d57b3947-674f-4a75-ba54-b704beda2d66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d57b3947-674f-4a75-ba54-b704beda2d66', 'volume_size': 1} Sep 03 14:27:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-07b6dc22-4c9f-4798-be15-7d52e5ea2b52 tempest-VolumesTransfersV357Test-24968037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:27:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a64f6dc1-0da7-472b-bc14-2b516b902a78 tempest-GroupSnapshotsV319Test-73661233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-40866377-0134-4325-920e-eb2baeb3afc0 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:27:05 devstack sudo[99231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-40866377-0134-4325-920e-eb2baeb3afc0 Sep 03 14:27:05 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:27:05 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root Sep 03 14:27:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a64f6dc1-0da7-472b-bc14-2b516b902a78 tempest-GroupSnapshotsV319Test-73661233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-40866377-0134-4325-920e-eb2baeb3afc0" returned: 0 in 0.433s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:27:05 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a64f6dc1-0da7-472b-bc14-2b516b902a78 tempest-GroupSnapshotsV319Test-73661233 None] <== create_volume: return (2196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:27:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a64f6dc1-0da7-472b-bc14-2b516b902a78 tempest-GroupSnapshotsV319Test-73661233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.200s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:27:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-07b6dc22-4c9f-4798-be15-7d52e5ea2b52 tempest-VolumesTransfersV357Test-24968037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.461s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:27:05 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-07b6dc22-4c9f-4798-be15-7d52e5ea2b52 tempest-VolumesTransfersV357Test-24968037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-588419747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d57b3947-674f-4a75-ba54-b704beda2d66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df36d4984be04f8aa212ad78c2587d93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:27:05Z,use_quota=True,user_id='79d009d363004db3b34f3b14dfc790c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:27:05 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-07b6dc22-4c9f-4798-be15-7d52e5ea2b52 tempest-VolumesTransfersV357Test-24968037 None] Creating volume d57b3947-674f-4a75-ba54-b704beda2d66 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:27:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-07b6dc22-4c9f-4798-be15-7d52e5ea2b52 tempest-VolumesTransfersV357Test-24968037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:27:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-07b6dc22-4c9f-4798-be15-7d52e5ea2b52 tempest-VolumesTransfersV357Test-24968037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:27:05 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-07b6dc22-4c9f-4798-be15-7d52e5ea2b52 tempest-VolumesTransfersV357Test-24968037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:27:05 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-07b6dc22-4c9f-4798-be15-7d52e5ea2b52 tempest-VolumesTransfersV357Test-24968037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:27:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-07b6dc22-4c9f-4798-be15-7d52e5ea2b52 tempest-VolumesTransfersV357Test-24968037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:27:05 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-07b6dc22-4c9f-4798-be15-7d52e5ea2b52 tempest-VolumesTransfersV357Test-24968037 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:27:05 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-07b6dc22-4c9f-4798-be15-7d52e5ea2b52 tempest-VolumesTransfersV357Test-24968037 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:27:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-07b6dc22-4c9f-4798-be15-7d52e5ea2b52 tempest-VolumesTransfersV357Test-24968037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d57b3947-674f-4a75-ba54-b704beda2d66 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:27:05 devstack sudo[99238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d57b3947-674f-4a75-ba54-b704beda2d66 1073741824 Sep 03 14:27:05 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a64f6dc1-0da7-472b-bc14-2b516b902a78 tempest-GroupSnapshotsV319Test-73661233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c169719e-8848-40d6-a19b-c49cc5157dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40866377-0134-4325-920e-eb2baeb3afc0', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:05 devstack sudo[99238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:27:05 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a64f6dc1-0da7-472b-bc14-2b516b902a78 tempest-GroupSnapshotsV319Test-73661233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e885ea3b-48ed-4d1e-ad10-f79c44d86b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:05 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-a64f6dc1-0da7-472b-bc14-2b516b902a78 tempest-GroupSnapshotsV319Test-73661233 None] Volume volume-40866377-0134-4325-920e-eb2baeb3afc0 (40866377-0134-4325-920e-eb2baeb3afc0): created successfully Sep 03 14:27:05 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a64f6dc1-0da7-472b-bc14-2b516b902a78 tempest-GroupSnapshotsV319Test-73661233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e885ea3b-48ed-4d1e-ad10-f79c44d86b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:05 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a64f6dc1-0da7-472b-bc14-2b516b902a78 tempest-GroupSnapshotsV319Test-73661233 None] Flow 'volume_create_manager' (0791d711-98d0-4f13-9455-2d67b8901a93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:27:05 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-a64f6dc1-0da7-472b-bc14-2b516b902a78 tempest-GroupSnapshotsV319Test-73661233 None] Created volume successfully. Sep 03 14:27:06 devstack sudo[99238]: pam_unix(sudo:session): session closed for user root Sep 03 14:27:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-07b6dc22-4c9f-4798-be15-7d52e5ea2b52 tempest-VolumesTransfersV357Test-24968037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d57b3947-674f-4a75-ba54-b704beda2d66 1073741824" returned: 0 in 0.664s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:27:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-07b6dc22-4c9f-4798-be15-7d52e5ea2b52 tempest-VolumesTransfersV357Test-24968037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d57b3947-674f-4a75-ba54-b704beda2d66 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:27:06 devstack sudo[99246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d57b3947-674f-4a75-ba54-b704beda2d66 Sep 03 14:27:06 devstack sudo[99246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:27:06 devstack sudo[99246]: pam_unix(sudo:session): session closed for user root Sep 03 14:27:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-07b6dc22-4c9f-4798-be15-7d52e5ea2b52 tempest-VolumesTransfersV357Test-24968037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d57b3947-674f-4a75-ba54-b704beda2d66" returned: 0 in 0.433s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:27:06 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-07b6dc22-4c9f-4798-be15-7d52e5ea2b52 tempest-VolumesTransfersV357Test-24968037 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:27:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-07b6dc22-4c9f-4798-be15-7d52e5ea2b52 tempest-VolumesTransfersV357Test-24968037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:27:06 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-d48106a7-1155-4f5f-ac51-6c17a6e2b3e1 tempest-GroupSnapshotsV319Test-73661233 None] GroupSnapshot 3341ef73-4019-439e-97b9-e52bc7b5061c: creating. Sep 03 14:27:06 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-07b6dc22-4c9f-4798-be15-7d52e5ea2b52 tempest-VolumesTransfersV357Test-24968037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a434beb-638b-4fe4-a1b3-4df367c4726a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d57b3947-674f-4a75-ba54-b704beda2d66', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:06 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-07b6dc22-4c9f-4798-be15-7d52e5ea2b52 tempest-VolumesTransfersV357Test-24968037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce06ba17-6bbf-4370-9c6e-d51ed6654a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:06 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-07b6dc22-4c9f-4798-be15-7d52e5ea2b52 tempest-VolumesTransfersV357Test-24968037 None] Volume volume-d57b3947-674f-4a75-ba54-b704beda2d66 (d57b3947-674f-4a75-ba54-b704beda2d66): created successfully Sep 03 14:27:07 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-07b6dc22-4c9f-4798-be15-7d52e5ea2b52 tempest-VolumesTransfersV357Test-24968037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce06ba17-6bbf-4370-9c6e-d51ed6654a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:07 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-07b6dc22-4c9f-4798-be15-7d52e5ea2b52 tempest-VolumesTransfersV357Test-24968037 None] Flow 'volume_create_manager' (a11610f0-0b4f-45c4-8ddc-860649ddf569) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:27:07 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d48106a7-1155-4f5f-ac51-6c17a6e2b3e1 tempest-GroupSnapshotsV319Test-73661233 None] Group snapshot 3341ef73-4019-439e-97b9-e52bc7b5061c: creating. {{(pid=87007) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 03 14:27:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d48106a7-1155-4f5f-ac51-6c17a6e2b3e1 tempest-GroupSnapshotsV319Test-73661233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:27:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d48106a7-1155-4f5f-ac51-6c17a6e2b3e1 tempest-GroupSnapshotsV319Test-73661233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:27:07 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-07b6dc22-4c9f-4798-be15-7d52e5ea2b52 tempest-VolumesTransfersV357Test-24968037 None] Created volume successfully. Sep 03 14:27:07 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-d48106a7-1155-4f5f-ac51-6c17a6e2b3e1 tempest-GroupSnapshotsV319Test-73661233 None] Creating offline snapshot b832b22e-f3b8-4626-860c-67fa9a5eaddf of volume 40866377-0134-4325-920e-eb2baeb3afc0 {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:27:07 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b7a65e99-81be-4fab-8d85-d896c1b8cd37 tempest-VolumesActionsTest-1610054353 None] Acquiring lock "cinder-5e27ea23-97c4-4101-95f3-2966c899cc60" by "attach_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:27:07 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d843b51-e042-4d62-992f-a295c066c210]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:27:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d48106a7-1155-4f5f-ac51-6c17a6e2b3e1 tempest-GroupSnapshotsV319Test-73661233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-40866377-0134-4325-920e-eb2baeb3afc0 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:27:07 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b7a65e99-81be-4fab-8d85-d896c1b8cd37 tempest-VolumesActionsTest-1610054353 None] Lock "cinder-5e27ea23-97c4-4101-95f3-2966c899cc60" acquired by "attach_volume" :: waited 0.051s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:27:07 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-b7a65e99-81be-4fab-8d85-d896c1b8cd37 tempest-VolumesActionsTest-1610054353 None] Attaching volume 5e27ea23-97c4-4101-95f3-2966c899cc60 to instance 7867038c-a4d3-4cab-85d6-050be213cdbe at mountpoint /dev/vdb on host None. Sep 03 14:27:07 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-b7a65e99-81be-4fab-8d85-d896c1b8cd37 tempest-VolumesActionsTest-1610054353 None] Attach volume completed successfully. Sep 03 14:27:07 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b7a65e99-81be-4fab-8d85-d896c1b8cd37 tempest-VolumesActionsTest-1610054353 None] Lock "cinder-5e27ea23-97c4-4101-95f3-2966c899cc60" released by "attach_volume" :: held 0.135s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:27:07 devstack sudo[99250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-40866377-0134-4325-920e-eb2baeb3afc0 Sep 03 14:27:07 devstack sudo[99250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:27:07 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c619c6ca-ac03-4d70-b903-779945228ccb tempest-VolumesActionsTest-1610054353 None] Acquiring lock "cinder-5e27ea23-97c4-4101-95f3-2966c899cc60-detach_volume" by "detach_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:27:07 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c619c6ca-ac03-4d70-b903-779945228ccb tempest-VolumesActionsTest-1610054353 None] Lock "cinder-5e27ea23-97c4-4101-95f3-2966c899cc60-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:27:07 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-c619c6ca-ac03-4d70-b903-779945228ccb tempest-VolumesActionsTest-1610054353 None] Detaching volume 5e27ea23-97c4-4101-95f3-2966c899cc60 from instance 7867038c-a4d3-4cab-85d6-050be213cdbe. Sep 03 14:27:07 devstack sudo[99250]: pam_unix(sudo:session): session closed for user root Sep 03 14:27:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d48106a7-1155-4f5f-ac51-6c17a6e2b3e1 tempest-GroupSnapshotsV319Test-73661233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-40866377-0134-4325-920e-eb2baeb3afc0" returned: 0 in 0.524s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:27:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d48106a7-1155-4f5f-ac51-6c17a6e2b3e1 tempest-GroupSnapshotsV319Test-73661233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-40866377-0134-4325-920e-eb2baeb3afc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-40866377-0134-4325-920e-eb2baeb3afc0.b832b22e-f3b8-4626-860c-67fa9a5eaddf 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:27:07 devstack sudo[99256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-40866377-0134-4325-920e-eb2baeb3afc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-40866377-0134-4325-920e-eb2baeb3afc0.b832b22e-f3b8-4626-860c-67fa9a5eaddf 1G Sep 03 14:27:07 devstack sudo[99256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:27:07 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-c619c6ca-ac03-4d70-b903-779945228ccb tempest-VolumesActionsTest-1610054353 None] Detach volume completed successfully. Sep 03 14:27:07 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c619c6ca-ac03-4d70-b903-779945228ccb tempest-VolumesActionsTest-1610054353 None] Lock "cinder-5e27ea23-97c4-4101-95f3-2966c899cc60-detach_volume" released by "detach_volume" :: held 0.111s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:27:08 devstack sudo[99256]: pam_unix(sudo:session): session closed for user root Sep 03 14:27:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d48106a7-1155-4f5f-ac51-6c17a6e2b3e1 tempest-GroupSnapshotsV319Test-73661233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-40866377-0134-4325-920e-eb2baeb3afc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-40866377-0134-4325-920e-eb2baeb3afc0.b832b22e-f3b8-4626-860c-67fa9a5eaddf 1G" returned: 0 in 0.770s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:27:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d48106a7-1155-4f5f-ac51-6c17a6e2b3e1 tempest-GroupSnapshotsV319Test-73661233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40866377-0134-4325-920e-eb2baeb3afc0 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-40866377-0134-4325-920e-eb2baeb3afc0.b832b22e-f3b8-4626-860c-67fa9a5eaddf {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:27:08 devstack sudo[99264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40866377-0134-4325-920e-eb2baeb3afc0 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-40866377-0134-4325-920e-eb2baeb3afc0.b832b22e-f3b8-4626-860c-67fa9a5eaddf Sep 03 14:27:08 devstack sudo[99264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:27:08 devstack sudo[99264]: pam_unix(sudo:session): session closed for user root Sep 03 14:27:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d48106a7-1155-4f5f-ac51-6c17a6e2b3e1 tempest-GroupSnapshotsV319Test-73661233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40866377-0134-4325-920e-eb2baeb3afc0 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-40866377-0134-4325-920e-eb2baeb3afc0.b832b22e-f3b8-4626-860c-67fa9a5eaddf" returned: 0 in 0.595s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:27:09 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-d48106a7-1155-4f5f-ac51-6c17a6e2b3e1 tempest-GroupSnapshotsV319Test-73661233 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-40866377-0134-4325-920e-eb2baeb3afc0.b832b22e-f3b8-4626-860c-67fa9a5eaddf is being set with open permissions: ugo+rw: NotImplementedError Sep 03 14:27:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d48106a7-1155-4f5f-ac51-6c17a6e2b3e1 tempest-GroupSnapshotsV319Test-73661233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-40866377-0134-4325-920e-eb2baeb3afc0.b832b22e-f3b8-4626-860c-67fa9a5eaddf {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:27:09 devstack sudo[99289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-40866377-0134-4325-920e-eb2baeb3afc0.b832b22e-f3b8-4626-860c-67fa9a5eaddf Sep 03 14:27:09 devstack sudo[99289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:27:09 devstack sudo[99289]: pam_unix(sudo:session): session closed for user root Sep 03 14:27:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d48106a7-1155-4f5f-ac51-6c17a6e2b3e1 tempest-GroupSnapshotsV319Test-73661233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-40866377-0134-4325-920e-eb2baeb3afc0.b832b22e-f3b8-4626-860c-67fa9a5eaddf" returned: 0 in 0.332s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:27:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d48106a7-1155-4f5f-ac51-6c17a6e2b3e1 tempest-GroupSnapshotsV319Test-73661233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-40866377-0134-4325-920e-eb2baeb3afc0.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:27:09 devstack sudo[99293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-40866377-0134-4325-920e-eb2baeb3afc0.info Sep 03 14:27:09 devstack sudo[99293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:27:09 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-84208bec-582e-45f3-a8b2-2b571e97761f tempest-VolumesTransfersV357Test-1956611914 None] Transfer volume completed successfully. Sep 03 14:27:09 devstack sudo[99293]: pam_unix(sudo:session): session closed for user root Sep 03 14:27:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d48106a7-1155-4f5f-ac51-6c17a6e2b3e1 tempest-GroupSnapshotsV319Test-73661233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-40866377-0134-4325-920e-eb2baeb3afc0.info" returned: 0 in 0.374s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:27:09 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-d48106a7-1155-4f5f-ac51-6c17a6e2b3e1 tempest-GroupSnapshotsV319Test-73661233 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-40866377-0134-4325-920e-eb2baeb3afc0.info is being set with open permissions: ugo+rw: NotImplementedError Sep 03 14:27:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d48106a7-1155-4f5f-ac51-6c17a6e2b3e1 tempest-GroupSnapshotsV319Test-73661233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-40866377-0134-4325-920e-eb2baeb3afc0.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:27:09 devstack sudo[99296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-40866377-0134-4325-920e-eb2baeb3afc0.info Sep 03 14:27:09 devstack sudo[99296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:27:10 devstack sudo[99296]: pam_unix(sudo:session): session closed for user root Sep 03 14:27:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d48106a7-1155-4f5f-ac51-6c17a6e2b3e1 tempest-GroupSnapshotsV319Test-73661233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-40866377-0134-4325-920e-eb2baeb3afc0.info" returned: 0 in 0.334s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:27:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d48106a7-1155-4f5f-ac51-6c17a6e2b3e1 tempest-GroupSnapshotsV319Test-73661233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.100s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:27:10 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-d48106a7-1155-4f5f-ac51-6c17a6e2b3e1 tempest-GroupSnapshotsV319Test-73661233 None] group_snapshot 3341ef73-4019-439e-97b9-e52bc7b5061c: created successfully Sep 03 14:27:10 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-27270689-a697-4f90-a106-50c128375f0a tempest-VolumesTransfersV357Test-1442193269 None] Acquiring lock "cinder-d57b3947-674f-4a75-ba54-b704beda2d66-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:27:10 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-27270689-a697-4f90-a106-50c128375f0a tempest-VolumesTransfersV357Test-1442193269 None] Lock "cinder-d57b3947-674f-4a75-ba54-b704beda2d66-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:27:10 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-27270689-a697-4f90-a106-50c128375f0a tempest-VolumesTransfersV357Test-1442193269 None] Acquiring lock "cinder-quobyte-d57b3947-674f-4a75-ba54-b704beda2d66" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:27:10 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-27270689-a697-4f90-a106-50c128375f0a tempest-VolumesTransfersV357Test-1442193269 None] Lock "cinder-quobyte-d57b3947-674f-4a75-ba54-b704beda2d66" acquired by "delete_volume" :: waited 0.031s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:27:10 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[41549cb3-8d45-437d-827b-0334a4deb73b]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:27:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-27270689-a697-4f90-a106-50c128375f0a tempest-VolumesTransfersV357Test-1442193269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d57b3947-674f-4a75-ba54-b704beda2d66 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:27:10 devstack sudo[99301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d57b3947-674f-4a75-ba54-b704beda2d66 Sep 03 14:27:10 devstack sudo[99301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:27:11 devstack sudo[99301]: pam_unix(sudo:session): session closed for user root Sep 03 14:27:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-27270689-a697-4f90-a106-50c128375f0a tempest-VolumesTransfersV357Test-1442193269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d57b3947-674f-4a75-ba54-b704beda2d66" returned: 0 in 0.420s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:27:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-27270689-a697-4f90-a106-50c128375f0a tempest-VolumesTransfersV357Test-1442193269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d57b3947-674f-4a75-ba54-b704beda2d66 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:27:11 devstack sudo[99308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d57b3947-674f-4a75-ba54-b704beda2d66 Sep 03 14:27:11 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:27:11 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root Sep 03 14:27:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-27270689-a697-4f90-a106-50c128375f0a tempest-VolumesTransfersV357Test-1442193269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d57b3947-674f-4a75-ba54-b704beda2d66" returned: 0 in 0.401s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:27:11 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-27270689-a697-4f90-a106-50c128375f0a tempest-VolumesTransfersV357Test-1442193269 None] Lock "cinder-quobyte-d57b3947-674f-4a75-ba54-b704beda2d66" released by "delete_volume" :: held 0.881s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:27:11 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-27270689-a697-4f90-a106-50c128375f0a tempest-VolumesTransfersV357Test-1442193269 None] Created reservations ['e9699f9a-ca69-410f-aa23-ad2a6755969c', '7e741589-0d03-43f6-8476-8ee3fe0fd620', '0af794ea-a672-4c1b-8a6b-13d7dd8d3528', '852f13f0-f1be-4683-bc65-b63eac2ff1d8'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:27:11 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-7ebfa19b-f695-4779-a21a-a9300d06c156 tempest-GroupSnapshotsV319Test-73661233 None] group_snapshot 3341ef73-4019-439e-97b9-e52bc7b5061c: deleting Sep 03 14:27:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7ebfa19b-f695-4779-a21a-a9300d06c156 tempest-GroupSnapshotsV319Test-73661233 None] group_snapshot 3341ef73-4019-439e-97b9-e52bc7b5061c: deleting {{(pid=87007) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 03 14:27:11 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7ebfa19b-f695-4779-a21a-a9300d06c156 tempest-GroupSnapshotsV319Test-73661233 None] Acquiring lock "cinder-quobyte-40866377-0134-4325-920e-eb2baeb3afc0" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:27:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-27270689-a697-4f90-a106-50c128375f0a tempest-VolumesTransfersV357Test-1442193269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:27:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-27270689-a697-4f90-a106-50c128375f0a tempest-VolumesTransfersV357Test-1442193269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:27:11 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-27270689-a697-4f90-a106-50c128375f0a tempest-VolumesTransfersV357Test-1442193269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:27:11 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-27270689-a697-4f90-a106-50c128375f0a tempest-VolumesTransfersV357Test-1442193269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:27:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-27270689-a697-4f90-a106-50c128375f0a tempest-VolumesTransfersV357Test-1442193269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:27:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-27270689-a697-4f90-a106-50c128375f0a tempest-VolumesTransfersV357Test-1442193269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:27:11 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7ebfa19b-f695-4779-a21a-a9300d06c156 tempest-GroupSnapshotsV319Test-73661233 None] Lock "cinder-quobyte-40866377-0134-4325-920e-eb2baeb3afc0" acquired by "delete_snapshot" :: waited 0.057s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:27:11 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7ebfa19b-f695-4779-a21a-a9300d06c156 tempest-GroupSnapshotsV319Test-73661233 None] Acquiring lock "cinder-quobyte-b832b22e-f3b8-4626-860c-67fa9a5eaddf" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:27:11 devstack sudo[99311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:27:11 devstack sudo[99311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:27:11 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7ebfa19b-f695-4779-a21a-a9300d06c156 tempest-GroupSnapshotsV319Test-73661233 None] Lock "cinder-quobyte-b832b22e-f3b8-4626-860c-67fa9a5eaddf" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:27:11 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-7ebfa19b-f695-4779-a21a-a9300d06c156 tempest-GroupSnapshotsV319Test-73661233 None] Deleting offline snapshot b832b22e-f3b8-4626-860c-67fa9a5eaddf of volume 40866377-0134-4325-920e-eb2baeb3afc0 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:27:11 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-7ebfa19b-f695-4779-a21a-a9300d06c156 tempest-GroupSnapshotsV319Test-73661233 None] snapshot_file for this snap is: volume-40866377-0134-4325-920e-eb2baeb3afc0.b832b22e-f3b8-4626-860c-67fa9a5eaddf {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:27:12 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef6e922-be82-4ea6-860c-bca50b65bd9e]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:27:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7ebfa19b-f695-4779-a21a-a9300d06c156 tempest-GroupSnapshotsV319Test-73661233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-40866377-0134-4325-920e-eb2baeb3afc0.b832b22e-f3b8-4626-860c-67fa9a5eaddf {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:27:12 devstack sudo[99313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-40866377-0134-4325-920e-eb2baeb3afc0.b832b22e-f3b8-4626-860c-67fa9a5eaddf Sep 03 14:27:12 devstack sudo[99313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:27:12 devstack sudo[99311]: pam_unix(sudo:session): session closed for user root Sep 03 14:27:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-27270689-a697-4f90-a106-50c128375f0a tempest-VolumesTransfersV357Test-1442193269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.481s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:27:12 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-27270689-a697-4f90-a106-50c128375f0a tempest-VolumesTransfersV357Test-1442193269 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:27:12 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-27270689-a697-4f90-a106-50c128375f0a tempest-VolumesTransfersV357Test-1442193269 None] Deleted volume successfully. Sep 03 14:27:12 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-27270689-a697-4f90-a106-50c128375f0a tempest-VolumesTransfersV357Test-1442193269 None] Lock "cinder-d57b3947-674f-4a75-ba54-b704beda2d66-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:27:12 devstack sudo[99313]: pam_unix(sudo:session): session closed for user root Sep 03 14:27:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7ebfa19b-f695-4779-a21a-a9300d06c156 tempest-GroupSnapshotsV319Test-73661233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-40866377-0134-4325-920e-eb2baeb3afc0.b832b22e-f3b8-4626-860c-67fa9a5eaddf" returned: 0 in 0.511s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:27:12 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-7ebfa19b-f695-4779-a21a-a9300d06c156 tempest-GroupSnapshotsV319Test-73661233 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40866377-0134-4325-920e-eb2baeb3afc0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:27:12 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[761256b8-d502-4b07-bdc1-0beca957894d]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:27:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7ebfa19b-f695-4779-a21a-a9300d06c156 tempest-GroupSnapshotsV319Test-73661233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-40866377-0134-4325-920e-eb2baeb3afc0 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:27:12 devstack sudo[99319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-40866377-0134-4325-920e-eb2baeb3afc0 Sep 03 14:27:12 devstack sudo[99319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:27:12 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-8256ecbc-81e3-4154-bf27-9f1a29a56fbf tempest-VolumesTransfersV357Test-24968037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:27:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8256ecbc-81e3-4154-bf27-9f1a29a56fbf tempest-VolumesTransfersV357Test-24968037 None] Flow 'volume_create_manager' (8506c0eb-ec27-48c4-ab64-181c0ac11c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:27:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8256ecbc-81e3-4154-bf27-9f1a29a56fbf tempest-VolumesTransfersV357Test-24968037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4212b67-e261-4350-a509-f0d10632a798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8256ecbc-81e3-4154-bf27-9f1a29a56fbf tempest-VolumesTransfersV357Test-24968037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4212b67-e261-4350-a509-f0d10632a798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-857128823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c11bc34d-9f0b-4c36-b1fe-160c0f473e65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df36d4984be04f8aa212ad78c2587d93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:27:13Z,use_quota=True,user_id='79d009d363004db3b34f3b14dfc790c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8256ecbc-81e3-4154-bf27-9f1a29a56fbf tempest-VolumesTransfersV357Test-24968037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f2238e1-4dba-42fd-84c3-21302c539be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8256ecbc-81e3-4154-bf27-9f1a29a56fbf tempest-VolumesTransfersV357Test-24968037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f2238e1-4dba-42fd-84c3-21302c539be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8256ecbc-81e3-4154-bf27-9f1a29a56fbf tempest-VolumesTransfersV357Test-24968037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9a55237-fab3-4cae-913b-b2f5a17c677b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8256ecbc-81e3-4154-bf27-9f1a29a56fbf tempest-VolumesTransfersV357Test-24968037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9a55237-fab3-4cae-913b-b2f5a17c677b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c11bc34d-9f0b-4c36-b1fe-160c0f473e65', 'volume_name': 'volume-c11bc34d-9f0b-4c36-b1fe-160c0f473e65', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8256ecbc-81e3-4154-bf27-9f1a29a56fbf tempest-VolumesTransfersV357Test-24968037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72b45db7-218d-4a1c-874c-640b1d9a7437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8256ecbc-81e3-4154-bf27-9f1a29a56fbf tempest-VolumesTransfersV357Test-24968037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72b45db7-218d-4a1c-874c-640b1d9a7437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8256ecbc-81e3-4154-bf27-9f1a29a56fbf tempest-VolumesTransfersV357Test-24968037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17043481-db72-4738-855d-bfeacaf28176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:13 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-8256ecbc-81e3-4154-bf27-9f1a29a56fbf tempest-VolumesTransfersV357Test-24968037 None] Volume c11bc34d-9f0b-4c36-b1fe-160c0f473e65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c11bc34d-9f0b-4c36-b1fe-160c0f473e65', 'volume_size': 1} Sep 03 14:27:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8256ecbc-81e3-4154-bf27-9f1a29a56fbf tempest-VolumesTransfersV357Test-24968037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:27:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8256ecbc-81e3-4154-bf27-9f1a29a56fbf tempest-VolumesTransfersV357Test-24968037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:27:13 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-8256ecbc-81e3-4154-bf27-9f1a29a56fbf tempest-VolumesTransfersV357Test-24968037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-857128823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c11bc34d-9f0b-4c36-b1fe-160c0f473e65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df36d4984be04f8aa212ad78c2587d93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:27:13Z,use_quota=True,user_id='79d009d363004db3b34f3b14dfc790c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:27:13 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-8256ecbc-81e3-4154-bf27-9f1a29a56fbf tempest-VolumesTransfersV357Test-24968037 None] Creating volume c11bc34d-9f0b-4c36-b1fe-160c0f473e65 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:27:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8256ecbc-81e3-4154-bf27-9f1a29a56fbf tempest-VolumesTransfersV357Test-24968037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:27:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8256ecbc-81e3-4154-bf27-9f1a29a56fbf tempest-VolumesTransfersV357Test-24968037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:27:13 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-8256ecbc-81e3-4154-bf27-9f1a29a56fbf tempest-VolumesTransfersV357Test-24968037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:27:13 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-8256ecbc-81e3-4154-bf27-9f1a29a56fbf tempest-VolumesTransfersV357Test-24968037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:27:13 devstack sudo[99319]: pam_unix(sudo:session): session closed for user root Sep 03 14:27:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8256ecbc-81e3-4154-bf27-9f1a29a56fbf tempest-VolumesTransfersV357Test-24968037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:27:13 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-8256ecbc-81e3-4154-bf27-9f1a29a56fbf tempest-VolumesTransfersV357Test-24968037 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:27:13 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-8256ecbc-81e3-4154-bf27-9f1a29a56fbf tempest-VolumesTransfersV357Test-24968037 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:27:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8256ecbc-81e3-4154-bf27-9f1a29a56fbf tempest-VolumesTransfersV357Test-24968037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c11bc34d-9f0b-4c36-b1fe-160c0f473e65 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:27:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7ebfa19b-f695-4779-a21a-a9300d06c156 tempest-GroupSnapshotsV319Test-73661233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-40866377-0134-4325-920e-eb2baeb3afc0" returned: 0 in 0.560s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:27:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7ebfa19b-f695-4779-a21a-a9300d06c156 tempest-GroupSnapshotsV319Test-73661233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-40866377-0134-4325-920e-eb2baeb3afc0.b832b22e-f3b8-4626-860c-67fa9a5eaddf {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:27:13 devstack sudo[99324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c11bc34d-9f0b-4c36-b1fe-160c0f473e65 1073741824 Sep 03 14:27:13 devstack sudo[99324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:27:13 devstack sudo[99325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-40866377-0134-4325-920e-eb2baeb3afc0.b832b22e-f3b8-4626-860c-67fa9a5eaddf Sep 03 14:27:13 devstack sudo[99325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:27:13 devstack sudo[99325]: pam_unix(sudo:session): session closed for user root Sep 03 14:27:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7ebfa19b-f695-4779-a21a-a9300d06c156 tempest-GroupSnapshotsV319Test-73661233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-40866377-0134-4325-920e-eb2baeb3afc0.b832b22e-f3b8-4626-860c-67fa9a5eaddf" returned: 0 in 0.477s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:27:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7ebfa19b-f695-4779-a21a-a9300d06c156 tempest-GroupSnapshotsV319Test-73661233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-40866377-0134-4325-920e-eb2baeb3afc0.b832b22e-f3b8-4626-860c-67fa9a5eaddf {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:27:13 devstack sudo[99324]: pam_unix(sudo:session): session closed for user root Sep 03 14:27:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8256ecbc-81e3-4154-bf27-9f1a29a56fbf tempest-VolumesTransfersV357Test-24968037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c11bc34d-9f0b-4c36-b1fe-160c0f473e65 1073741824" returned: 0 in 0.508s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:27:13 devstack sudo[99334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-40866377-0134-4325-920e-eb2baeb3afc0.b832b22e-f3b8-4626-860c-67fa9a5eaddf Sep 03 14:27:13 devstack sudo[99334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:27:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8256ecbc-81e3-4154-bf27-9f1a29a56fbf tempest-VolumesTransfersV357Test-24968037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c11bc34d-9f0b-4c36-b1fe-160c0f473e65 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:27:13 devstack sudo[99336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c11bc34d-9f0b-4c36-b1fe-160c0f473e65 Sep 03 14:27:13 devstack sudo[99336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:27:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-951e6f98-e316-4789-9a6f-c21ac1664150 tempest-VolumesActionsTest-1610054353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:27:13 devstack sudo[99334]: pam_unix(sudo:session): session closed for user root Sep 03 14:27:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7ebfa19b-f695-4779-a21a-a9300d06c156 tempest-GroupSnapshotsV319Test-73661233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-40866377-0134-4325-920e-eb2baeb3afc0.b832b22e-f3b8-4626-860c-67fa9a5eaddf" returned: 0 in 0.347s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:27:14 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7ebfa19b-f695-4779-a21a-a9300d06c156 tempest-GroupSnapshotsV319Test-73661233 None] Lock "cinder-quobyte-b832b22e-f3b8-4626-860c-67fa9a5eaddf" released by "_delete_snapshot" :: held 2.073s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:27:14 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7ebfa19b-f695-4779-a21a-a9300d06c156 tempest-GroupSnapshotsV319Test-73661233 None] Lock "cinder-quobyte-40866377-0134-4325-920e-eb2baeb3afc0" released by "delete_snapshot" :: held 2.105s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:27:14 devstack sudo[99336]: pam_unix(sudo:session): session closed for user root Sep 03 14:27:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8256ecbc-81e3-4154-bf27-9f1a29a56fbf tempest-VolumesTransfersV357Test-24968037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c11bc34d-9f0b-4c36-b1fe-160c0f473e65" returned: 0 in 0.358s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:27:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-8256ecbc-81e3-4154-bf27-9f1a29a56fbf tempest-VolumesTransfersV357Test-24968037 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:27:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8256ecbc-81e3-4154-bf27-9f1a29a56fbf tempest-VolumesTransfersV357Test-24968037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:27:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-951e6f98-e316-4789-9a6f-c21ac1664150 tempest-VolumesActionsTest-1610054353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.132s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:27:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8256ecbc-81e3-4154-bf27-9f1a29a56fbf tempest-VolumesTransfersV357Test-24968037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17043481-db72-4738-855d-bfeacaf28176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c11bc34d-9f0b-4c36-b1fe-160c0f473e65', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8256ecbc-81e3-4154-bf27-9f1a29a56fbf tempest-VolumesTransfersV357Test-24968037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a03330a-b4a0-478f-a2ec-d3b14e1b550d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:14 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[91bdca71-7ff3-4000-9a79-054c40d50d3d]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:27:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-951e6f98-e316-4789-9a6f-c21ac1664150 tempest-VolumesActionsTest-1610054353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e27ea23-97c4-4101-95f3-2966c899cc60 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:27:14 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-8256ecbc-81e3-4154-bf27-9f1a29a56fbf tempest-VolumesTransfersV357Test-24968037 None] Volume volume-c11bc34d-9f0b-4c36-b1fe-160c0f473e65 (c11bc34d-9f0b-4c36-b1fe-160c0f473e65): created successfully Sep 03 14:27:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8256ecbc-81e3-4154-bf27-9f1a29a56fbf tempest-VolumesTransfersV357Test-24968037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a03330a-b4a0-478f-a2ec-d3b14e1b550d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8256ecbc-81e3-4154-bf27-9f1a29a56fbf tempest-VolumesTransfersV357Test-24968037 None] Flow 'volume_create_manager' (8506c0eb-ec27-48c4-ab64-181c0ac11c83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:27:14 devstack cinder-volume[87007]: WARNING cinder.quota [None req-7ebfa19b-f695-4779-a21a-a9300d06c156 tempest-GroupSnapshotsV319Test-73661233 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1830860157 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1830860157, it is now deprecated. Please use the default quota class for default quota. Sep 03 14:27:14 devstack cinder-volume[87007]: WARNING cinder.quota [None req-7ebfa19b-f695-4779-a21a-a9300d06c156 tempest-GroupSnapshotsV319Test-73661233 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1830860157 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1830860157, it is now deprecated. Please use the default quota class for default quota. Sep 03 14:27:14 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-8256ecbc-81e3-4154-bf27-9f1a29a56fbf tempest-VolumesTransfersV357Test-24968037 None] Created volume successfully. Sep 03 14:27:14 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-7ebfa19b-f695-4779-a21a-a9300d06c156 tempest-GroupSnapshotsV319Test-73661233 None] Created reservations ['34ede9cc-115f-4dc4-baa1-5f14bae0eb7d', '2f909db2-a301-46cf-a7de-b0b23afb681f', 'd3fc89b3-5830-4ab4-ade6-d4eda1af0fbc', 'a6989593-6f58-488b-8f7f-1efec8b66e0a'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:27:14 devstack sudo[99340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e27ea23-97c4-4101-95f3-2966c899cc60 Sep 03 14:27:14 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:27:14 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-7ebfa19b-f695-4779-a21a-a9300d06c156 tempest-GroupSnapshotsV319Test-73661233 None] group_snapshot 3341ef73-4019-439e-97b9-e52bc7b5061c: deleted successfully Sep 03 14:27:14 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root Sep 03 14:27:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-951e6f98-e316-4789-9a6f-c21ac1664150 tempest-VolumesActionsTest-1610054353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e27ea23-97c4-4101-95f3-2966c899cc60" returned: 0 in 0.437s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:27:14 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[808cc4e1-20d4-4830-8fa5-260491a0a15c]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:27:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-951e6f98-e316-4789-9a6f-c21ac1664150 tempest-VolumesActionsTest-1610054353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e27ea23-97c4-4101-95f3-2966c899cc60 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:27:14 devstack sudo[99345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e27ea23-97c4-4101-95f3-2966c899cc60 Sep 03 14:27:14 devstack sudo[99345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:27:14 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-642d97de-79f2-4081-b0f6-c86f2b2a8bf4 tempest-GroupSnapshotsV319Test-73661233 None] Acquiring lock "cinder-quobyte-40866377-0134-4325-920e-eb2baeb3afc0" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:27:14 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-642d97de-79f2-4081-b0f6-c86f2b2a8bf4 tempest-GroupSnapshotsV319Test-73661233 None] Lock "cinder-quobyte-40866377-0134-4325-920e-eb2baeb3afc0" acquired by "delete_volume" :: waited 0.023s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:27:14 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6789777b-069c-4162-a3c6-c1e1ba8ef527]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:27:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-642d97de-79f2-4081-b0f6-c86f2b2a8bf4 tempest-GroupSnapshotsV319Test-73661233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-40866377-0134-4325-920e-eb2baeb3afc0 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:27:14 devstack sudo[99347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-40866377-0134-4325-920e-eb2baeb3afc0 Sep 03 14:27:14 devstack sudo[99347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:27:15 devstack sudo[99345]: pam_unix(sudo:session): session closed for user root Sep 03 14:27:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-951e6f98-e316-4789-9a6f-c21ac1664150 tempest-VolumesActionsTest-1610054353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e27ea23-97c4-4101-95f3-2966c899cc60" returned: 0 in 0.512s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:27:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-951e6f98-e316-4789-9a6f-c21ac1664150 tempest-VolumesActionsTest-1610054353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e27ea23-97c4-4101-95f3-2966c899cc60 /opt/stack/data/cinder/conversion/5e27ea23-97c4-4101-95f3-2966c899cc60.temp_image.5d189be9-795a-4a26-9d66-c518e0fa68458u4iit5w.img {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:27:15 devstack sudo[99353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e27ea23-97c4-4101-95f3-2966c899cc60 /opt/stack/data/cinder/conversion/5e27ea23-97c4-4101-95f3-2966c899cc60.temp_image.5d189be9-795a-4a26-9d66-c518e0fa68458u4iit5w.img Sep 03 14:27:15 devstack sudo[99353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:27:15 devstack sudo[99347]: pam_unix(sudo:session): session closed for user root Sep 03 14:27:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-642d97de-79f2-4081-b0f6-c86f2b2a8bf4 tempest-GroupSnapshotsV319Test-73661233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-40866377-0134-4325-920e-eb2baeb3afc0" returned: 0 in 0.557s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:27:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-642d97de-79f2-4081-b0f6-c86f2b2a8bf4 tempest-GroupSnapshotsV319Test-73661233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-40866377-0134-4325-920e-eb2baeb3afc0 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:27:15 devstack sudo[99361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-40866377-0134-4325-920e-eb2baeb3afc0 Sep 03 14:27:15 devstack sudo[99361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:27:15 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-46840fc3-68dc-4cb1-9470-26c4398ba1f4 tempest-VolumesTransfersV357Test-1442193269 None] Acquiring lock "cinder-c11bc34d-9f0b-4c36-b1fe-160c0f473e65-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:27:15 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-46840fc3-68dc-4cb1-9470-26c4398ba1f4 tempest-VolumesTransfersV357Test-1442193269 None] Lock "cinder-c11bc34d-9f0b-4c36-b1fe-160c0f473e65-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:27:15 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-46840fc3-68dc-4cb1-9470-26c4398ba1f4 tempest-VolumesTransfersV357Test-1442193269 None] Acquiring lock "cinder-quobyte-c11bc34d-9f0b-4c36-b1fe-160c0f473e65" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:27:15 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-46840fc3-68dc-4cb1-9470-26c4398ba1f4 tempest-VolumesTransfersV357Test-1442193269 None] Lock "cinder-quobyte-c11bc34d-9f0b-4c36-b1fe-160c0f473e65" acquired by "delete_volume" :: waited 0.047s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:27:15 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee091ba-341c-49fa-9939-cbe501b86944]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:27:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-46840fc3-68dc-4cb1-9470-26c4398ba1f4 tempest-VolumesTransfersV357Test-1442193269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c11bc34d-9f0b-4c36-b1fe-160c0f473e65 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:27:16 devstack sudo[99361]: pam_unix(sudo:session): session closed for user root Sep 03 14:27:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-642d97de-79f2-4081-b0f6-c86f2b2a8bf4 tempest-GroupSnapshotsV319Test-73661233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-40866377-0134-4325-920e-eb2baeb3afc0" returned: 0 in 0.784s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:27:16 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-642d97de-79f2-4081-b0f6-c86f2b2a8bf4 tempest-GroupSnapshotsV319Test-73661233 None] Lock "cinder-quobyte-40866377-0134-4325-920e-eb2baeb3afc0" released by "delete_volume" :: held 1.451s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:27:16 devstack sudo[99371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c11bc34d-9f0b-4c36-b1fe-160c0f473e65 Sep 03 14:27:16 devstack sudo[99371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:27:16 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-642d97de-79f2-4081-b0f6-c86f2b2a8bf4 tempest-GroupSnapshotsV319Test-73661233 None] Created reservations ['79d799a9-925e-40bb-82cb-25c9635cec0d'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:27:16 devstack cinder-volume[87007]: WARNING cinder.quota [None req-642d97de-79f2-4081-b0f6-c86f2b2a8bf4 tempest-GroupSnapshotsV319Test-73661233 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1830860157 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1830860157, it is now deprecated. Please use the default quota class for default quota. Sep 03 14:27:16 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-642d97de-79f2-4081-b0f6-c86f2b2a8bf4 tempest-GroupSnapshotsV319Test-73661233 None] Created reservations ['ef5f3df3-c456-43ba-8f61-ca42064082b3', 'a80fbc55-8919-4d0c-ac34-458ea6f831a8', '1a5fa7a8-db9f-4ea5-8fbe-151d89a05ddf', '2808345c-5fe1-494e-89b7-a7acc7926c8e'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:27:17 devstack sudo[99371]: pam_unix(sudo:session): session closed for user root Sep 03 14:27:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-46840fc3-68dc-4cb1-9470-26c4398ba1f4 tempest-VolumesTransfersV357Test-1442193269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c11bc34d-9f0b-4c36-b1fe-160c0f473e65" returned: 0 in 1.235s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:27:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-46840fc3-68dc-4cb1-9470-26c4398ba1f4 tempest-VolumesTransfersV357Test-1442193269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c11bc34d-9f0b-4c36-b1fe-160c0f473e65 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:27:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-642d97de-79f2-4081-b0f6-c86f2b2a8bf4 tempest-GroupSnapshotsV319Test-73661233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:27:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-642d97de-79f2-4081-b0f6-c86f2b2a8bf4 tempest-GroupSnapshotsV319Test-73661233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:27:17 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-642d97de-79f2-4081-b0f6-c86f2b2a8bf4 tempest-GroupSnapshotsV319Test-73661233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:27:17 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-642d97de-79f2-4081-b0f6-c86f2b2a8bf4 tempest-GroupSnapshotsV319Test-73661233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:27:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-642d97de-79f2-4081-b0f6-c86f2b2a8bf4 tempest-GroupSnapshotsV319Test-73661233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:27:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-642d97de-79f2-4081-b0f6-c86f2b2a8bf4 tempest-GroupSnapshotsV319Test-73661233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:27:17 devstack sudo[99382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c11bc34d-9f0b-4c36-b1fe-160c0f473e65 Sep 03 14:27:17 devstack sudo[99382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:27:17 devstack sudo[99383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:27:17 devstack sudo[99383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:27:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-642d97de-79f2-4081-b0f6-c86f2b2a8bf4 tempest-GroupSnapshotsV319Test-73661233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.531s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:27:17 devstack sudo[99383]: pam_unix(sudo:session): session closed for user root Sep 03 14:27:17 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-642d97de-79f2-4081-b0f6-c86f2b2a8bf4 tempest-GroupSnapshotsV319Test-73661233 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:27:17 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-642d97de-79f2-4081-b0f6-c86f2b2a8bf4 tempest-GroupSnapshotsV319Test-73661233 None] Delete group completed successfully. Sep 03 14:27:17 devstack sudo[99382]: pam_unix(sudo:session): session closed for user root Sep 03 14:27:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-46840fc3-68dc-4cb1-9470-26c4398ba1f4 tempest-VolumesTransfersV357Test-1442193269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c11bc34d-9f0b-4c36-b1fe-160c0f473e65" returned: 0 in 0.823s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:27:17 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-46840fc3-68dc-4cb1-9470-26c4398ba1f4 tempest-VolumesTransfersV357Test-1442193269 None] Lock "cinder-quobyte-c11bc34d-9f0b-4c36-b1fe-160c0f473e65" released by "delete_volume" :: held 2.186s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:27:18 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-46840fc3-68dc-4cb1-9470-26c4398ba1f4 tempest-VolumesTransfersV357Test-1442193269 None] Created reservations ['f273732e-4ea0-4234-a4b9-387b92e802a3', '9454a93e-702f-4c8d-8d34-6eafecfcf525', 'f3d489e0-b969-410d-bd35-93619e8fe536', 'a26de693-333f-4406-b9a4-bfb056a29fb1'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:27:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-46840fc3-68dc-4cb1-9470-26c4398ba1f4 tempest-VolumesTransfersV357Test-1442193269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:27:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-46840fc3-68dc-4cb1-9470-26c4398ba1f4 tempest-VolumesTransfersV357Test-1442193269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:27:18 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-46840fc3-68dc-4cb1-9470-26c4398ba1f4 tempest-VolumesTransfersV357Test-1442193269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:27:18 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-46840fc3-68dc-4cb1-9470-26c4398ba1f4 tempest-VolumesTransfersV357Test-1442193269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:27:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-46840fc3-68dc-4cb1-9470-26c4398ba1f4 tempest-VolumesTransfersV357Test-1442193269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:27:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-46840fc3-68dc-4cb1-9470-26c4398ba1f4 tempest-VolumesTransfersV357Test-1442193269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:27:18 devstack sudo[99388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:27:18 devstack sudo[99388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:27:19 devstack sudo[99388]: pam_unix(sudo:session): session closed for user root Sep 03 14:27:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-46840fc3-68dc-4cb1-9470-26c4398ba1f4 tempest-VolumesTransfersV357Test-1442193269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.685s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:27:19 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-46840fc3-68dc-4cb1-9470-26c4398ba1f4 tempest-VolumesTransfersV357Test-1442193269 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:27:19 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-46840fc3-68dc-4cb1-9470-26c4398ba1f4 tempest-VolumesTransfersV357Test-1442193269 None] Deleted volume successfully. Sep 03 14:27:19 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-46840fc3-68dc-4cb1-9470-26c4398ba1f4 tempest-VolumesTransfersV357Test-1442193269 None] Lock "cinder-c11bc34d-9f0b-4c36-b1fe-160c0f473e65-delete_volume" released by "delete_volume" :: held 3.615s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:27:21 devstack sudo[99353]: pam_unix(sudo:session): session closed for user root Sep 03 14:27:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-951e6f98-e316-4789-9a6f-c21ac1664150 tempest-VolumesActionsTest-1610054353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e27ea23-97c4-4101-95f3-2966c899cc60 /opt/stack/data/cinder/conversion/5e27ea23-97c4-4101-95f3-2966c899cc60.temp_image.5d189be9-795a-4a26-9d66-c518e0fa68458u4iit5w.img" returned: 0 in 6.260s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:27:21 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db63508-1dcc-4197-857b-9bfb6d047cb0]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:27:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-951e6f98-e316-4789-9a6f-c21ac1664150 tempest-VolumesActionsTest-1610054353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e27ea23-97c4-4101-95f3-2966c899cc60 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:27:21 devstack sudo[99391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e27ea23-97c4-4101-95f3-2966c899cc60 Sep 03 14:27:21 devstack sudo[99391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:27:22 devstack sudo[99391]: pam_unix(sudo:session): session closed for user root Sep 03 14:27:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-951e6f98-e316-4789-9a6f-c21ac1664150 tempest-VolumesActionsTest-1610054353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e27ea23-97c4-4101-95f3-2966c899cc60" returned: 0 in 0.690s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:27:22 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-951e6f98-e316-4789-9a6f-c21ac1664150 tempest-VolumesActionsTest-1610054353 None] Image conversion details: src /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e27ea23-97c4-4101-95f3-2966c899cc60, size 1024.00 MB, duration 6.26 sec, destination /opt/stack/data/cinder/conversion/5e27ea23-97c4-4101-95f3-2966c899cc60.temp_image.5d189be9-795a-4a26-9d66-c518e0fa68458u4iit5w.img {{(pid=87007) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 14:27:22 devstack cinder-volume[87007]: INFO cinder.image.image_utils [None req-951e6f98-e316-4789-9a6f-c21ac1664150 tempest-VolumesActionsTest-1610054353 None] Converted 1024.00 MB image at 163.52 MB/s Sep 03 14:27:22 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-951e6f98-e316-4789-9a6f-c21ac1664150 tempest-VolumesActionsTest-1610054353 None] 5d189be9-795a-4a26-9d66-c518e0fa6845 was raw, no need to convert to raw {{(pid=87007) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 03 14:27:31 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-13aeb600-c5a7-45d4-9385-24e157aabe04 tempest-GroupsTest-1964696563 None] Group tempest-Group1-1158081888: creating Sep 03 14:27:31 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-13aeb600-c5a7-45d4-9385-24e157aabe04 tempest-GroupsTest-1964696563 None] Group tempest-Group1-1158081888: created successfully Sep 03 14:27:31 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-13aeb600-c5a7-45d4-9385-24e157aabe04 tempest-GroupsTest-1964696563 None] Create group completed successfully. Sep 03 14:27:31 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ca46a52-0955-4c11-8fb9-b55dfde061bb tempest-VolumesCloneTest-872901948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:27:31 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8ca46a52-0955-4c11-8fb9-b55dfde061bb tempest-VolumesCloneTest-872901948 None] Flow 'volume_create_manager' (59b73914-defd-4743-ae9f-2c13647207f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:27:31 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8ca46a52-0955-4c11-8fb9-b55dfde061bb tempest-VolumesCloneTest-872901948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a7d7902-cb31-4fc6-b652-88606b7cb3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:31 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8ca46a52-0955-4c11-8fb9-b55dfde061bb tempest-VolumesCloneTest-872901948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a7d7902-cb31-4fc6-b652-88606b7cb3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2019711163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c964e42-8c22-4067-8ece-7fbfae1197c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7643fa1404474ef6b9ef42e5196b76a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:27:32Z,use_quota=True,user_id='4f41f02097ad418286a2872156e3a7c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:31 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8ca46a52-0955-4c11-8fb9-b55dfde061bb tempest-VolumesCloneTest-872901948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edaea425-d988-498a-8fb1-9261ea8323d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:31 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8ca46a52-0955-4c11-8fb9-b55dfde061bb tempest-VolumesCloneTest-872901948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edaea425-d988-498a-8fb1-9261ea8323d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:31 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8ca46a52-0955-4c11-8fb9-b55dfde061bb tempest-VolumesCloneTest-872901948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cb42710-8f4c-4866-90dd-8b835e1e4a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:31 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8ca46a52-0955-4c11-8fb9-b55dfde061bb tempest-VolumesCloneTest-872901948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cb42710-8f4c-4866-90dd-8b835e1e4a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c964e42-8c22-4067-8ece-7fbfae1197c2', 'volume_name': 'volume-5c964e42-8c22-4067-8ece-7fbfae1197c2', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:31 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8ca46a52-0955-4c11-8fb9-b55dfde061bb tempest-VolumesCloneTest-872901948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed348059-7cdb-4eb2-ac21-0513e16ac0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:31 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8ca46a52-0955-4c11-8fb9-b55dfde061bb tempest-VolumesCloneTest-872901948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed348059-7cdb-4eb2-ac21-0513e16ac0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:31 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8ca46a52-0955-4c11-8fb9-b55dfde061bb tempest-VolumesCloneTest-872901948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcacefdd-6961-41ee-a0be-8c6e88aa593f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:31 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-8ca46a52-0955-4c11-8fb9-b55dfde061bb tempest-VolumesCloneTest-872901948 None] Volume 5c964e42-8c22-4067-8ece-7fbfae1197c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c964e42-8c22-4067-8ece-7fbfae1197c2', 'volume_size': 1} Sep 03 14:27:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8ca46a52-0955-4c11-8fb9-b55dfde061bb tempest-VolumesCloneTest-872901948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:27:32 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-b1edc5be-1f0b-4f7f-af33-00d4b0a1d95a tempest-GroupsTest-1964696563 None] Group tempest-Group2-1798755571: creating Sep 03 14:27:32 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-b1edc5be-1f0b-4f7f-af33-00d4b0a1d95a tempest-GroupsTest-1964696563 None] Group tempest-Group2-1798755571: created successfully Sep 03 14:27:32 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-b1edc5be-1f0b-4f7f-af33-00d4b0a1d95a tempest-GroupsTest-1964696563 None] Create group completed successfully. Sep 03 14:27:35 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5a99413-a9f5-48e5-a59d-a7195d7582ae tempest-GroupsTest-1964696563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:27:35 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e5a99413-a9f5-48e5-a59d-a7195d7582ae tempest-GroupsTest-1964696563 None] Flow 'volume_create_manager' (cc65cb37-3b35-440a-8ca8-0c4e39c2bd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:27:35 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e5a99413-a9f5-48e5-a59d-a7195d7582ae tempest-GroupsTest-1964696563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a2a2e49-609f-42f5-87f4-af0c15ae7c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:35 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e5a99413-a9f5-48e5-a59d-a7195d7582ae tempest-GroupsTest-1964696563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a2a2e49-609f-42f5-87f4-af0c15ae7c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1113356533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f11b5e93-35b0-4bcf-b979-7f73a0a83685,host='devstack@QuobyteHD#QuobyteHD',id=fe165f8d-0cea-42ef-b4dd-06b7dce8a9d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e862723866f413489ac61f42f869c17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:27:35Z,use_quota=True,user_id='70c1b9af10e0485fab13ccf4ff4c7038',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(819b877a-0ab4-44c6-8138-74c8a41d5e10),volume_type_id=819b877a-0ab4-44c6-8138-74c8a41d5e10)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:35 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e5a99413-a9f5-48e5-a59d-a7195d7582ae tempest-GroupsTest-1964696563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68a125da-1b1f-47ba-9779-810ee36b8575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:35 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e5a99413-a9f5-48e5-a59d-a7195d7582ae tempest-GroupsTest-1964696563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68a125da-1b1f-47ba-9779-810ee36b8575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:35 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e5a99413-a9f5-48e5-a59d-a7195d7582ae tempest-GroupsTest-1964696563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c186ed-9f93-4e07-a8ef-1b741a9490a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:35 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e5a99413-a9f5-48e5-a59d-a7195d7582ae tempest-GroupsTest-1964696563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c186ed-9f93-4e07-a8ef-1b741a9490a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe165f8d-0cea-42ef-b4dd-06b7dce8a9d4', 'volume_name': 'volume-fe165f8d-0cea-42ef-b4dd-06b7dce8a9d4', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:35 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e5a99413-a9f5-48e5-a59d-a7195d7582ae tempest-GroupsTest-1964696563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc1c0a54-d743-4730-a5e2-dcb4e90baec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:35 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e5a99413-a9f5-48e5-a59d-a7195d7582ae tempest-GroupsTest-1964696563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc1c0a54-d743-4730-a5e2-dcb4e90baec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:35 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e5a99413-a9f5-48e5-a59d-a7195d7582ae tempest-GroupsTest-1964696563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f8f208f-c056-4b6b-8b16-834257799b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:35 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-e5a99413-a9f5-48e5-a59d-a7195d7582ae tempest-GroupsTest-1964696563 None] Volume fe165f8d-0cea-42ef-b4dd-06b7dce8a9d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe165f8d-0cea-42ef-b4dd-06b7dce8a9d4', 'volume_size': 1} Sep 03 14:27:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-e5a99413-a9f5-48e5-a59d-a7195d7582ae tempest-GroupsTest-1964696563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:27:41 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d05283c-6221-4737-8886-74e56a1ae033 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:27:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4d05283c-6221-4737-8886-74e56a1ae033 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Flow 'volume_create_manager' (1cfc298b-72c1-4c47-9873-9401d0e773ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:27:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4d05283c-6221-4737-8886-74e56a1ae033 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0849007d-a943-47df-be8a-13375f7d3220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4d05283c-6221-4737-8886-74e56a1ae033 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0849007d-a943-47df-be8a-13375f7d3220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1275939286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=426d8cf4-6b43-4581-af8a-15d423a627d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb107b45bb174ba7bcc55966fb10f0d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:27:41Z,use_quota=True,user_id='09b6f40cd5f44879a6f51f1f9b81af55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4d05283c-6221-4737-8886-74e56a1ae033 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de1392f5-082b-4079-b897-48e76b5b0421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4d05283c-6221-4737-8886-74e56a1ae033 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de1392f5-082b-4079-b897-48e76b5b0421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4d05283c-6221-4737-8886-74e56a1ae033 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (183a2581-09f6-4610-b9a9-230236b88110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4d05283c-6221-4737-8886-74e56a1ae033 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (183a2581-09f6-4610-b9a9-230236b88110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '426d8cf4-6b43-4581-af8a-15d423a627d7', 'volume_name': 'volume-426d8cf4-6b43-4581-af8a-15d423a627d7', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4d05283c-6221-4737-8886-74e56a1ae033 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8708acb-8c91-446a-95c2-506a01cbe535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4d05283c-6221-4737-8886-74e56a1ae033 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8708acb-8c91-446a-95c2-506a01cbe535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4d05283c-6221-4737-8886-74e56a1ae033 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b0769d2-15ce-4dd1-a259-123b0d6511b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:41 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-4d05283c-6221-4737-8886-74e56a1ae033 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Volume 426d8cf4-6b43-4581-af8a-15d423a627d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-426d8cf4-6b43-4581-af8a-15d423a627d7', 'volume_size': 1} Sep 03 14:27:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4d05283c-6221-4737-8886-74e56a1ae033 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:27:41 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:UPDATE=112,cinder:SELECT=95,cinder:INSERT=18,cinder:DELETE=7 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:27:41 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d755fc6-fe97-4bdc-96a9-7b1b1dbba117 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:27:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-1d755fc6-fe97-4bdc-96a9-7b1b1dbba117 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Flow 'volume_create_manager' (5c15949e-8ad1-4e69-80d0-82ff788ec57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:27:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-1d755fc6-fe97-4bdc-96a9-7b1b1dbba117 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b08b8b0b-1855-4edb-a50e-cb5dd6368256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-1d755fc6-fe97-4bdc-96a9-7b1b1dbba117 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b08b8b0b-1855-4edb-a50e-cb5dd6368256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1714579857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad30970e-0797-4044-8e29-9a9712a4ce62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb107b45bb174ba7bcc55966fb10f0d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:27:42Z,use_quota=True,user_id='09b6f40cd5f44879a6f51f1f9b81af55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-1d755fc6-fe97-4bdc-96a9-7b1b1dbba117 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7ffdcfc-e675-4b1a-845f-675b13e5ff1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-1d755fc6-fe97-4bdc-96a9-7b1b1dbba117 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7ffdcfc-e675-4b1a-845f-675b13e5ff1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-1d755fc6-fe97-4bdc-96a9-7b1b1dbba117 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (805728ff-8989-4c8e-a546-edf3716cc3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-1d755fc6-fe97-4bdc-96a9-7b1b1dbba117 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (805728ff-8989-4c8e-a546-edf3716cc3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad30970e-0797-4044-8e29-9a9712a4ce62', 'volume_name': 'volume-ad30970e-0797-4044-8e29-9a9712a4ce62', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-1d755fc6-fe97-4bdc-96a9-7b1b1dbba117 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d43af80-2bcc-4232-88ef-a92072dc4e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-1d755fc6-fe97-4bdc-96a9-7b1b1dbba117 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d43af80-2bcc-4232-88ef-a92072dc4e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-1d755fc6-fe97-4bdc-96a9-7b1b1dbba117 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fac15f2-131c-4e2c-9014-290cfab34152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:41 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-1d755fc6-fe97-4bdc-96a9-7b1b1dbba117 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Volume ad30970e-0797-4044-8e29-9a9712a4ce62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad30970e-0797-4044-8e29-9a9712a4ce62', 'volume_size': 1} Sep 03 14:27:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1d755fc6-fe97-4bdc-96a9-7b1b1dbba117 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:27:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-951e6f98-e316-4789-9a6f-c21ac1664150 tempest-VolumesActionsTest-1610054353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 32.335s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:27:46 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-951e6f98-e316-4789-9a6f-c21ac1664150 tempest-VolumesActionsTest-1610054353 None] Uploaded volume to glance image-id: 5d189be9-795a-4a26-9d66-c518e0fa6845. {{(pid=87007) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 03 14:27:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8ca46a52-0955-4c11-8fb9-b55dfde061bb tempest-VolumesCloneTest-872901948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.450s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:27:46 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-8ca46a52-0955-4c11-8fb9-b55dfde061bb tempest-VolumesCloneTest-872901948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2019711163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c964e42-8c22-4067-8ece-7fbfae1197c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7643fa1404474ef6b9ef42e5196b76a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:27:32Z,use_quota=True,user_id='4f41f02097ad418286a2872156e3a7c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:27:46 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-8ca46a52-0955-4c11-8fb9-b55dfde061bb tempest-VolumesCloneTest-872901948 None] Creating volume 5c964e42-8c22-4067-8ece-7fbfae1197c2 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:27:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8ca46a52-0955-4c11-8fb9-b55dfde061bb tempest-VolumesCloneTest-872901948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:27:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8ca46a52-0955-4c11-8fb9-b55dfde061bb tempest-VolumesCloneTest-872901948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:27:46 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-8ca46a52-0955-4c11-8fb9-b55dfde061bb tempest-VolumesCloneTest-872901948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:27:46 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-8ca46a52-0955-4c11-8fb9-b55dfde061bb tempest-VolumesCloneTest-872901948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:27:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8ca46a52-0955-4c11-8fb9-b55dfde061bb tempest-VolumesCloneTest-872901948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:27:46 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-8ca46a52-0955-4c11-8fb9-b55dfde061bb tempest-VolumesCloneTest-872901948 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:27:46 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-8ca46a52-0955-4c11-8fb9-b55dfde061bb tempest-VolumesCloneTest-872901948 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:27:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8ca46a52-0955-4c11-8fb9-b55dfde061bb tempest-VolumesCloneTest-872901948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:27:46 devstack sudo[99414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2 1073741824 Sep 03 14:27:46 devstack sudo[99414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:27:46 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-951e6f98-e316-4789-9a6f-c21ac1664150 tempest-VolumesActionsTest-1610054353 None] Copy volume to image completed successfully. Sep 03 14:27:47 devstack sudo[99414]: pam_unix(sudo:session): session closed for user root Sep 03 14:27:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8ca46a52-0955-4c11-8fb9-b55dfde061bb tempest-VolumesCloneTest-872901948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2 1073741824" returned: 0 in 0.667s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:27:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8ca46a52-0955-4c11-8fb9-b55dfde061bb tempest-VolumesCloneTest-872901948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:27:47 devstack sudo[99435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2 Sep 03 14:27:47 devstack sudo[99435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:27:47 devstack sudo[99435]: pam_unix(sudo:session): session closed for user root Sep 03 14:27:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8ca46a52-0955-4c11-8fb9-b55dfde061bb tempest-VolumesCloneTest-872901948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2" returned: 0 in 0.290s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:27:47 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-8ca46a52-0955-4c11-8fb9-b55dfde061bb tempest-VolumesCloneTest-872901948 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:27:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8ca46a52-0955-4c11-8fb9-b55dfde061bb tempest-VolumesCloneTest-872901948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:27:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-e5a99413-a9f5-48e5-a59d-a7195d7582ae tempest-GroupsTest-1964696563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.076s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:27:47 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-e5a99413-a9f5-48e5-a59d-a7195d7582ae tempest-GroupsTest-1964696563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f11b5e93-35b0-4bcf-b979-7f73a0a83685,created_at=2026-09-03T12:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1113356533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f11b5e93-35b0-4bcf-b979-7f73a0a83685,host='devstack@QuobyteHD#QuobyteHD',id=fe165f8d-0cea-42ef-b4dd-06b7dce8a9d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e862723866f413489ac61f42f869c17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:27:35Z,use_quota=True,user_id='70c1b9af10e0485fab13ccf4ff4c7038',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(819b877a-0ab4-44c6-8138-74c8a41d5e10),volume_type_id=819b877a-0ab4-44c6-8138-74c8a41d5e10)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:27:47 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-e5a99413-a9f5-48e5-a59d-a7195d7582ae tempest-GroupsTest-1964696563 None] Creating volume fe165f8d-0cea-42ef-b4dd-06b7dce8a9d4 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:27:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-e5a99413-a9f5-48e5-a59d-a7195d7582ae tempest-GroupsTest-1964696563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:27:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-e5a99413-a9f5-48e5-a59d-a7195d7582ae tempest-GroupsTest-1964696563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:27:47 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-e5a99413-a9f5-48e5-a59d-a7195d7582ae tempest-GroupsTest-1964696563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:27:47 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-e5a99413-a9f5-48e5-a59d-a7195d7582ae tempest-GroupsTest-1964696563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:27:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-e5a99413-a9f5-48e5-a59d-a7195d7582ae tempest-GroupsTest-1964696563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:27:47 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-e5a99413-a9f5-48e5-a59d-a7195d7582ae tempest-GroupsTest-1964696563 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:27:47 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-e5a99413-a9f5-48e5-a59d-a7195d7582ae tempest-GroupsTest-1964696563 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:27:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e5a99413-a9f5-48e5-a59d-a7195d7582ae tempest-GroupsTest-1964696563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fe165f8d-0cea-42ef-b4dd-06b7dce8a9d4 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:27:47 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8ca46a52-0955-4c11-8fb9-b55dfde061bb tempest-VolumesCloneTest-872901948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcacefdd-6961-41ee-a0be-8c6e88aa593f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c964e42-8c22-4067-8ece-7fbfae1197c2', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:47 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8ca46a52-0955-4c11-8fb9-b55dfde061bb tempest-VolumesCloneTest-872901948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1954c22-53c9-453f-945e-acb36c33fb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:47 devstack sudo[99438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fe165f8d-0cea-42ef-b4dd-06b7dce8a9d4 1073741824 Sep 03 14:27:47 devstack sudo[99438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:27:47 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-8ca46a52-0955-4c11-8fb9-b55dfde061bb tempest-VolumesCloneTest-872901948 None] Volume volume-5c964e42-8c22-4067-8ece-7fbfae1197c2 (5c964e42-8c22-4067-8ece-7fbfae1197c2): created successfully Sep 03 14:27:47 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8ca46a52-0955-4c11-8fb9-b55dfde061bb tempest-VolumesCloneTest-872901948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1954c22-53c9-453f-945e-acb36c33fb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:47 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8ca46a52-0955-4c11-8fb9-b55dfde061bb tempest-VolumesCloneTest-872901948 None] Flow 'volume_create_manager' (59b73914-defd-4743-ae9f-2c13647207f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:27:47 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-8ca46a52-0955-4c11-8fb9-b55dfde061bb tempest-VolumesCloneTest-872901948 None] Created volume successfully. Sep 03 14:27:48 devstack sudo[99438]: pam_unix(sudo:session): session closed for user root Sep 03 14:27:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e5a99413-a9f5-48e5-a59d-a7195d7582ae tempest-GroupsTest-1964696563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fe165f8d-0cea-42ef-b4dd-06b7dce8a9d4 1073741824" returned: 0 in 0.558s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:27:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e5a99413-a9f5-48e5-a59d-a7195d7582ae tempest-GroupsTest-1964696563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fe165f8d-0cea-42ef-b4dd-06b7dce8a9d4 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:27:48 devstack sudo[99444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fe165f8d-0cea-42ef-b4dd-06b7dce8a9d4 Sep 03 14:27:48 devstack sudo[99444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:27:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-e5987760-99df-465a-a6bf-37f72e245cff tempest-VolumesActionsTest-1610054353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:27:48 devstack sudo[99444]: pam_unix(sudo:session): session closed for user root Sep 03 14:27:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e5a99413-a9f5-48e5-a59d-a7195d7582ae tempest-GroupsTest-1964696563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fe165f8d-0cea-42ef-b4dd-06b7dce8a9d4" returned: 0 in 0.306s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:27:48 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-e5a99413-a9f5-48e5-a59d-a7195d7582ae tempest-GroupsTest-1964696563 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:27:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-e5a99413-a9f5-48e5-a59d-a7195d7582ae tempest-GroupsTest-1964696563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:27:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4d05283c-6221-4737-8886-74e56a1ae033 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.038s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:27:48 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-4d05283c-6221-4737-8886-74e56a1ae033 tempest-TestServerVolumeAttachmentScenario-1248877400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1275939286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=426d8cf4-6b43-4581-af8a-15d423a627d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb107b45bb174ba7bcc55966fb10f0d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:27:41Z,use_quota=True,user_id='09b6f40cd5f44879a6f51f1f9b81af55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:27:48 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-4d05283c-6221-4737-8886-74e56a1ae033 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Creating volume 426d8cf4-6b43-4581-af8a-15d423a627d7 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:27:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4d05283c-6221-4737-8886-74e56a1ae033 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:27:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4d05283c-6221-4737-8886-74e56a1ae033 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:27:48 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-4d05283c-6221-4737-8886-74e56a1ae033 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:27:48 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-4d05283c-6221-4737-8886-74e56a1ae033 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:27:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4d05283c-6221-4737-8886-74e56a1ae033 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:27:48 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-4d05283c-6221-4737-8886-74e56a1ae033 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:27:48 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-4d05283c-6221-4737-8886-74e56a1ae033 tempest-TestServerVolumeAttachmentScenario-1248877400 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:27:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4d05283c-6221-4737-8886-74e56a1ae033 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-426d8cf4-6b43-4581-af8a-15d423a627d7 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:27:48 devstack sudo[99447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-426d8cf4-6b43-4581-af8a-15d423a627d7 1073741824 Sep 03 14:27:48 devstack sudo[99447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:27:48 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e5a99413-a9f5-48e5-a59d-a7195d7582ae tempest-GroupsTest-1964696563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f8f208f-c056-4b6b-8b16-834257799b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe165f8d-0cea-42ef-b4dd-06b7dce8a9d4', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:48 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e5a99413-a9f5-48e5-a59d-a7195d7582ae tempest-GroupsTest-1964696563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46c502c7-9fea-4811-8bc4-9360fd85f504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:48 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-e5a99413-a9f5-48e5-a59d-a7195d7582ae tempest-GroupsTest-1964696563 None] Volume volume-fe165f8d-0cea-42ef-b4dd-06b7dce8a9d4 (fe165f8d-0cea-42ef-b4dd-06b7dce8a9d4): created successfully Sep 03 14:27:48 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e5a99413-a9f5-48e5-a59d-a7195d7582ae tempest-GroupsTest-1964696563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46c502c7-9fea-4811-8bc4-9360fd85f504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:48 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e5a99413-a9f5-48e5-a59d-a7195d7582ae tempest-GroupsTest-1964696563 None] Flow 'volume_create_manager' (cc65cb37-3b35-440a-8ca8-0c4e39c2bd40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:27:48 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-e5a99413-a9f5-48e5-a59d-a7195d7582ae tempest-GroupsTest-1964696563 None] Created volume successfully. Sep 03 14:27:49 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:27:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Flow 'volume_create_manager' (fc3d649f-826b-47cf-a98d-2ad399a1e13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:27:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60bd0cfd-6009-4a0f-a5d4-530aae832fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60bd0cfd-6009-4a0f-a5d4-530aae832fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1032768394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd49a8f1-a6a8-4ccc-8382-ab5a0160cb9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7643fa1404474ef6b9ef42e5196b76a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:27:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=5c964e42-8c22-4067-8ece-7fbfae1197c2,status='creating',terminated_at=None,updated_at=2026-09-03T12:27:49Z,use_quota=True,user_id='4f41f02097ad418286a2872156e3a7c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e70dd74-5e4f-430e-9d1c-f43383dcf16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e70dd74-5e4f-430e-9d1c-f43383dcf16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:49 devstack sudo[99447]: pam_unix(sudo:session): session closed for user root Sep 03 14:27:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8b0b815-4b2f-463d-88c6-457bf1e6bb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4d05283c-6221-4737-8886-74e56a1ae033 tempest-TestServerVolumeAttachmentScenario-1248877400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-426d8cf4-6b43-4581-af8a-15d423a627d7 1073741824" returned: 0 in 0.686s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:27:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8b0b815-4b2f-463d-88c6-457bf1e6bb52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'cd49a8f1-a6a8-4ccc-8382-ab5a0160cb9d', 'volume_name': 'volume-cd49a8f1-a6a8-4ccc-8382-ab5a0160cb9d', 'volume_size': 2, 'source_volid': '5c964e42-8c22-4067-8ece-7fbfae1197c2', 'source_volstatus': 'available'}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2cf5e2f-66b7-4197-bc02-7992d4fa1bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2cf5e2f-66b7-4197-bc02-7992d4fa1bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54af7108-4f92-4872-acb3-54f43bbb0641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:49 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Volume cd49a8f1-a6a8-4ccc-8382-ab5a0160cb9d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-cd49a8f1-a6a8-4ccc-8382-ab5a0160cb9d', 'volume_size': 2, 'source_volid': '5c964e42-8c22-4067-8ece-7fbfae1197c2', 'source_volstatus': 'available'} Sep 03 14:27:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:27:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4d05283c-6221-4737-8886-74e56a1ae033 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-426d8cf4-6b43-4581-af8a-15d423a627d7 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:27:49 devstack sudo[99454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-426d8cf4-6b43-4581-af8a-15d423a627d7 Sep 03 14:27:49 devstack sudo[99454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:27:49 devstack sudo[99454]: pam_unix(sudo:session): session closed for user root Sep 03 14:27:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4d05283c-6221-4737-8886-74e56a1ae033 tempest-TestServerVolumeAttachmentScenario-1248877400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-426d8cf4-6b43-4581-af8a-15d423a627d7" returned: 0 in 0.469s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:27:49 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-4d05283c-6221-4737-8886-74e56a1ae033 tempest-TestServerVolumeAttachmentScenario-1248877400 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:27:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4d05283c-6221-4737-8886-74e56a1ae033 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.233s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:27:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1d755fc6-fe97-4bdc-96a9-7b1b1dbba117 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.846s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:27:49 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-1d755fc6-fe97-4bdc-96a9-7b1b1dbba117 tempest-TestServerVolumeAttachmentScenario-1248877400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1714579857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad30970e-0797-4044-8e29-9a9712a4ce62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb107b45bb174ba7bcc55966fb10f0d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:27:42Z,use_quota=True,user_id='09b6f40cd5f44879a6f51f1f9b81af55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:27:49 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-1d755fc6-fe97-4bdc-96a9-7b1b1dbba117 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Creating volume ad30970e-0797-4044-8e29-9a9712a4ce62 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:27:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1d755fc6-fe97-4bdc-96a9-7b1b1dbba117 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:27:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1d755fc6-fe97-4bdc-96a9-7b1b1dbba117 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:27:49 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-1d755fc6-fe97-4bdc-96a9-7b1b1dbba117 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:27:49 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-1d755fc6-fe97-4bdc-96a9-7b1b1dbba117 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:27:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1d755fc6-fe97-4bdc-96a9-7b1b1dbba117 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:27:49 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-1d755fc6-fe97-4bdc-96a9-7b1b1dbba117 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:27:49 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-1d755fc6-fe97-4bdc-96a9-7b1b1dbba117 tempest-TestServerVolumeAttachmentScenario-1248877400 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:27:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1d755fc6-fe97-4bdc-96a9-7b1b1dbba117 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ad30970e-0797-4044-8e29-9a9712a4ce62 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:27:49 devstack sudo[99493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ad30970e-0797-4044-8e29-9a9712a4ce62 1073741824 Sep 03 14:27:49 devstack sudo[99493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:27:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4d05283c-6221-4737-8886-74e56a1ae033 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b0769d2-15ce-4dd1-a259-123b0d6511b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-426d8cf4-6b43-4581-af8a-15d423a627d7', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4d05283c-6221-4737-8886-74e56a1ae033 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a60cc44-d4a8-47ad-9c7c-345230f5b59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:49 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-4d05283c-6221-4737-8886-74e56a1ae033 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Volume volume-426d8cf4-6b43-4581-af8a-15d423a627d7 (426d8cf4-6b43-4581-af8a-15d423a627d7): created successfully Sep 03 14:27:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4d05283c-6221-4737-8886-74e56a1ae033 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a60cc44-d4a8-47ad-9c7c-345230f5b59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4d05283c-6221-4737-8886-74e56a1ae033 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Flow 'volume_create_manager' (1cfc298b-72c1-4c47-9873-9401d0e773ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:27:49 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c18e91f0-9217-4de9-a7db-946bc0307faf tempest-GroupsTest-1964696563 None] Acquiring lock "cinder-quobyte-fe165f8d-0cea-42ef-b4dd-06b7dce8a9d4" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:27:50 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-4d05283c-6221-4737-8886-74e56a1ae033 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Created volume successfully. Sep 03 14:27:50 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c18e91f0-9217-4de9-a7db-946bc0307faf tempest-GroupsTest-1964696563 None] Lock "cinder-quobyte-fe165f8d-0cea-42ef-b4dd-06b7dce8a9d4" acquired by "delete_volume" :: waited 0.082s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:27:50 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[22179783-044c-4794-8517-1b74df5ba498]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:27:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c18e91f0-9217-4de9-a7db-946bc0307faf tempest-GroupsTest-1964696563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fe165f8d-0cea-42ef-b4dd-06b7dce8a9d4 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:27:50 devstack sudo[99515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fe165f8d-0cea-42ef-b4dd-06b7dce8a9d4 Sep 03 14:27:50 devstack sudo[99515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:27:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1d755fc6-fe97-4bdc-96a9-7b1b1dbba117 tempest-TestServerVolumeAttachmentScenario-1248877400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ad30970e-0797-4044-8e29-9a9712a4ce62 1073741824" returned: 0 in 0.846s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:27:50 devstack sudo[99493]: pam_unix(sudo:session): session closed for user root Sep 03 14:27:50 devstack sudo[99515]: pam_unix(sudo:session): session closed for user root Sep 03 14:27:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c18e91f0-9217-4de9-a7db-946bc0307faf tempest-GroupsTest-1964696563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fe165f8d-0cea-42ef-b4dd-06b7dce8a9d4" returned: 0 in 0.577s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:27:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c18e91f0-9217-4de9-a7db-946bc0307faf tempest-GroupsTest-1964696563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fe165f8d-0cea-42ef-b4dd-06b7dce8a9d4 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:27:50 devstack sudo[99532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fe165f8d-0cea-42ef-b4dd-06b7dce8a9d4 Sep 03 14:27:50 devstack sudo[99532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:27:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1d755fc6-fe97-4bdc-96a9-7b1b1dbba117 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ad30970e-0797-4044-8e29-9a9712a4ce62 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:27:50 devstack sudo[99534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ad30970e-0797-4044-8e29-9a9712a4ce62 Sep 03 14:27:50 devstack sudo[99534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:27:51 devstack sudo[99532]: pam_unix(sudo:session): session closed for user root Sep 03 14:27:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c18e91f0-9217-4de9-a7db-946bc0307faf tempest-GroupsTest-1964696563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fe165f8d-0cea-42ef-b4dd-06b7dce8a9d4" returned: 0 in 0.339s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:27:51 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c18e91f0-9217-4de9-a7db-946bc0307faf tempest-GroupsTest-1964696563 None] Lock "cinder-quobyte-fe165f8d-0cea-42ef-b4dd-06b7dce8a9d4" released by "delete_volume" :: held 1.009s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:27:51 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-c18e91f0-9217-4de9-a7db-946bc0307faf tempest-GroupsTest-1964696563 None] Created reservations ['aa04faff-b468-4658-bafa-13a932306630'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:27:51 devstack cinder-volume[87007]: WARNING cinder.quota [None req-c18e91f0-9217-4de9-a7db-946bc0307faf tempest-GroupsTest-1964696563 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1863314843 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1863314843, it is now deprecated. Please use the default quota class for default quota. Sep 03 14:27:51 devstack cinder-volume[87007]: WARNING cinder.quota [None req-c18e91f0-9217-4de9-a7db-946bc0307faf tempest-GroupsTest-1964696563 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1863314843 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1863314843, it is now deprecated. Please use the default quota class for default quota. Sep 03 14:27:51 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-c18e91f0-9217-4de9-a7db-946bc0307faf tempest-GroupsTest-1964696563 None] Created reservations ['6f1fcc9f-7d79-4e85-a43d-6d69197e9d79', '7c1c06fb-e080-4338-aa02-b7c6ef9a97e2', '779ec3ed-ad7b-4779-84ac-f37df3366829', 'f89d1ef6-c806-4859-9c65-1a7ae5399fa0'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:27:51 devstack sudo[99534]: pam_unix(sudo:session): session closed for user root Sep 03 14:27:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1d755fc6-fe97-4bdc-96a9-7b1b1dbba117 tempest-TestServerVolumeAttachmentScenario-1248877400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ad30970e-0797-4044-8e29-9a9712a4ce62" returned: 0 in 0.521s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:27:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-1d755fc6-fe97-4bdc-96a9-7b1b1dbba117 tempest-TestServerVolumeAttachmentScenario-1248877400 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:27:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1d755fc6-fe97-4bdc-96a9-7b1b1dbba117 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:27:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-e5987760-99df-465a-a6bf-37f72e245cff tempest-VolumesActionsTest-1610054353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.129s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:27:51 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a021c6e-6250-4ab7-b828-6004e3b91120]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:27:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e5987760-99df-465a-a6bf-37f72e245cff tempest-VolumesActionsTest-1610054353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e27ea23-97c4-4101-95f3-2966c899cc60 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:27:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-1d755fc6-fe97-4bdc-96a9-7b1b1dbba117 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fac15f2-131c-4e2c-9014-290cfab34152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad30970e-0797-4044-8e29-9a9712a4ce62', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-1d755fc6-fe97-4bdc-96a9-7b1b1dbba117 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3f9fe78-8d06-4194-8f44-4d03a2f3847a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:51 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-1d755fc6-fe97-4bdc-96a9-7b1b1dbba117 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Volume volume-ad30970e-0797-4044-8e29-9a9712a4ce62 (ad30970e-0797-4044-8e29-9a9712a4ce62): created successfully Sep 03 14:27:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-1d755fc6-fe97-4bdc-96a9-7b1b1dbba117 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3f9fe78-8d06-4194-8f44-4d03a2f3847a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-1d755fc6-fe97-4bdc-96a9-7b1b1dbba117 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Flow 'volume_create_manager' (5c15949e-8ad1-4e69-80d0-82ff788ec57d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:27:51 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-1d755fc6-fe97-4bdc-96a9-7b1b1dbba117 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Created volume successfully. Sep 03 14:27:51 devstack cinder-volume[87007]: DEBUG oslo_service.periodic_task [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87007) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 14:27:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:27:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:27:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:27:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:27:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:27:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:27:51 devstack sudo[99543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e27ea23-97c4-4101-95f3-2966c899cc60 Sep 03 14:27:51 devstack sudo[99543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:27:51 devstack sudo[99544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:27:51 devstack sudo[99544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:27:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c18e91f0-9217-4de9-a7db-946bc0307faf tempest-GroupsTest-1964696563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:27:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c18e91f0-9217-4de9-a7db-946bc0307faf tempest-GroupsTest-1964696563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:27:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-c18e91f0-9217-4de9-a7db-946bc0307faf tempest-GroupsTest-1964696563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:27:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-c18e91f0-9217-4de9-a7db-946bc0307faf tempest-GroupsTest-1964696563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:27:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c18e91f0-9217-4de9-a7db-946bc0307faf tempest-GroupsTest-1964696563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:27:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c18e91f0-9217-4de9-a7db-946bc0307faf tempest-GroupsTest-1964696563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:27:51 devstack sudo[99547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:27:51 devstack sudo[99547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:27:51 devstack sudo[99544]: pam_unix(sudo:session): session closed for user root Sep 03 14:27:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.333s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:27:51 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:27:51 devstack cinder-volume[87007]: DEBUG oslo_service.periodic_task [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running periodic task VolumeManager._thread_info {{(pid=87007) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 14:27:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] thread count: 28 {{(pid=87007) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 14:27:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] thread info: [<_MainThread(MainThread, started 123689171054720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87007) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 14:27:52 devstack sudo[99543]: pam_unix(sudo:session): session closed for user root Sep 03 14:27:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e5987760-99df-465a-a6bf-37f72e245cff tempest-VolumesActionsTest-1610054353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e27ea23-97c4-4101-95f3-2966c899cc60" returned: 0 in 0.609s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:27:52 devstack sudo[99547]: pam_unix(sudo:session): session closed for user root Sep 03 14:27:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c18e91f0-9217-4de9-a7db-946bc0307faf tempest-GroupsTest-1964696563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.335s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:27:52 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-c18e91f0-9217-4de9-a7db-946bc0307faf tempest-GroupsTest-1964696563 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:27:52 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-c18e91f0-9217-4de9-a7db-946bc0307faf tempest-GroupsTest-1964696563 None] Delete group completed successfully. Sep 03 14:27:52 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd77528b-5a80-4918-821d-6e6cb3a863ec]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:27:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e5987760-99df-465a-a6bf-37f72e245cff tempest-VolumesActionsTest-1610054353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e27ea23-97c4-4101-95f3-2966c899cc60 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:27:52 devstack sudo[99554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e27ea23-97c4-4101-95f3-2966c899cc60 Sep 03 14:27:52 devstack sudo[99554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:27:52 devstack sudo[99554]: pam_unix(sudo:session): session closed for user root Sep 03 14:27:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e5987760-99df-465a-a6bf-37f72e245cff tempest-VolumesActionsTest-1610054353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e27ea23-97c4-4101-95f3-2966c899cc60" returned: 0 in 0.397s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:27:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e5987760-99df-465a-a6bf-37f72e245cff tempest-VolumesActionsTest-1610054353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e27ea23-97c4-4101-95f3-2966c899cc60 /opt/stack/data/cinder/conversion/5e27ea23-97c4-4101-95f3-2966c899cc60.temp_image.1572fdf0-9380-4f72-a11e-8555f6f21d9adv9tqqow.img {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:27:52 devstack sudo[99560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e27ea23-97c4-4101-95f3-2966c899cc60 /opt/stack/data/cinder/conversion/5e27ea23-97c4-4101-95f3-2966c899cc60.temp_image.1572fdf0-9380-4f72-a11e-8555f6f21d9adv9tqqow.img Sep 03 14:27:52 devstack sudo[99560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:27:52 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-8afb805d-e2e1-4e8b-9f0a-e1ee5b18aea5 tempest-GroupsTest-1964696563 None] Created reservations ['6b5da1b6-8d2e-4d29-9379-b0563f304b60'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:27:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8afb805d-e2e1-4e8b-9f0a-e1ee5b18aea5 tempest-GroupsTest-1964696563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:27:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8afb805d-e2e1-4e8b-9f0a-e1ee5b18aea5 tempest-GroupsTest-1964696563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:27:52 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-8afb805d-e2e1-4e8b-9f0a-e1ee5b18aea5 tempest-GroupsTest-1964696563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:27:52 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-8afb805d-e2e1-4e8b-9f0a-e1ee5b18aea5 tempest-GroupsTest-1964696563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:27:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8afb805d-e2e1-4e8b-9f0a-e1ee5b18aea5 tempest-GroupsTest-1964696563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:27:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8afb805d-e2e1-4e8b-9f0a-e1ee5b18aea5 tempest-GroupsTest-1964696563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:27:52 devstack sudo[99566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:27:52 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:27:53 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root Sep 03 14:27:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8afb805d-e2e1-4e8b-9f0a-e1ee5b18aea5 tempest-GroupsTest-1964696563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.831s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:27:53 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-8afb805d-e2e1-4e8b-9f0a-e1ee5b18aea5 tempest-GroupsTest-1964696563 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:27:53 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-8afb805d-e2e1-4e8b-9f0a-e1ee5b18aea5 tempest-GroupsTest-1964696563 None] Delete group completed successfully. Sep 03 14:27:56 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-6b76fd9c-267c-42a1-9141-339d9aa16d16 tempest-GroupsTest-1964696563 None] Group tempest-GroupsTest-Group-1668124633: creating Sep 03 14:27:56 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-6b76fd9c-267c-42a1-9141-339d9aa16d16 tempest-GroupsTest-1964696563 None] Group tempest-GroupsTest-Group-1668124633: created successfully Sep 03 14:27:56 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-6b76fd9c-267c-42a1-9141-339d9aa16d16 tempest-GroupsTest-1964696563 None] Create group completed successfully. Sep 03 14:27:59 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-109379dd-b75a-418b-badd-a75d983e49b2 tempest-GroupsTest-1964696563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:27:59 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-109379dd-b75a-418b-badd-a75d983e49b2 tempest-GroupsTest-1964696563 None] Flow 'volume_create_manager' (84ed2326-8d57-4ae3-86a5-9cf718091afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:27:59 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-109379dd-b75a-418b-badd-a75d983e49b2 tempest-GroupsTest-1964696563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d4c11f-2fd5-42dc-af53-f5fda2cd8287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:59 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-109379dd-b75a-418b-badd-a75d983e49b2 tempest-GroupsTest-1964696563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d4c11f-2fd5-42dc-af53-f5fda2cd8287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-749395644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=74589010-1534-43d6-8c25-9ff5eca8dd70,host='devstack@QuobyteHD#QuobyteHD',id=87e2c5e8-c420-4b81-8ee7-1d4ffa1ccb67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e862723866f413489ac61f42f869c17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:27:59Z,use_quota=True,user_id='70c1b9af10e0485fab13ccf4ff4c7038',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e9e6bf5-2d6e-49e8-9106-29e53b39bc76),volume_type_id=6e9e6bf5-2d6e-49e8-9106-29e53b39bc76)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:59 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-109379dd-b75a-418b-badd-a75d983e49b2 tempest-GroupsTest-1964696563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93da9d4d-e508-484c-9b51-ef59308b9d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:59 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-109379dd-b75a-418b-badd-a75d983e49b2 tempest-GroupsTest-1964696563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93da9d4d-e508-484c-9b51-ef59308b9d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:59 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-109379dd-b75a-418b-badd-a75d983e49b2 tempest-GroupsTest-1964696563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59f28807-9afd-4278-b929-5c14cc50590b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:59 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-109379dd-b75a-418b-badd-a75d983e49b2 tempest-GroupsTest-1964696563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59f28807-9afd-4278-b929-5c14cc50590b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87e2c5e8-c420-4b81-8ee7-1d4ffa1ccb67', 'volume_name': 'volume-87e2c5e8-c420-4b81-8ee7-1d4ffa1ccb67', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:59 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-109379dd-b75a-418b-badd-a75d983e49b2 tempest-GroupsTest-1964696563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94e95baa-038d-4f2c-9bfd-b505c988b3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:59 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-109379dd-b75a-418b-badd-a75d983e49b2 tempest-GroupsTest-1964696563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94e95baa-038d-4f2c-9bfd-b505c988b3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:27:59 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-109379dd-b75a-418b-badd-a75d983e49b2 tempest-GroupsTest-1964696563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeecd5cb-ac80-4092-8f18-f1e8c7a84a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:27:59 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-109379dd-b75a-418b-badd-a75d983e49b2 tempest-GroupsTest-1964696563 None] Volume 87e2c5e8-c420-4b81-8ee7-1d4ffa1ccb67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87e2c5e8-c420-4b81-8ee7-1d4ffa1ccb67', 'volume_size': 1} Sep 03 14:27:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-109379dd-b75a-418b-badd-a75d983e49b2 tempest-GroupsTest-1964696563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:27:59 devstack sudo[99560]: pam_unix(sudo:session): session closed for user root Sep 03 14:27:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e5987760-99df-465a-a6bf-37f72e245cff tempest-VolumesActionsTest-1610054353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e27ea23-97c4-4101-95f3-2966c899cc60 /opt/stack/data/cinder/conversion/5e27ea23-97c4-4101-95f3-2966c899cc60.temp_image.1572fdf0-9380-4f72-a11e-8555f6f21d9adv9tqqow.img" returned: 0 in 7.127s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:27:59 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97b71a7-3dbf-4a22-a579-f212642f35b6]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:27:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e5987760-99df-465a-a6bf-37f72e245cff tempest-VolumesActionsTest-1610054353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e27ea23-97c4-4101-95f3-2966c899cc60 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:27:59 devstack sudo[99578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e27ea23-97c4-4101-95f3-2966c899cc60 Sep 03 14:27:59 devstack sudo[99578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:00 devstack sudo[99578]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e5987760-99df-465a-a6bf-37f72e245cff tempest-VolumesActionsTest-1610054353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e27ea23-97c4-4101-95f3-2966c899cc60" returned: 0 in 0.543s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:00 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-e5987760-99df-465a-a6bf-37f72e245cff tempest-VolumesActionsTest-1610054353 None] Image conversion details: src /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e27ea23-97c4-4101-95f3-2966c899cc60, size 1024.00 MB, duration 7.13 sec, destination /opt/stack/data/cinder/conversion/5e27ea23-97c4-4101-95f3-2966c899cc60.temp_image.1572fdf0-9380-4f72-a11e-8555f6f21d9adv9tqqow.img {{(pid=87007) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 14:28:00 devstack cinder-volume[87007]: INFO cinder.image.image_utils [None req-e5987760-99df-465a-a6bf-37f72e245cff tempest-VolumesActionsTest-1610054353 None] Converted 1024.00 MB image at 143.66 MB/s Sep 03 14:28:00 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-e5987760-99df-465a-a6bf-37f72e245cff tempest-VolumesActionsTest-1610054353 None] 1572fdf0-9380-4f72-a11e-8555f6f21d9a was raw, converting to qcow2 {{(pid=87007) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 03 14:28:00 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b54318-99a3-4cf5-9ace-a0185e915d7c]: (4, 'raw') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:28:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e5987760-99df-465a-a6bf-37f72e245cff tempest-VolumesActionsTest-1610054353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5e27ea23-97c4-4101-95f3-2966c899cc60.temp_image.1572fdf0-9380-4f72-a11e-8555f6f21d9adv9tqqow.img {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:00 devstack sudo[99583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5e27ea23-97c4-4101-95f3-2966c899cc60.temp_image.1572fdf0-9380-4f72-a11e-8555f6f21d9adv9tqqow.img Sep 03 14:28:00 devstack sudo[99583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:00 devstack sudo[99583]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e5987760-99df-465a-a6bf-37f72e245cff tempest-VolumesActionsTest-1610054353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5e27ea23-97c4-4101-95f3-2966c899cc60.temp_image.1572fdf0-9380-4f72-a11e-8555f6f21d9adv9tqqow.img" returned: 0 in 0.338s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e5987760-99df-465a-a6bf-37f72e245cff tempest-VolumesActionsTest-1610054353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5e27ea23-97c4-4101-95f3-2966c899cc60.temp_image.1572fdf0-9380-4f72-a11e-8555f6f21d9adv9tqqow.img {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:00 devstack sudo[99587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5e27ea23-97c4-4101-95f3-2966c899cc60.temp_image.1572fdf0-9380-4f72-a11e-8555f6f21d9adv9tqqow.img Sep 03 14:28:00 devstack sudo[99587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:00 devstack sudo[99587]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e5987760-99df-465a-a6bf-37f72e245cff tempest-VolumesActionsTest-1610054353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5e27ea23-97c4-4101-95f3-2966c899cc60.temp_image.1572fdf0-9380-4f72-a11e-8555f6f21d9adv9tqqow.img" returned: 1 in 0.331s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e5987760-99df-465a-a6bf-37f72e245cff tempest-VolumesActionsTest-1610054353 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5e27ea23-97c4-4101-95f3-2966c899cc60.temp_image.1572fdf0-9380-4f72-a11e-8555f6f21d9adv9tqqow.img' failed. Not Retrying. {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 14:28:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e5987760-99df-465a-a6bf-37f72e245cff tempest-VolumesActionsTest-1610054353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5e27ea23-97c4-4101-95f3-2966c899cc60.temp_image.1572fdf0-9380-4f72-a11e-8555f6f21d9adv9tqqow.img /opt/stack/data/cinder/conversion/vol_upload_i219m8y_ {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:00 devstack sudo[99592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5e27ea23-97c4-4101-95f3-2966c899cc60.temp_image.1572fdf0-9380-4f72-a11e-8555f6f21d9adv9tqqow.img /opt/stack/data/cinder/conversion/vol_upload_i219m8y_ Sep 03 14:28:00 devstack sudo[99592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:01 devstack sudo[99592]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e5987760-99df-465a-a6bf-37f72e245cff tempest-VolumesActionsTest-1610054353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5e27ea23-97c4-4101-95f3-2966c899cc60.temp_image.1572fdf0-9380-4f72-a11e-8555f6f21d9adv9tqqow.img /opt/stack/data/cinder/conversion/vol_upload_i219m8y_" returned: 0 in 0.274s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:01 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-e5987760-99df-465a-a6bf-37f72e245cff tempest-VolumesActionsTest-1610054353 None] Image conversion details: src /opt/stack/data/cinder/conversion/5e27ea23-97c4-4101-95f3-2966c899cc60.temp_image.1572fdf0-9380-4f72-a11e-8555f6f21d9adv9tqqow.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_i219m8y_ {{(pid=87007) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 14:28:01 devstack cinder-volume[87007]: INFO cinder.image.image_utils [None req-e5987760-99df-465a-a6bf-37f72e245cff tempest-VolumesActionsTest-1610054353 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 03 14:28:01 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93a83eb-cbcc-4de9-8a4c-7cd7d4344b6d]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:28:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e5987760-99df-465a-a6bf-37f72e245cff tempest-VolumesActionsTest-1610054353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_i219m8y_ {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:01 devstack sudo[99598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_i219m8y_ Sep 03 14:28:01 devstack sudo[99598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:01 devstack sudo[99598]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e5987760-99df-465a-a6bf-37f72e245cff tempest-VolumesActionsTest-1610054353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_i219m8y_" returned: 0 in 0.334s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-e5987760-99df-465a-a6bf-37f72e245cff tempest-VolumesActionsTest-1610054353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.483s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:28:02 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e5987760-99df-465a-a6bf-37f72e245cff tempest-VolumesActionsTest-1610054353 None] Uploaded volume to glance image-id: 1572fdf0-9380-4f72-a11e-8555f6f21d9a. {{(pid=87007) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 03 14:28:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 13.725s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:28:02 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Cloning volume 5c964e42-8c22-4067-8ece-7fbfae1197c2 to volume cd49a8f1-a6a8-4ccc-8382-ab5a0160cb9d Sep 03 14:28:02 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-e5987760-99df-465a-a6bf-37f72e245cff tempest-VolumesActionsTest-1610054353 None] Copy volume to image completed successfully. Sep 03 14:28:02 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Creating offline snapshot 6b1e2750-1b53-42f5-bfa8-bf65d7b18609 of volume 5c964e42-8c22-4067-8ece-7fbfae1197c2 {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:28:02 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fed6471-5847-4e96-9659-d7d77bab9407]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:28:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:03 devstack sudo[99603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2 Sep 03 14:28:03 devstack sudo[99603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:03 devstack sudo[99603]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2" returned: 0 in 0.421s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2.6b1e2750-1b53-42f5-bfa8-bf65d7b18609 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:03 devstack sudo[99616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2.6b1e2750-1b53-42f5-bfa8-bf65d7b18609 1G Sep 03 14:28:03 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:03 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2.6b1e2750-1b53-42f5-bfa8-bf65d7b18609 1G" returned: 0 in 0.467s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c964e42-8c22-4067-8ece-7fbfae1197c2 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2.6b1e2750-1b53-42f5-bfa8-bf65d7b18609 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:03 devstack sudo[99629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c964e42-8c22-4067-8ece-7fbfae1197c2 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2.6b1e2750-1b53-42f5-bfa8-bf65d7b18609 Sep 03 14:28:03 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:03 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-bb324039-5cae-4081-a83f-d1322065468b tempest-VolumesActionsTest-1610054353 None] Acquiring lock "cinder-5e27ea23-97c4-4101-95f3-2966c899cc60-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:28:03 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-bb324039-5cae-4081-a83f-d1322065468b tempest-VolumesActionsTest-1610054353 None] Lock "cinder-5e27ea23-97c4-4101-95f3-2966c899cc60-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:28:04 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-bb324039-5cae-4081-a83f-d1322065468b tempest-VolumesActionsTest-1610054353 None] Acquiring lock "cinder-quobyte-5e27ea23-97c4-4101-95f3-2966c899cc60" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:28:04 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-bb324039-5cae-4081-a83f-d1322065468b tempest-VolumesActionsTest-1610054353 None] Lock "cinder-quobyte-5e27ea23-97c4-4101-95f3-2966c899cc60" acquired by "delete_volume" :: waited 0.026s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:28:04 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb54cc5f-c740-4aa7-9ce5-8a7e92fe3cec]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:28:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bb324039-5cae-4081-a83f-d1322065468b tempest-VolumesActionsTest-1610054353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e27ea23-97c4-4101-95f3-2966c899cc60 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:04 devstack sudo[99632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e27ea23-97c4-4101-95f3-2966c899cc60 Sep 03 14:28:04 devstack sudo[99632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:04 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c964e42-8c22-4067-8ece-7fbfae1197c2 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2.6b1e2750-1b53-42f5-bfa8-bf65d7b18609" returned: 0 in 0.389s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:04 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2.6b1e2750-1b53-42f5-bfa8-bf65d7b18609 is being set with open permissions: ugo+rw Sep 03 14:28:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2.6b1e2750-1b53-42f5-bfa8-bf65d7b18609 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:04 devstack sudo[99637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2.6b1e2750-1b53-42f5-bfa8-bf65d7b18609 Sep 03 14:28:04 devstack sudo[99637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:04 devstack sudo[99632]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bb324039-5cae-4081-a83f-d1322065468b tempest-VolumesActionsTest-1610054353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e27ea23-97c4-4101-95f3-2966c899cc60" returned: 0 in 0.384s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bb324039-5cae-4081-a83f-d1322065468b tempest-VolumesActionsTest-1610054353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e27ea23-97c4-4101-95f3-2966c899cc60 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:04 devstack sudo[99637]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:04 devstack sudo[99643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e27ea23-97c4-4101-95f3-2966c899cc60 Sep 03 14:28:04 devstack sudo[99643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2.6b1e2750-1b53-42f5-bfa8-bf65d7b18609" returned: 0 in 0.263s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:04 devstack sudo[99645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2.info Sep 03 14:28:04 devstack sudo[99645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:04 devstack sudo[99643]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bb324039-5cae-4081-a83f-d1322065468b tempest-VolumesActionsTest-1610054353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e27ea23-97c4-4101-95f3-2966c899cc60" returned: 0 in 0.258s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:04 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-bb324039-5cae-4081-a83f-d1322065468b tempest-VolumesActionsTest-1610054353 None] Lock "cinder-quobyte-5e27ea23-97c4-4101-95f3-2966c899cc60" released by "delete_volume" :: held 0.692s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:28:04 devstack sudo[99645]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2.info" returned: 0 in 0.262s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:04 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2.info is being set with open permissions: ugo+rw Sep 03 14:28:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:04 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-bb324039-5cae-4081-a83f-d1322065468b tempest-VolumesActionsTest-1610054353 None] Created reservations ['a859871f-1433-4d8f-97a0-3c31f0901a44', '220a41f9-d51d-4d1c-ae74-b5a86ddd0688', 'f79b3819-c416-405f-85a8-70492219d5c5', 'ce1f489e-b705-4664-b2ba-fc027e7fdb60'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:28:04 devstack sudo[99649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2.info Sep 03 14:28:04 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-bb324039-5cae-4081-a83f-d1322065468b tempest-VolumesActionsTest-1610054353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:28:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-bb324039-5cae-4081-a83f-d1322065468b tempest-VolumesActionsTest-1610054353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:28:04 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-bb324039-5cae-4081-a83f-d1322065468b tempest-VolumesActionsTest-1610054353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:28:04 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-bb324039-5cae-4081-a83f-d1322065468b tempest-VolumesActionsTest-1610054353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:28:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-bb324039-5cae-4081-a83f-d1322065468b tempest-VolumesActionsTest-1610054353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:28:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bb324039-5cae-4081-a83f-d1322065468b tempest-VolumesActionsTest-1610054353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:04 devstack sudo[99651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:28:04 devstack sudo[99651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:05 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2.info" returned: 0 in 0.245s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:05 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Acquiring lock "cinder-quobyte-cd49a8f1-a6a8-4ccc-8382-ab5a0160cb9d" by "_copy_volume_from_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:28:05 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Lock "cinder-quobyte-cd49a8f1-a6a8-4ccc-8382-ab5a0160cb9d" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:28:05 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] snapshot: 6b1e2750-1b53-42f5-bfa8-bf65d7b18609, volume: cd49a8f1-a6a8-4ccc-8382-ab5a0160cb9d, {{(pid=87007) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 14:28:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:28:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:28:05 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:28:05 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:28:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:28:05 devstack sudo[99651]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bb324039-5cae-4081-a83f-d1322065468b tempest-VolumesActionsTest-1610054353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.264s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:05 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-bb324039-5cae-4081-a83f-d1322065468b tempest-VolumesActionsTest-1610054353 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:28:05 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c20e907-1fad-47a6-8ca7-3090aa01a5c1]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:28:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2.6b1e2750-1b53-42f5-bfa8-bf65d7b18609 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:05 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-bb324039-5cae-4081-a83f-d1322065468b tempest-VolumesActionsTest-1610054353 None] Deleted volume successfully. Sep 03 14:28:05 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-bb324039-5cae-4081-a83f-d1322065468b tempest-VolumesActionsTest-1610054353 None] Lock "cinder-5e27ea23-97c4-4101-95f3-2966c899cc60-delete_volume" released by "delete_volume" :: held 1.246s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:28:05 devstack sudo[99655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2.6b1e2750-1b53-42f5-bfa8-bf65d7b18609 Sep 03 14:28:05 devstack sudo[99655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:05 devstack sudo[99655]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2.6b1e2750-1b53-42f5-bfa8-bf65d7b18609" returned: 0 in 0.396s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:05 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c964e42-8c22-4067-8ece-7fbfae1197c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:28:05 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[29101719-30b1-40d5-a205-27bdf2676e6c]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:28:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:05 devstack sudo[99660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2 Sep 03 14:28:05 devstack sudo[99660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:05 devstack sudo[99660]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2" returned: 0 in 0.437s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:05 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2 {{(pid=87007) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 14:28:05 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Creating direct copy from snapshot {{(pid=87007) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 14:28:05 devstack cinder-volume[87007]: DEBUG cinder.utils [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Path /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-cd49a8f1-a6a8-4ccc-8382-ab5a0160cb9d not found in is_blk_device check {{(pid=87007) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 14:28:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-cd49a8f1-a6a8-4ccc-8382-ab5a0160cb9d {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:06 devstack sudo[99699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-cd49a8f1-a6a8-4ccc-8382-ab5a0160cb9d Sep 03 14:28:06 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:11 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-cd49a8f1-a6a8-4ccc-8382-ab5a0160cb9d" returned: 0 in 5.052s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:11 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Image conversion details: src /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2, size 1024.00 MB, duration 5.05 sec, destination /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-cd49a8f1-a6a8-4ccc-8382-ab5a0160cb9d {{(pid=87007) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 14:28:11 devstack cinder-volume[87007]: INFO cinder.image.image_utils [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Converted 1024.00 MB image at 202.63 MB/s Sep 03 14:28:11 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-cd49a8f1-a6a8-4ccc-8382-ab5a0160cb9d is being set with open permissions: ugo+rw Sep 03 14:28:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-cd49a8f1-a6a8-4ccc-8382-ab5a0160cb9d {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:11 devstack sudo[99719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-cd49a8f1-a6a8-4ccc-8382-ab5a0160cb9d Sep 03 14:28:11 devstack sudo[99719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:11 devstack sudo[99719]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-cd49a8f1-a6a8-4ccc-8382-ab5a0160cb9d" returned: 0 in 0.267s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:11 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Lock "cinder-quobyte-cd49a8f1-a6a8-4ccc-8382-ab5a0160cb9d" released by "_copy_volume_from_snapshot" :: held 6.252s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:28:11 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Acquiring lock "cinder-quobyte-6b1e2750-1b53-42f5-bfa8-bf65d7b18609" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:28:11 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Lock "cinder-quobyte-6b1e2750-1b53-42f5-bfa8-bf65d7b18609" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:28:11 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Deleting offline snapshot 6b1e2750-1b53-42f5-bfa8-bf65d7b18609 of volume 5c964e42-8c22-4067-8ece-7fbfae1197c2 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:28:11 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] snapshot_file for this snap is: volume-5c964e42-8c22-4067-8ece-7fbfae1197c2.6b1e2750-1b53-42f5-bfa8-bf65d7b18609 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:28:11 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d2fcc2-62f3-47b9-9daf-d81eb8087623]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:28:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2.6b1e2750-1b53-42f5-bfa8-bf65d7b18609 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:11 devstack sudo[99722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2.6b1e2750-1b53-42f5-bfa8-bf65d7b18609 Sep 03 14:28:11 devstack sudo[99722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:11 devstack sudo[99722]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2.6b1e2750-1b53-42f5-bfa8-bf65d7b18609" returned: 0 in 0.469s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:11 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c964e42-8c22-4067-8ece-7fbfae1197c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:28:11 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9674ef6-48f6-405c-9074-0e49ae03fa20]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:28:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:12 devstack sudo[99728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2 Sep 03 14:28:12 devstack sudo[99728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:12 devstack sudo[99728]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2" returned: 0 in 0.615s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2.6b1e2750-1b53-42f5-bfa8-bf65d7b18609 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:12 devstack sudo[99734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2.6b1e2750-1b53-42f5-bfa8-bf65d7b18609 Sep 03 14:28:12 devstack sudo[99734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:12 devstack sudo[99734]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2.6b1e2750-1b53-42f5-bfa8-bf65d7b18609" returned: 0 in 0.464s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2.6b1e2750-1b53-42f5-bfa8-bf65d7b18609 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:13 devstack sudo[99740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2.6b1e2750-1b53-42f5-bfa8-bf65d7b18609 Sep 03 14:28:13 devstack sudo[99740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:13 devstack sudo[99740]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2.6b1e2750-1b53-42f5-bfa8-bf65d7b18609" returned: 0 in 0.279s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:13 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Lock "cinder-quobyte-6b1e2750-1b53-42f5-bfa8-bf65d7b18609" released by "_delete_snapshot" :: held 1.939s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:28:13 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:UPDATE=82,cinder:INSERT=21,cinder:SELECT=92,cinder:DELETE=3 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:28:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.466s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:28:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-109379dd-b75a-418b-badd-a75d983e49b2 tempest-GroupsTest-1964696563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.961s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:28:13 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-109379dd-b75a-418b-badd-a75d983e49b2 tempest-GroupsTest-1964696563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=74589010-1534-43d6-8c25-9ff5eca8dd70,created_at=2026-09-03T12:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-749395644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=74589010-1534-43d6-8c25-9ff5eca8dd70,host='devstack@QuobyteHD#QuobyteHD',id=87e2c5e8-c420-4b81-8ee7-1d4ffa1ccb67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e862723866f413489ac61f42f869c17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:27:59Z,use_quota=True,user_id='70c1b9af10e0485fab13ccf4ff4c7038',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e9e6bf5-2d6e-49e8-9106-29e53b39bc76),volume_type_id=6e9e6bf5-2d6e-49e8-9106-29e53b39bc76)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:28:13 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-109379dd-b75a-418b-badd-a75d983e49b2 tempest-GroupsTest-1964696563 None] Creating volume 87e2c5e8-c420-4b81-8ee7-1d4ffa1ccb67 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:28:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-109379dd-b75a-418b-badd-a75d983e49b2 tempest-GroupsTest-1964696563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:28:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-109379dd-b75a-418b-badd-a75d983e49b2 tempest-GroupsTest-1964696563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:28:13 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-109379dd-b75a-418b-badd-a75d983e49b2 tempest-GroupsTest-1964696563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:28:13 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-109379dd-b75a-418b-badd-a75d983e49b2 tempest-GroupsTest-1964696563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:28:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-109379dd-b75a-418b-badd-a75d983e49b2 tempest-GroupsTest-1964696563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:28:13 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-109379dd-b75a-418b-badd-a75d983e49b2 tempest-GroupsTest-1964696563 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:28:13 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-109379dd-b75a-418b-badd-a75d983e49b2 tempest-GroupsTest-1964696563 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:28:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-109379dd-b75a-418b-badd-a75d983e49b2 tempest-GroupsTest-1964696563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-87e2c5e8-c420-4b81-8ee7-1d4ffa1ccb67 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54af7108-4f92-4872-acb3-54f43bbb0641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd49a8f1-a6a8-4ccc-8382-ab5a0160cb9d', 'volume_size': 2, 'source_volid': '5c964e42-8c22-4067-8ece-7fbfae1197c2', 'source_volstatus': 'available'}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:28:13 devstack sudo[99743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-87e2c5e8-c420-4b81-8ee7-1d4ffa1ccb67 1073741824 Sep 03 14:28:13 devstack sudo[99743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (187a3918-1a1a-4a2b-ab05-3a7e5823292e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:28:13 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Volume volume-cd49a8f1-a6a8-4ccc-8382-ab5a0160cb9d (cd49a8f1-a6a8-4ccc-8382-ab5a0160cb9d): created successfully Sep 03 14:28:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (187a3918-1a1a-4a2b-ab05-3a7e5823292e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:28:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Flow 'volume_create_manager' (fc3d649f-826b-47cf-a98d-2ad399a1e13b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:28:13 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-ad2edf64-6925-4328-9a33-6b721c1b8cd6 tempest-VolumesCloneTest-872901948 None] Created volume successfully. Sep 03 14:28:13 devstack sudo[99743]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-109379dd-b75a-418b-badd-a75d983e49b2 tempest-GroupsTest-1964696563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-87e2c5e8-c420-4b81-8ee7-1d4ffa1ccb67 1073741824" returned: 0 in 0.477s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-109379dd-b75a-418b-badd-a75d983e49b2 tempest-GroupsTest-1964696563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-87e2c5e8-c420-4b81-8ee7-1d4ffa1ccb67 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:13 devstack sudo[99749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-87e2c5e8-c420-4b81-8ee7-1d4ffa1ccb67 Sep 03 14:28:13 devstack sudo[99749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:14 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-4fc78a3e-af0c-494b-bf41-acf271c7489f tempest-VolumesCloneTest-872901948 None] Acquiring lock "cinder-cd49a8f1-a6a8-4ccc-8382-ab5a0160cb9d-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:28:14 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-4fc78a3e-af0c-494b-bf41-acf271c7489f tempest-VolumesCloneTest-872901948 None] Lock "cinder-cd49a8f1-a6a8-4ccc-8382-ab5a0160cb9d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:28:14 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-4fc78a3e-af0c-494b-bf41-acf271c7489f tempest-VolumesCloneTest-872901948 None] Acquiring lock "cinder-quobyte-cd49a8f1-a6a8-4ccc-8382-ab5a0160cb9d" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:28:14 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-4fc78a3e-af0c-494b-bf41-acf271c7489f tempest-VolumesCloneTest-872901948 None] Lock "cinder-quobyte-cd49a8f1-a6a8-4ccc-8382-ab5a0160cb9d" acquired by "delete_volume" :: waited 0.014s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:28:14 devstack sudo[99749]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-109379dd-b75a-418b-badd-a75d983e49b2 tempest-GroupsTest-1964696563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-87e2c5e8-c420-4b81-8ee7-1d4ffa1ccb67" returned: 0 in 0.373s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-109379dd-b75a-418b-badd-a75d983e49b2 tempest-GroupsTest-1964696563 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:28:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-109379dd-b75a-418b-badd-a75d983e49b2 tempest-GroupsTest-1964696563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:28:14 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d92f0f8-a47b-455d-b95e-fcf56cadbdad]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:28:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4fc78a3e-af0c-494b-bf41-acf271c7489f tempest-VolumesCloneTest-872901948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-cd49a8f1-a6a8-4ccc-8382-ab5a0160cb9d {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-109379dd-b75a-418b-badd-a75d983e49b2 tempest-GroupsTest-1964696563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeecd5cb-ac80-4092-8f18-f1e8c7a84a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87e2c5e8-c420-4b81-8ee7-1d4ffa1ccb67', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:28:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-109379dd-b75a-418b-badd-a75d983e49b2 tempest-GroupsTest-1964696563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0e2877d-c76c-4f75-92af-b38489902519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:28:14 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-109379dd-b75a-418b-badd-a75d983e49b2 tempest-GroupsTest-1964696563 None] Volume volume-87e2c5e8-c420-4b81-8ee7-1d4ffa1ccb67 (87e2c5e8-c420-4b81-8ee7-1d4ffa1ccb67): created successfully Sep 03 14:28:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-109379dd-b75a-418b-badd-a75d983e49b2 tempest-GroupsTest-1964696563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0e2877d-c76c-4f75-92af-b38489902519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:28:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-109379dd-b75a-418b-badd-a75d983e49b2 tempest-GroupsTest-1964696563 None] Flow 'volume_create_manager' (84ed2326-8d57-4ae3-86a5-9cf718091afb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:28:14 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-109379dd-b75a-418b-badd-a75d983e49b2 tempest-GroupsTest-1964696563 None] Created volume successfully. Sep 03 14:28:14 devstack sudo[99752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-cd49a8f1-a6a8-4ccc-8382-ab5a0160cb9d Sep 03 14:28:14 devstack sudo[99752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:14 devstack sudo[99752]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4fc78a3e-af0c-494b-bf41-acf271c7489f tempest-VolumesCloneTest-872901948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-cd49a8f1-a6a8-4ccc-8382-ab5a0160cb9d" returned: 0 in 0.382s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4fc78a3e-af0c-494b-bf41-acf271c7489f tempest-VolumesCloneTest-872901948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-cd49a8f1-a6a8-4ccc-8382-ab5a0160cb9d {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:14 devstack sudo[99757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-cd49a8f1-a6a8-4ccc-8382-ab5a0160cb9d Sep 03 14:28:14 devstack sudo[99757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:14 devstack sudo[99757]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4fc78a3e-af0c-494b-bf41-acf271c7489f tempest-VolumesCloneTest-872901948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-cd49a8f1-a6a8-4ccc-8382-ab5a0160cb9d" returned: 0 in 0.246s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:14 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-4fc78a3e-af0c-494b-bf41-acf271c7489f tempest-VolumesCloneTest-872901948 None] Lock "cinder-quobyte-cd49a8f1-a6a8-4ccc-8382-ab5a0160cb9d" released by "delete_volume" :: held 0.684s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:28:14 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-4fc78a3e-af0c-494b-bf41-acf271c7489f tempest-VolumesCloneTest-872901948 None] Created reservations ['54989a7e-442c-4628-bfef-9c42e1fdb8df', '70b4c7b2-30cd-4a8f-98a4-911b612be8bf', '161097b5-acb2-4f3a-a8c1-daceb8b9c8bd', '9f8259e1-2abe-4898-987f-4830b6e59c15'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:28:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4fc78a3e-af0c-494b-bf41-acf271c7489f tempest-VolumesCloneTest-872901948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:28:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4fc78a3e-af0c-494b-bf41-acf271c7489f tempest-VolumesCloneTest-872901948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:28:15 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-4fc78a3e-af0c-494b-bf41-acf271c7489f tempest-VolumesCloneTest-872901948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:28:15 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-4fc78a3e-af0c-494b-bf41-acf271c7489f tempest-VolumesCloneTest-872901948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:28:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4fc78a3e-af0c-494b-bf41-acf271c7489f tempest-VolumesCloneTest-872901948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:28:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4fc78a3e-af0c-494b-bf41-acf271c7489f tempest-VolumesCloneTest-872901948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:15 devstack sudo[99760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:28:15 devstack sudo[99760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:15 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-cca7688c-de24-4276-83dc-6da66890a6e9 tempest-VolumesNegativeTest-1350112477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:28:15 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cca7688c-de24-4276-83dc-6da66890a6e9 tempest-VolumesNegativeTest-1350112477 None] Flow 'volume_create_manager' (496b493f-ba87-4ec7-8a58-8b7c6b5270fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:28:15 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cca7688c-de24-4276-83dc-6da66890a6e9 tempest-VolumesNegativeTest-1350112477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9f11223-3cb7-44d0-8d6c-f76dc72d2af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:28:15 devstack sudo[99760]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4fc78a3e-af0c-494b-bf41-acf271c7489f tempest-VolumesCloneTest-872901948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.274s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:15 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-4fc78a3e-af0c-494b-bf41-acf271c7489f tempest-VolumesCloneTest-872901948 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:28:15 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cca7688c-de24-4276-83dc-6da66890a6e9 tempest-VolumesNegativeTest-1350112477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9f11223-3cb7-44d0-8d6c-f76dc72d2af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:28:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1643388124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92f71c60-326c-494a-9652-309b6377e60f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a54683f486444015834d7b5a3c31bd14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:28:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:28:15Z,use_quota=True,user_id='20ee0c8d1c1c4144a6b07b5766eba5bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:28:15 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cca7688c-de24-4276-83dc-6da66890a6e9 tempest-VolumesNegativeTest-1350112477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a75da4a5-54d0-4627-b66b-59332a9995d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:28:15 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cca7688c-de24-4276-83dc-6da66890a6e9 tempest-VolumesNegativeTest-1350112477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a75da4a5-54d0-4627-b66b-59332a9995d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:28:15 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cca7688c-de24-4276-83dc-6da66890a6e9 tempest-VolumesNegativeTest-1350112477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64e8402a-73be-46c1-9ac2-2803958e9a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:28:15 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cca7688c-de24-4276-83dc-6da66890a6e9 tempest-VolumesNegativeTest-1350112477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64e8402a-73be-46c1-9ac2-2803958e9a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92f71c60-326c-494a-9652-309b6377e60f', 'volume_name': 'volume-92f71c60-326c-494a-9652-309b6377e60f', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:28:15 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cca7688c-de24-4276-83dc-6da66890a6e9 tempest-VolumesNegativeTest-1350112477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3175fb0e-1a7a-45c1-bb1c-5442459371ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:28:15 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cca7688c-de24-4276-83dc-6da66890a6e9 tempest-VolumesNegativeTest-1350112477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3175fb0e-1a7a-45c1-bb1c-5442459371ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:28:15 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cca7688c-de24-4276-83dc-6da66890a6e9 tempest-VolumesNegativeTest-1350112477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe6cff6f-a5a0-49cd-ad50-69dabfce175a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:28:15 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-cca7688c-de24-4276-83dc-6da66890a6e9 tempest-VolumesNegativeTest-1350112477 None] Volume 92f71c60-326c-494a-9652-309b6377e60f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92f71c60-326c-494a-9652-309b6377e60f', 'volume_size': 1} Sep 03 14:28:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-cca7688c-de24-4276-83dc-6da66890a6e9 tempest-VolumesNegativeTest-1350112477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:28:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-cca7688c-de24-4276-83dc-6da66890a6e9 tempest-VolumesNegativeTest-1350112477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:28:15 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-cca7688c-de24-4276-83dc-6da66890a6e9 tempest-VolumesNegativeTest-1350112477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:28:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1643388124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92f71c60-326c-494a-9652-309b6377e60f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a54683f486444015834d7b5a3c31bd14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:28:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:28:15Z,use_quota=True,user_id='20ee0c8d1c1c4144a6b07b5766eba5bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:28:15 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-cca7688c-de24-4276-83dc-6da66890a6e9 tempest-VolumesNegativeTest-1350112477 None] Creating volume 92f71c60-326c-494a-9652-309b6377e60f {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:28:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-cca7688c-de24-4276-83dc-6da66890a6e9 tempest-VolumesNegativeTest-1350112477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:28:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-cca7688c-de24-4276-83dc-6da66890a6e9 tempest-VolumesNegativeTest-1350112477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:28:15 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-cca7688c-de24-4276-83dc-6da66890a6e9 tempest-VolumesNegativeTest-1350112477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:28:15 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-cca7688c-de24-4276-83dc-6da66890a6e9 tempest-VolumesNegativeTest-1350112477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:28:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-cca7688c-de24-4276-83dc-6da66890a6e9 tempest-VolumesNegativeTest-1350112477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:28:15 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-cca7688c-de24-4276-83dc-6da66890a6e9 tempest-VolumesNegativeTest-1350112477 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:28:15 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-cca7688c-de24-4276-83dc-6da66890a6e9 tempest-VolumesNegativeTest-1350112477 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:28:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-cca7688c-de24-4276-83dc-6da66890a6e9 tempest-VolumesNegativeTest-1350112477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-92f71c60-326c-494a-9652-309b6377e60f 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:15 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-4fc78a3e-af0c-494b-bf41-acf271c7489f tempest-VolumesCloneTest-872901948 None] Deleted volume successfully. Sep 03 14:28:15 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-4c445b2c-d888-45c3-9200-850266fd77f5 tempest-VolumesCloneTest-872901948 None] Acquiring lock "cinder-5c964e42-8c22-4067-8ece-7fbfae1197c2-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:28:15 devstack sudo[99763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-92f71c60-326c-494a-9652-309b6377e60f 1073741824 Sep 03 14:28:15 devstack sudo[99763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:15 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-4fc78a3e-af0c-494b-bf41-acf271c7489f tempest-VolumesCloneTest-872901948 None] Lock "cinder-cd49a8f1-a6a8-4ccc-8382-ab5a0160cb9d-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:28:15 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-4c445b2c-d888-45c3-9200-850266fd77f5 tempest-VolumesCloneTest-872901948 None] Lock "cinder-5c964e42-8c22-4067-8ece-7fbfae1197c2-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:28:15 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-4c445b2c-d888-45c3-9200-850266fd77f5 tempest-VolumesCloneTest-872901948 None] Acquiring lock "cinder-quobyte-5c964e42-8c22-4067-8ece-7fbfae1197c2" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:28:15 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-4c445b2c-d888-45c3-9200-850266fd77f5 tempest-VolumesCloneTest-872901948 None] Lock "cinder-quobyte-5c964e42-8c22-4067-8ece-7fbfae1197c2" acquired by "delete_volume" :: waited 0.018s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:28:15 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[602074ca-3774-45ee-8d37-7777f639d834]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:28:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4c445b2c-d888-45c3-9200-850266fd77f5 tempest-VolumesCloneTest-872901948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:15 devstack sudo[99765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2 Sep 03 14:28:15 devstack sudo[99765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:15 devstack sudo[99763]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-cca7688c-de24-4276-83dc-6da66890a6e9 tempest-VolumesNegativeTest-1350112477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-92f71c60-326c-494a-9652-309b6377e60f 1073741824" returned: 0 in 0.505s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-cca7688c-de24-4276-83dc-6da66890a6e9 tempest-VolumesNegativeTest-1350112477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-92f71c60-326c-494a-9652-309b6377e60f {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:15 devstack sudo[99776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-92f71c60-326c-494a-9652-309b6377e60f Sep 03 14:28:15 devstack sudo[99776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:16 devstack sudo[99765]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4c445b2c-d888-45c3-9200-850266fd77f5 tempest-VolumesCloneTest-872901948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2" returned: 0 in 0.465s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4c445b2c-d888-45c3-9200-850266fd77f5 tempest-VolumesCloneTest-872901948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:16 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-377e7654-e332-4fc4-80f0-435a416b56f8 tempest-GroupsTest-1964696563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:28:16 devstack sudo[99779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2 Sep 03 14:28:16 devstack sudo[99779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:16 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-377e7654-e332-4fc4-80f0-435a416b56f8 tempest-GroupsTest-1964696563 None] Flow 'volume_create_manager' (422f62b3-2c9c-4b3a-a2b1-eba28f195575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:28:16 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-377e7654-e332-4fc4-80f0-435a416b56f8 tempest-GroupsTest-1964696563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3bd6ed1-e2a1-41d2-b8cf-411256ad8ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:28:16 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-377e7654-e332-4fc4-80f0-435a416b56f8 tempest-GroupsTest-1964696563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3bd6ed1-e2a1-41d2-b8cf-411256ad8ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-229180235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=74589010-1534-43d6-8c25-9ff5eca8dd70,host='devstack@QuobyteHD#QuobyteHD',id=69fe9557-9db9-40b5-80bd-e4dd2f2bfecf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e862723866f413489ac61f42f869c17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:28:16Z,use_quota=True,user_id='70c1b9af10e0485fab13ccf4ff4c7038',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e9e6bf5-2d6e-49e8-9106-29e53b39bc76),volume_type_id=6e9e6bf5-2d6e-49e8-9106-29e53b39bc76)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:28:16 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-377e7654-e332-4fc4-80f0-435a416b56f8 tempest-GroupsTest-1964696563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28ed0a31-bd26-4e4e-bc55-5124f3afa34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:28:16 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-377e7654-e332-4fc4-80f0-435a416b56f8 tempest-GroupsTest-1964696563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28ed0a31-bd26-4e4e-bc55-5124f3afa34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:28:16 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-377e7654-e332-4fc4-80f0-435a416b56f8 tempest-GroupsTest-1964696563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aacf516-1188-47a9-b793-bdf15c1a47ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:28:16 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-377e7654-e332-4fc4-80f0-435a416b56f8 tempest-GroupsTest-1964696563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aacf516-1188-47a9-b793-bdf15c1a47ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69fe9557-9db9-40b5-80bd-e4dd2f2bfecf', 'volume_name': 'volume-69fe9557-9db9-40b5-80bd-e4dd2f2bfecf', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:28:16 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-377e7654-e332-4fc4-80f0-435a416b56f8 tempest-GroupsTest-1964696563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a88a99c8-b9ed-4342-af54-4f4afd836cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:28:16 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-377e7654-e332-4fc4-80f0-435a416b56f8 tempest-GroupsTest-1964696563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a88a99c8-b9ed-4342-af54-4f4afd836cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:28:16 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-377e7654-e332-4fc4-80f0-435a416b56f8 tempest-GroupsTest-1964696563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91a8a5d4-e843-4543-bd95-fb43bcb1aa5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:28:16 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-377e7654-e332-4fc4-80f0-435a416b56f8 tempest-GroupsTest-1964696563 None] Volume 69fe9557-9db9-40b5-80bd-e4dd2f2bfecf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69fe9557-9db9-40b5-80bd-e4dd2f2bfecf', 'volume_size': 1} Sep 03 14:28:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-377e7654-e332-4fc4-80f0-435a416b56f8 tempest-GroupsTest-1964696563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:28:16 devstack sudo[99776]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-cca7688c-de24-4276-83dc-6da66890a6e9 tempest-VolumesNegativeTest-1350112477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-92f71c60-326c-494a-9652-309b6377e60f" returned: 0 in 0.320s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:16 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-cca7688c-de24-4276-83dc-6da66890a6e9 tempest-VolumesNegativeTest-1350112477 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:28:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-cca7688c-de24-4276-83dc-6da66890a6e9 tempest-VolumesNegativeTest-1350112477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:28:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-377e7654-e332-4fc4-80f0-435a416b56f8 tempest-GroupsTest-1964696563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.062s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:28:16 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-377e7654-e332-4fc4-80f0-435a416b56f8 tempest-GroupsTest-1964696563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=74589010-1534-43d6-8c25-9ff5eca8dd70,created_at=2026-09-03T12:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-229180235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=74589010-1534-43d6-8c25-9ff5eca8dd70,host='devstack@QuobyteHD#QuobyteHD',id=69fe9557-9db9-40b5-80bd-e4dd2f2bfecf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e862723866f413489ac61f42f869c17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:28:16Z,use_quota=True,user_id='70c1b9af10e0485fab13ccf4ff4c7038',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e9e6bf5-2d6e-49e8-9106-29e53b39bc76),volume_type_id=6e9e6bf5-2d6e-49e8-9106-29e53b39bc76)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:28:16 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-377e7654-e332-4fc4-80f0-435a416b56f8 tempest-GroupsTest-1964696563 None] Creating volume 69fe9557-9db9-40b5-80bd-e4dd2f2bfecf {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:28:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-377e7654-e332-4fc4-80f0-435a416b56f8 tempest-GroupsTest-1964696563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:28:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-377e7654-e332-4fc4-80f0-435a416b56f8 tempest-GroupsTest-1964696563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:28:16 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-377e7654-e332-4fc4-80f0-435a416b56f8 tempest-GroupsTest-1964696563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:28:16 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-377e7654-e332-4fc4-80f0-435a416b56f8 tempest-GroupsTest-1964696563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:28:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-377e7654-e332-4fc4-80f0-435a416b56f8 tempest-GroupsTest-1964696563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:28:16 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-377e7654-e332-4fc4-80f0-435a416b56f8 tempest-GroupsTest-1964696563 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:28:16 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-377e7654-e332-4fc4-80f0-435a416b56f8 tempest-GroupsTest-1964696563 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:28:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-377e7654-e332-4fc4-80f0-435a416b56f8 tempest-GroupsTest-1964696563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-69fe9557-9db9-40b5-80bd-e4dd2f2bfecf 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:16 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cca7688c-de24-4276-83dc-6da66890a6e9 tempest-VolumesNegativeTest-1350112477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe6cff6f-a5a0-49cd-ad50-69dabfce175a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92f71c60-326c-494a-9652-309b6377e60f', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:28:16 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cca7688c-de24-4276-83dc-6da66890a6e9 tempest-VolumesNegativeTest-1350112477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83b58e0b-5e5b-4743-9cb0-b23353619adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:28:16 devstack sudo[99783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-69fe9557-9db9-40b5-80bd-e4dd2f2bfecf 1073741824 Sep 03 14:28:16 devstack sudo[99783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:16 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-cca7688c-de24-4276-83dc-6da66890a6e9 tempest-VolumesNegativeTest-1350112477 None] Volume volume-92f71c60-326c-494a-9652-309b6377e60f (92f71c60-326c-494a-9652-309b6377e60f): created successfully Sep 03 14:28:16 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cca7688c-de24-4276-83dc-6da66890a6e9 tempest-VolumesNegativeTest-1350112477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83b58e0b-5e5b-4743-9cb0-b23353619adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:28:16 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cca7688c-de24-4276-83dc-6da66890a6e9 tempest-VolumesNegativeTest-1350112477 None] Flow 'volume_create_manager' (496b493f-ba87-4ec7-8a58-8b7c6b5270fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:28:16 devstack sudo[99779]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4c445b2c-d888-45c3-9200-850266fd77f5 tempest-VolumesCloneTest-872901948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c964e42-8c22-4067-8ece-7fbfae1197c2" returned: 0 in 0.310s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:16 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-4c445b2c-d888-45c3-9200-850266fd77f5 tempest-VolumesCloneTest-872901948 None] Lock "cinder-quobyte-5c964e42-8c22-4067-8ece-7fbfae1197c2" released by "delete_volume" :: held 0.849s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:28:16 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-cca7688c-de24-4276-83dc-6da66890a6e9 tempest-VolumesNegativeTest-1350112477 None] Created volume successfully. Sep 03 14:28:16 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-4c445b2c-d888-45c3-9200-850266fd77f5 tempest-VolumesCloneTest-872901948 None] Created reservations ['12c3a863-359d-4066-b070-b4c58b66916a', '705fc536-625d-4d6c-9d63-6f9d357b9957', '61d346c6-b398-4512-abe5-633d9a26b052', '117773a5-d32f-48c1-9bf1-e5a51a4a54f7'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:28:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4c445b2c-d888-45c3-9200-850266fd77f5 tempest-VolumesCloneTest-872901948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:28:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4c445b2c-d888-45c3-9200-850266fd77f5 tempest-VolumesCloneTest-872901948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:28:16 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-4c445b2c-d888-45c3-9200-850266fd77f5 tempest-VolumesCloneTest-872901948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:28:16 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-4c445b2c-d888-45c3-9200-850266fd77f5 tempest-VolumesCloneTest-872901948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:28:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4c445b2c-d888-45c3-9200-850266fd77f5 tempest-VolumesCloneTest-872901948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:28:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4c445b2c-d888-45c3-9200-850266fd77f5 tempest-VolumesCloneTest-872901948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:16 devstack sudo[99787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:28:16 devstack sudo[99787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:16 devstack sudo[99783]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-377e7654-e332-4fc4-80f0-435a416b56f8 tempest-GroupsTest-1964696563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-69fe9557-9db9-40b5-80bd-e4dd2f2bfecf 1073741824" returned: 0 in 0.514s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:16 devstack sudo[99787]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4c445b2c-d888-45c3-9200-850266fd77f5 tempest-VolumesCloneTest-872901948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.313s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:16 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-4c445b2c-d888-45c3-9200-850266fd77f5 tempest-VolumesCloneTest-872901948 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:28:16 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-4c445b2c-d888-45c3-9200-850266fd77f5 tempest-VolumesCloneTest-872901948 None] Deleted volume successfully. Sep 03 14:28:16 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-4c445b2c-d888-45c3-9200-850266fd77f5 tempest-VolumesCloneTest-872901948 None] Lock "cinder-5c964e42-8c22-4067-8ece-7fbfae1197c2-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:28:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-377e7654-e332-4fc4-80f0-435a416b56f8 tempest-GroupsTest-1964696563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-69fe9557-9db9-40b5-80bd-e4dd2f2bfecf {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:16 devstack sudo[99792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-69fe9557-9db9-40b5-80bd-e4dd2f2bfecf Sep 03 14:28:16 devstack sudo[99792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:17 devstack sudo[99792]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-377e7654-e332-4fc4-80f0-435a416b56f8 tempest-GroupsTest-1964696563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-69fe9557-9db9-40b5-80bd-e4dd2f2bfecf" returned: 0 in 0.278s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:17 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-377e7654-e332-4fc4-80f0-435a416b56f8 tempest-GroupsTest-1964696563 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:28:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-377e7654-e332-4fc4-80f0-435a416b56f8 tempest-GroupsTest-1964696563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:28:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-377e7654-e332-4fc4-80f0-435a416b56f8 tempest-GroupsTest-1964696563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91a8a5d4-e843-4543-bd95-fb43bcb1aa5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69fe9557-9db9-40b5-80bd-e4dd2f2bfecf', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:28:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-377e7654-e332-4fc4-80f0-435a416b56f8 tempest-GroupsTest-1964696563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (109553ee-7457-4696-b4d5-3b36ca20bf07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:28:17 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-377e7654-e332-4fc4-80f0-435a416b56f8 tempest-GroupsTest-1964696563 None] Volume volume-69fe9557-9db9-40b5-80bd-e4dd2f2bfecf (69fe9557-9db9-40b5-80bd-e4dd2f2bfecf): created successfully Sep 03 14:28:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-377e7654-e332-4fc4-80f0-435a416b56f8 tempest-GroupsTest-1964696563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (109553ee-7457-4696-b4d5-3b36ca20bf07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:28:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-377e7654-e332-4fc4-80f0-435a416b56f8 tempest-GroupsTest-1964696563 None] Flow 'volume_create_manager' (422f62b3-2c9c-4b3a-a2b1-eba28f195575) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:28:17 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-377e7654-e332-4fc4-80f0-435a416b56f8 tempest-GroupsTest-1964696563 None] Created volume successfully. Sep 03 14:28:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-7237c8c5-8ba9-4b50-9bc8-1a1930e48512 req-d1075039-ee0e-451e-8455-3326f12d735b tempest-TestServerVolumeAttachmentScenario-1248877400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:28:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-7237c8c5-8ba9-4b50-9bc8-1a1930e48512 req-d1075039-ee0e-451e-8455-3326f12d735b tempest-TestServerVolumeAttachmentScenario-1248877400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:28:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-7237c8c5-8ba9-4b50-9bc8-1a1930e48512 req-d1075039-ee0e-451e-8455-3326f12d735b tempest-TestServerVolumeAttachmentScenario-1248877400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:28:18 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-7237c8c5-8ba9-4b50-9bc8-1a1930e48512 req-d1075039-ee0e-451e-8455-3326f12d735b tempest-TestServerVolumeAttachmentScenario-1248877400 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713', 'name': 'volume-426d8cf4-6b43-4581-af8a-15d423a627d7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ea2cfa53-938f-4b79-a74f-f4b33ce7dade', 'enforce_multipath': True} {{(pid=87007) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 14:28:18 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-7237c8c5-8ba9-4b50-9bc8-1a1930e48512 req-d1075039-ee0e-451e-8455-3326f12d735b tempest-TestServerVolumeAttachmentScenario-1248877400 None] attachment_update completed successfully. Sep 03 14:28:18 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-759c12a1-abd0-4392-ad55-a47ff7d4cacd tempest-GroupsTest-1964696563 None] Update group completed successfully. Sep 03 14:28:20 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-4506d4b6-0859-4790-a621-bdd4f7f6b7c5 tempest-VolumesCloneNegativeTest-1429286642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:28:20 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4506d4b6-0859-4790-a621-bdd4f7f6b7c5 tempest-VolumesCloneNegativeTest-1429286642 None] Flow 'volume_create_manager' (dc4c675f-6e70-43f7-afed-1550d2f74c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:28:20 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4506d4b6-0859-4790-a621-bdd4f7f6b7c5 tempest-VolumesCloneNegativeTest-1429286642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9034bcf5-9a7a-4640-b3b2-2b45812b8418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:28:20 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4506d4b6-0859-4790-a621-bdd4f7f6b7c5 tempest-VolumesCloneNegativeTest-1429286642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9034bcf5-9a7a-4640-b3b2-2b45812b8418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1654663611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a03663a-16be-47d1-8de9-2fb36eeebeed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d560a235a344b308389c95433b7bf51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:28:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:28:20Z,use_quota=True,user_id='047675641e3c42d5970a6c47d06cf5d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:28:20 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4506d4b6-0859-4790-a621-bdd4f7f6b7c5 tempest-VolumesCloneNegativeTest-1429286642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db97c504-58dd-4f9f-bf7f-72f7119a26ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:28:20 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4506d4b6-0859-4790-a621-bdd4f7f6b7c5 tempest-VolumesCloneNegativeTest-1429286642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db97c504-58dd-4f9f-bf7f-72f7119a26ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:28:20 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4506d4b6-0859-4790-a621-bdd4f7f6b7c5 tempest-VolumesCloneNegativeTest-1429286642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d2fdc3-f32a-490f-adc0-f4fca0c45f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:28:20 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4506d4b6-0859-4790-a621-bdd4f7f6b7c5 tempest-VolumesCloneNegativeTest-1429286642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d2fdc3-f32a-490f-adc0-f4fca0c45f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a03663a-16be-47d1-8de9-2fb36eeebeed', 'volume_name': 'volume-3a03663a-16be-47d1-8de9-2fb36eeebeed', 'volume_size': 2}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:28:20 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4506d4b6-0859-4790-a621-bdd4f7f6b7c5 tempest-VolumesCloneNegativeTest-1429286642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bd6a702-24d0-4192-83e5-1d5bcd2fc28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:28:20 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4506d4b6-0859-4790-a621-bdd4f7f6b7c5 tempest-VolumesCloneNegativeTest-1429286642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bd6a702-24d0-4192-83e5-1d5bcd2fc28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:28:20 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4506d4b6-0859-4790-a621-bdd4f7f6b7c5 tempest-VolumesCloneNegativeTest-1429286642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8febcec-c6dc-4c9c-8f88-36f21201a5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:28:20 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-4506d4b6-0859-4790-a621-bdd4f7f6b7c5 tempest-VolumesCloneNegativeTest-1429286642 None] Volume 3a03663a-16be-47d1-8de9-2fb36eeebeed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a03663a-16be-47d1-8de9-2fb36eeebeed', 'volume_size': 2} Sep 03 14:28:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4506d4b6-0859-4790-a621-bdd4f7f6b7c5 tempest-VolumesCloneNegativeTest-1429286642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:28:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4506d4b6-0859-4790-a621-bdd4f7f6b7c5 tempest-VolumesCloneNegativeTest-1429286642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:28:20 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-4506d4b6-0859-4790-a621-bdd4f7f6b7c5 tempest-VolumesCloneNegativeTest-1429286642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1654663611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a03663a-16be-47d1-8de9-2fb36eeebeed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d560a235a344b308389c95433b7bf51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:28:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:28:20Z,use_quota=True,user_id='047675641e3c42d5970a6c47d06cf5d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:28:20 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-4506d4b6-0859-4790-a621-bdd4f7f6b7c5 tempest-VolumesCloneNegativeTest-1429286642 None] Creating volume 3a03663a-16be-47d1-8de9-2fb36eeebeed {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:28:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4506d4b6-0859-4790-a621-bdd4f7f6b7c5 tempest-VolumesCloneNegativeTest-1429286642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:28:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4506d4b6-0859-4790-a621-bdd4f7f6b7c5 tempest-VolumesCloneNegativeTest-1429286642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:28:20 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-4506d4b6-0859-4790-a621-bdd4f7f6b7c5 tempest-VolumesCloneNegativeTest-1429286642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:28:20 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-4506d4b6-0859-4790-a621-bdd4f7f6b7c5 tempest-VolumesCloneNegativeTest-1429286642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:28:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4506d4b6-0859-4790-a621-bdd4f7f6b7c5 tempest-VolumesCloneNegativeTest-1429286642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:28:20 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-4506d4b6-0859-4790-a621-bdd4f7f6b7c5 tempest-VolumesCloneNegativeTest-1429286642 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:28:20 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-4506d4b6-0859-4790-a621-bdd4f7f6b7c5 tempest-VolumesCloneNegativeTest-1429286642 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:28:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4506d4b6-0859-4790-a621-bdd4f7f6b7c5 tempest-VolumesCloneNegativeTest-1429286642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a03663a-16be-47d1-8de9-2fb36eeebeed 2147483648 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:20 devstack sudo[100199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a03663a-16be-47d1-8de9-2fb36eeebeed 2147483648 Sep 03 14:28:20 devstack sudo[100199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:20 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-19612e65-4f1a-4751-b161-5e55cacfb6cb tempest-GroupsTest-1964696563 None] Update group completed successfully. Sep 03 14:28:21 devstack sudo[100199]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4506d4b6-0859-4790-a621-bdd4f7f6b7c5 tempest-VolumesCloneNegativeTest-1429286642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a03663a-16be-47d1-8de9-2fb36eeebeed 2147483648" returned: 0 in 0.656s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4506d4b6-0859-4790-a621-bdd4f7f6b7c5 tempest-VolumesCloneNegativeTest-1429286642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a03663a-16be-47d1-8de9-2fb36eeebeed {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:21 devstack sudo[100212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a03663a-16be-47d1-8de9-2fb36eeebeed Sep 03 14:28:21 devstack sudo[100212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:21 devstack sudo[100212]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4506d4b6-0859-4790-a621-bdd4f7f6b7c5 tempest-VolumesCloneNegativeTest-1429286642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a03663a-16be-47d1-8de9-2fb36eeebeed" returned: 0 in 0.312s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:21 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-4506d4b6-0859-4790-a621-bdd4f7f6b7c5 tempest-VolumesCloneNegativeTest-1429286642 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:28:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4506d4b6-0859-4790-a621-bdd4f7f6b7c5 tempest-VolumesCloneNegativeTest-1429286642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:28:21 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4506d4b6-0859-4790-a621-bdd4f7f6b7c5 tempest-VolumesCloneNegativeTest-1429286642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8febcec-c6dc-4c9c-8f88-36f21201a5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a03663a-16be-47d1-8de9-2fb36eeebeed', 'volume_size': 2}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:28:21 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4506d4b6-0859-4790-a621-bdd4f7f6b7c5 tempest-VolumesCloneNegativeTest-1429286642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7eb4c00-3c76-4000-aa15-8911e31b45f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:28:21 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-4506d4b6-0859-4790-a621-bdd4f7f6b7c5 tempest-VolumesCloneNegativeTest-1429286642 None] Volume volume-3a03663a-16be-47d1-8de9-2fb36eeebeed (3a03663a-16be-47d1-8de9-2fb36eeebeed): created successfully Sep 03 14:28:21 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4506d4b6-0859-4790-a621-bdd4f7f6b7c5 tempest-VolumesCloneNegativeTest-1429286642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7eb4c00-3c76-4000-aa15-8911e31b45f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:28:21 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4506d4b6-0859-4790-a621-bdd4f7f6b7c5 tempest-VolumesCloneNegativeTest-1429286642 None] Flow 'volume_create_manager' (dc4c675f-6e70-43f7-afed-1550d2f74c0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:28:21 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-4506d4b6-0859-4790-a621-bdd4f7f6b7c5 tempest-VolumesCloneNegativeTest-1429286642 None] Created volume successfully. Sep 03 14:28:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-80c5cf9c-1736-4fe1-b1f4-741694f60e33 tempest-GroupsTest-1964696563 None] Acquiring lock "cinder-quobyte-69fe9557-9db9-40b5-80bd-e4dd2f2bfecf" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:28:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-80c5cf9c-1736-4fe1-b1f4-741694f60e33 tempest-GroupsTest-1964696563 None] Lock "cinder-quobyte-69fe9557-9db9-40b5-80bd-e4dd2f2bfecf" acquired by "delete_volume" :: waited 0.034s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:28:22 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd24485-a029-4bcf-993a-c3dbf28abfdd]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:28:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-80c5cf9c-1736-4fe1-b1f4-741694f60e33 tempest-GroupsTest-1964696563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-69fe9557-9db9-40b5-80bd-e4dd2f2bfecf {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:22 devstack sudo[100226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-69fe9557-9db9-40b5-80bd-e4dd2f2bfecf Sep 03 14:28:22 devstack sudo[100226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-dd3ad0af-2af6-4b6a-80b1-beec55b0a2f6 tempest-VolumesCloneNegativeTest-1429286642 None] Acquiring lock "cinder-3a03663a-16be-47d1-8de9-2fb36eeebeed-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:28:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-dd3ad0af-2af6-4b6a-80b1-beec55b0a2f6 tempest-VolumesCloneNegativeTest-1429286642 None] Lock "cinder-3a03663a-16be-47d1-8de9-2fb36eeebeed-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:28:23 devstack sudo[100226]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-80c5cf9c-1736-4fe1-b1f4-741694f60e33 tempest-GroupsTest-1964696563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-69fe9557-9db9-40b5-80bd-e4dd2f2bfecf" returned: 0 in 0.537s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-80c5cf9c-1736-4fe1-b1f4-741694f60e33 tempest-GroupsTest-1964696563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-69fe9557-9db9-40b5-80bd-e4dd2f2bfecf {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:23 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-dd3ad0af-2af6-4b6a-80b1-beec55b0a2f6 tempest-VolumesCloneNegativeTest-1429286642 None] Acquiring lock "cinder-quobyte-3a03663a-16be-47d1-8de9-2fb36eeebeed" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:28:23 devstack sudo[100235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-69fe9557-9db9-40b5-80bd-e4dd2f2bfecf Sep 03 14:28:23 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:23 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-dd3ad0af-2af6-4b6a-80b1-beec55b0a2f6 tempest-VolumesCloneNegativeTest-1429286642 None] Lock "cinder-quobyte-3a03663a-16be-47d1-8de9-2fb36eeebeed" acquired by "delete_volume" :: waited 0.022s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:28:23 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1385d78-e9ae-4075-8e8f-18be7a813b6d]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:28:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dd3ad0af-2af6-4b6a-80b1-beec55b0a2f6 tempest-VolumesCloneNegativeTest-1429286642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a03663a-16be-47d1-8de9-2fb36eeebeed {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:23 devstack sudo[100237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a03663a-16be-47d1-8de9-2fb36eeebeed Sep 03 14:28:23 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:23 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-80c5cf9c-1736-4fe1-b1f4-741694f60e33 tempest-GroupsTest-1964696563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-69fe9557-9db9-40b5-80bd-e4dd2f2bfecf" returned: 0 in 0.353s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:23 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-80c5cf9c-1736-4fe1-b1f4-741694f60e33 tempest-GroupsTest-1964696563 None] Lock "cinder-quobyte-69fe9557-9db9-40b5-80bd-e4dd2f2bfecf" released by "delete_volume" :: held 0.966s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:28:23 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-80c5cf9c-1736-4fe1-b1f4-741694f60e33 tempest-GroupsTest-1964696563 None] Acquiring lock "cinder-quobyte-87e2c5e8-c420-4b81-8ee7-1d4ffa1ccb67" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:28:23 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-80c5cf9c-1736-4fe1-b1f4-741694f60e33 tempest-GroupsTest-1964696563 None] Lock "cinder-quobyte-87e2c5e8-c420-4b81-8ee7-1d4ffa1ccb67" acquired by "delete_volume" :: waited 0.033s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:28:23 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc2fc48-412e-46cb-a992-dfe9b01d4b7d]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:28:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-80c5cf9c-1736-4fe1-b1f4-741694f60e33 tempest-GroupsTest-1964696563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-87e2c5e8-c420-4b81-8ee7-1d4ffa1ccb67 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:23 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:23 devstack sudo[100248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-87e2c5e8-c420-4b81-8ee7-1d4ffa1ccb67 Sep 03 14:28:23 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dd3ad0af-2af6-4b6a-80b1-beec55b0a2f6 tempest-VolumesCloneNegativeTest-1429286642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a03663a-16be-47d1-8de9-2fb36eeebeed" returned: 0 in 0.567s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dd3ad0af-2af6-4b6a-80b1-beec55b0a2f6 tempest-VolumesCloneNegativeTest-1429286642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a03663a-16be-47d1-8de9-2fb36eeebeed {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-9159a931-c5a8-4374-8493-04198db4db54 req-6cbf51bd-84a6-48a2-a780-5d5c97cf8326 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:28:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-9159a931-c5a8-4374-8493-04198db4db54 req-6cbf51bd-84a6-48a2-a780-5d5c97cf8326 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:28:23 devstack sudo[100253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a03663a-16be-47d1-8de9-2fb36eeebeed Sep 03 14:28:23 devstack sudo[100253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-9159a931-c5a8-4374-8493-04198db4db54 req-6cbf51bd-84a6-48a2-a780-5d5c97cf8326 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:28:23 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-9159a931-c5a8-4374-8493-04198db4db54 req-6cbf51bd-84a6-48a2-a780-5d5c97cf8326 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713', 'name': 'volume-ad30970e-0797-4044-8e29-9a9712a4ce62', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'faacec95-84fc-49de-9f38-1dcb00531aa6', 'enforce_multipath': True} {{(pid=87007) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 14:28:23 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-9159a931-c5a8-4374-8493-04198db4db54 req-6cbf51bd-84a6-48a2-a780-5d5c97cf8326 tempest-TestServerVolumeAttachmentScenario-1248877400 None] attachment_update completed successfully. Sep 03 14:28:24 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-80c5cf9c-1736-4fe1-b1f4-741694f60e33 tempest-GroupsTest-1964696563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-87e2c5e8-c420-4b81-8ee7-1d4ffa1ccb67" returned: 0 in 0.599s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-80c5cf9c-1736-4fe1-b1f4-741694f60e33 tempest-GroupsTest-1964696563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-87e2c5e8-c420-4b81-8ee7-1d4ffa1ccb67 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:24 devstack sudo[100261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-87e2c5e8-c420-4b81-8ee7-1d4ffa1ccb67 Sep 03 14:28:24 devstack sudo[100261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:24 devstack sudo[100253]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dd3ad0af-2af6-4b6a-80b1-beec55b0a2f6 tempest-VolumesCloneNegativeTest-1429286642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a03663a-16be-47d1-8de9-2fb36eeebeed" returned: 0 in 0.484s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:24 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-dd3ad0af-2af6-4b6a-80b1-beec55b0a2f6 tempest-VolumesCloneNegativeTest-1429286642 None] Lock "cinder-quobyte-3a03663a-16be-47d1-8de9-2fb36eeebeed" released by "delete_volume" :: held 1.123s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:28:24 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-dd3ad0af-2af6-4b6a-80b1-beec55b0a2f6 tempest-VolumesCloneNegativeTest-1429286642 None] Created reservations ['94abf653-54eb-49b4-a3f0-1c7dd020170d', 'a254910c-d86b-486e-a3b6-6effd2dc1413', '518c3037-cfdd-4609-b38e-2803e6211623', '95c8b2c4-3ae7-499a-b07b-96e48b5c49db'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:28:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-dd3ad0af-2af6-4b6a-80b1-beec55b0a2f6 tempest-VolumesCloneNegativeTest-1429286642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:28:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-dd3ad0af-2af6-4b6a-80b1-beec55b0a2f6 tempest-VolumesCloneNegativeTest-1429286642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:28:24 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-dd3ad0af-2af6-4b6a-80b1-beec55b0a2f6 tempest-VolumesCloneNegativeTest-1429286642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:28:24 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-dd3ad0af-2af6-4b6a-80b1-beec55b0a2f6 tempest-VolumesCloneNegativeTest-1429286642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:28:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-dd3ad0af-2af6-4b6a-80b1-beec55b0a2f6 tempest-VolumesCloneNegativeTest-1429286642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:28:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dd3ad0af-2af6-4b6a-80b1-beec55b0a2f6 tempest-VolumesCloneNegativeTest-1429286642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:24 devstack sudo[100270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:28:24 devstack sudo[100270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:24 devstack sudo[100261]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-80c5cf9c-1736-4fe1-b1f4-741694f60e33 tempest-GroupsTest-1964696563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-87e2c5e8-c420-4b81-8ee7-1d4ffa1ccb67" returned: 0 in 0.439s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:24 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-80c5cf9c-1736-4fe1-b1f4-741694f60e33 tempest-GroupsTest-1964696563 None] Lock "cinder-quobyte-87e2c5e8-c420-4b81-8ee7-1d4ffa1ccb67" released by "delete_volume" :: held 1.127s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:28:24 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-80c5cf9c-1736-4fe1-b1f4-741694f60e33 tempest-GroupsTest-1964696563 None] Created reservations ['b431b676-cef5-4b25-90bf-f7267b786311'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:28:24 devstack sudo[100270]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:24 devstack cinder-volume[87007]: WARNING cinder.quota [None req-80c5cf9c-1736-4fe1-b1f4-741694f60e33 tempest-GroupsTest-1964696563 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-347802152 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-347802152, it is now deprecated. Please use the default quota class for default quota. Sep 03 14:28:24 devstack cinder-volume[87007]: WARNING cinder.quota [None req-80c5cf9c-1736-4fe1-b1f4-741694f60e33 tempest-GroupsTest-1964696563 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-347802152 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-347802152, it is now deprecated. Please use the default quota class for default quota. Sep 03 14:28:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dd3ad0af-2af6-4b6a-80b1-beec55b0a2f6 tempest-VolumesCloneNegativeTest-1429286642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.319s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:24 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-dd3ad0af-2af6-4b6a-80b1-beec55b0a2f6 tempest-VolumesCloneNegativeTest-1429286642 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:28:24 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-dd3ad0af-2af6-4b6a-80b1-beec55b0a2f6 tempest-VolumesCloneNegativeTest-1429286642 None] Deleted volume successfully. Sep 03 14:28:24 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-80c5cf9c-1736-4fe1-b1f4-741694f60e33 tempest-GroupsTest-1964696563 None] Created reservations ['073e1a0c-9ec2-4776-b5eb-214bc901db25', '2d9175fa-5cff-4a20-9747-44ca0779ef7d', 'f9ec9c2c-b654-4307-a71b-d4cbc1a1916a', 'e9a5c1dd-c6d1-448e-9aaa-00c5f06d7c6c'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:28:24 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-dd3ad0af-2af6-4b6a-80b1-beec55b0a2f6 tempest-VolumesCloneNegativeTest-1429286642 None] Lock "cinder-3a03663a-16be-47d1-8de9-2fb36eeebeed-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:28:24 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-80c5cf9c-1736-4fe1-b1f4-741694f60e33 tempest-GroupsTest-1964696563 None] Created reservations ['2a59b86a-1b7c-4b91-b1b6-47a2e2ebd1b3', 'b02c5a30-d0a7-4894-9c1e-b902a018500f', 'b0021115-132e-4e30-83b5-89067a140e9a', 'c3c3a397-01fa-45cb-92ae-3016b28a0780'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:28:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-80c5cf9c-1736-4fe1-b1f4-741694f60e33 tempest-GroupsTest-1964696563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:28:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-80c5cf9c-1736-4fe1-b1f4-741694f60e33 tempest-GroupsTest-1964696563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:28:25 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-80c5cf9c-1736-4fe1-b1f4-741694f60e33 tempest-GroupsTest-1964696563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:28:25 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-80c5cf9c-1736-4fe1-b1f4-741694f60e33 tempest-GroupsTest-1964696563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:28:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-80c5cf9c-1736-4fe1-b1f4-741694f60e33 tempest-GroupsTest-1964696563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:28:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-80c5cf9c-1736-4fe1-b1f4-741694f60e33 tempest-GroupsTest-1964696563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:25 devstack sudo[100289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:28:25 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:25 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-80c5cf9c-1736-4fe1-b1f4-741694f60e33 tempest-GroupsTest-1964696563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.579s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:25 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-80c5cf9c-1736-4fe1-b1f4-741694f60e33 tempest-GroupsTest-1964696563 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:28:25 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-80c5cf9c-1736-4fe1-b1f4-741694f60e33 tempest-GroupsTest-1964696563 None] Delete group completed successfully. Sep 03 14:28:27 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-6b91176d-160d-4ec3-9590-7104828e2d55 req-89c02705-a29f-4027-8bcd-667c4ab90fc7 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Terminate volume connection completed successfully. Sep 03 14:28:27 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-6b91176d-160d-4ec3-9590-7104828e2d55 req-89c02705-a29f-4027-8bcd-667c4ab90fc7 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Deleting attachment faacec95-84fc-49de-9f38-1dcb00531aa6. {{(pid=87007) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 14:28:29 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-47ea1ad2-88eb-4862-aa7f-2cf0c88db293 req-eda5f2db-1fe7-43b1-8ebd-8aec4c2c1862 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Terminate volume connection completed successfully. Sep 03 14:28:29 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-47ea1ad2-88eb-4862-aa7f-2cf0c88db293 req-eda5f2db-1fe7-43b1-8ebd-8aec4c2c1862 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Deleting attachment ea2cfa53-938f-4b79-a74f-f4b33ce7dade. {{(pid=87007) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 14:28:31 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:28:31 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Flow 'volume_create_manager' (417d5825-9dc9-49b9-bc49-37ada5f57a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:28:31 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83a3718a-f936-498a-8cf4-f9e7dbe32f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:28:31 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83a3718a-f936-498a-8cf4-f9e7dbe32f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-39737781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bec3e137-1dcd-45aa-a7e1-44f2bf71a052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fcc672081414137bf853fd68dc31032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:28:32Z,use_quota=True,user_id='ff9a27661839456a959319dceb9254c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:28:31 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c68e174-b57e-4cda-86ae-24d4a07e5831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:28:31 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c68e174-b57e-4cda-86ae-24d4a07e5831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:28:31 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bd2e70c-983f-4cb3-be5f-4871d118b9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:28:31 devstack cinder-volume[87007]: DEBUG cinder.image.glance [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Creating Keystone auth plugin from conf {{(pid=87007) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 14:28:32 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bd2e70c-983f-4cb3-be5f-4871d118b9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bec3e137-1dcd-45aa-a7e1-44f2bf71a052', 'volume_name': 'volume-bec3e137-1dcd-45aa-a7e1-44f2bf71a052', 'volume_size': 1, 'image_id': '49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd4e87261137045028f09a9da96d0acd8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'created_at': datetime.datetime(2026, 9, 3, 12, 12, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 12, 12, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/49981579-d0a4-4b4a-9bc6-bd809c76cea9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:28:32 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (211791fd-1efa-43b1-b252-df3639fb7c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:28:32 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (211791fd-1efa-43b1-b252-df3639fb7c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:28:32 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55764319-b5e2-4f9e-bcb0-f884795ddd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:28:32 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Volume bec3e137-1dcd-45aa-a7e1-44f2bf71a052: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bec3e137-1dcd-45aa-a7e1-44f2bf71a052', 'volume_size': 1, 'image_id': '49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd4e87261137045028f09a9da96d0acd8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'created_at': datetime.datetime(2026, 9, 3, 12, 12, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 12, 12, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/49981579-d0a4-4b4a-9bc6-bd809c76cea9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 03 14:28:32 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Trying to clone bec3e137-1dcd-45aa-a7e1-44f2bf71a052 from image 49981579-d0a4-4b4a-9bc6-bd809c76cea9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'metadata': {}}]). {{(pid=87007) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 14:28:33 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_5fzky6skdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87007) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 14:28:33 devstack cinder-volume[87007]: INFO cinder.image.image_utils [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Image download 20.69 MB at 20.69 MB/s Sep 03 14:28:33 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6954a7ac-1aa2-4d39-8e11-8e2d498e577c]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:28:33 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_5fzky6skdevstack@QuobyteHD {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:33 devstack sudo[100425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_5fzky6skdevstack@QuobyteHD Sep 03 14:28:33 devstack sudo[100425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:33 devstack sudo[100425]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_5fzky6skdevstack@QuobyteHD" returned: 0 in 0.469s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:34 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Temporary image 49981579-d0a4-4b4a-9bc6-bd809c76cea9 is fetched for user ff9a27661839456a959319dceb9254c8. {{(pid=87007) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 14:28:34 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3f3222-4426-453a-8f60-ebf9bbd6dc92]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:28:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_5fzky6skdevstack@QuobyteHD {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:34 devstack sudo[100430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_5fzky6skdevstack@QuobyteHD Sep 03 14:28:34 devstack sudo[100430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:34 devstack sudo[100430]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_5fzky6skdevstack@QuobyteHD" returned: 0 in 0.438s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:28:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:28:34 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-39737781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bec3e137-1dcd-45aa-a7e1-44f2bf71a052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fcc672081414137bf853fd68dc31032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:28:32Z,use_quota=True,user_id='ff9a27661839456a959319dceb9254c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:28:34 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Creating volume bec3e137-1dcd-45aa-a7e1-44f2bf71a052 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:28:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:28:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:28:34 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:28:34 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:28:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:28:34 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:28:34 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:28:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bec3e137-1dcd-45aa-a7e1-44f2bf71a052 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:34 devstack sudo[100436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bec3e137-1dcd-45aa-a7e1-44f2bf71a052 1073741824 Sep 03 14:28:34 devstack sudo[100436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:35 devstack sudo[100436]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bec3e137-1dcd-45aa-a7e1-44f2bf71a052 1073741824" returned: 0 in 0.648s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bec3e137-1dcd-45aa-a7e1-44f2bf71a052 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:35 devstack sudo[100442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bec3e137-1dcd-45aa-a7e1-44f2bf71a052 Sep 03 14:28:35 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:35 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a545dd3f-dff5-44ca-b04e-2e4d2c35e27b tempest-TestServerVolumeAttachmentScenario-1248877400 None] Acquiring lock "cinder-ad30970e-0797-4044-8e29-9a9712a4ce62-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:28:35 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a545dd3f-dff5-44ca-b04e-2e4d2c35e27b tempest-TestServerVolumeAttachmentScenario-1248877400 None] Lock "cinder-ad30970e-0797-4044-8e29-9a9712a4ce62-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:28:35 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a545dd3f-dff5-44ca-b04e-2e4d2c35e27b tempest-TestServerVolumeAttachmentScenario-1248877400 None] Acquiring lock "cinder-quobyte-ad30970e-0797-4044-8e29-9a9712a4ce62" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:28:35 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a545dd3f-dff5-44ca-b04e-2e4d2c35e27b tempest-TestServerVolumeAttachmentScenario-1248877400 None] Lock "cinder-quobyte-ad30970e-0797-4044-8e29-9a9712a4ce62" acquired by "delete_volume" :: waited 0.018s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:28:35 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fea6a3-af75-480f-9237-05a14dcaaacd]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:28:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a545dd3f-dff5-44ca-b04e-2e4d2c35e27b tempest-TestServerVolumeAttachmentScenario-1248877400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ad30970e-0797-4044-8e29-9a9712a4ce62 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:35 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bec3e137-1dcd-45aa-a7e1-44f2bf71a052" returned: 0 in 0.360s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:35 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:28:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:28:35 devstack sudo[100444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ad30970e-0797-4044-8e29-9a9712a4ce62 Sep 03 14:28:35 devstack sudo[100444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:35 devstack cinder-volume[87007]: DEBUG cinder.volume.volume_utils [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Attempting download of 49981579-d0a4-4b4a-9bc6-bd809c76cea9 ((None, [{'url': 'file:///opt/stack/data/glance/images/49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'metadata': {}}])) to volume bec3e137-1dcd-45aa-a7e1-44f2bf71a052. {{(pid=87007) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 14:28:35 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9623fe5-31ed-43c4-a028-432d770b00df]: (4, 'raw') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:28:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_49981579-d0a4-4b4a-9bc6-bd809c76cea9_lzu9i78a {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:35 devstack sudo[100447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_49981579-d0a4-4b4a-9bc6-bd809c76cea9_lzu9i78a Sep 03 14:28:35 devstack sudo[100447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:35 devstack sudo[100444]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a545dd3f-dff5-44ca-b04e-2e4d2c35e27b tempest-TestServerVolumeAttachmentScenario-1248877400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ad30970e-0797-4044-8e29-9a9712a4ce62" returned: 0 in 0.486s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a545dd3f-dff5-44ca-b04e-2e4d2c35e27b tempest-TestServerVolumeAttachmentScenario-1248877400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ad30970e-0797-4044-8e29-9a9712a4ce62 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:36 devstack sudo[100452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ad30970e-0797-4044-8e29-9a9712a4ce62 Sep 03 14:28:36 devstack sudo[100452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:36 devstack sudo[100447]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_49981579-d0a4-4b4a-9bc6-bd809c76cea9_lzu9i78a" returned: 0 in 0.452s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49981579-d0a4-4b4a-9bc6-bd809c76cea9_lzu9i78a {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:36 devstack sudo[100458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49981579-d0a4-4b4a-9bc6-bd809c76cea9_lzu9i78a Sep 03 14:28:36 devstack sudo[100458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:36 devstack sudo[100452]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a545dd3f-dff5-44ca-b04e-2e4d2c35e27b tempest-TestServerVolumeAttachmentScenario-1248877400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ad30970e-0797-4044-8e29-9a9712a4ce62" returned: 0 in 0.334s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:36 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a545dd3f-dff5-44ca-b04e-2e4d2c35e27b tempest-TestServerVolumeAttachmentScenario-1248877400 None] Lock "cinder-quobyte-ad30970e-0797-4044-8e29-9a9712a4ce62" released by "delete_volume" :: held 0.888s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:28:36 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-a545dd3f-dff5-44ca-b04e-2e4d2c35e27b tempest-TestServerVolumeAttachmentScenario-1248877400 None] Created reservations ['168692ac-55e7-4dee-9bb8-e847dba1bbd9', '3ac542ce-1500-4086-9ee1-b0b627d953f2', '2200593b-6c80-48fa-8093-e86e2055bc64', '31f061d6-6291-41f4-8b1a-cedc40156b39'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:28:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a545dd3f-dff5-44ca-b04e-2e4d2c35e27b tempest-TestServerVolumeAttachmentScenario-1248877400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:28:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a545dd3f-dff5-44ca-b04e-2e4d2c35e27b tempest-TestServerVolumeAttachmentScenario-1248877400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:28:36 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a545dd3f-dff5-44ca-b04e-2e4d2c35e27b tempest-TestServerVolumeAttachmentScenario-1248877400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:28:36 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a545dd3f-dff5-44ca-b04e-2e4d2c35e27b tempest-TestServerVolumeAttachmentScenario-1248877400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:28:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a545dd3f-dff5-44ca-b04e-2e4d2c35e27b tempest-TestServerVolumeAttachmentScenario-1248877400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:28:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a545dd3f-dff5-44ca-b04e-2e4d2c35e27b tempest-TestServerVolumeAttachmentScenario-1248877400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:36 devstack sudo[100463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:28:36 devstack sudo[100463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:36 devstack sudo[100458]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49981579-d0a4-4b4a-9bc6-bd809c76cea9_lzu9i78a" returned: 1 in 0.429s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49981579-d0a4-4b4a-9bc6-bd809c76cea9_lzu9i78a' failed. Not Retrying. {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 14:28:36 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[428a9911-4d9b-4e5f-b123-b667cfa46d9c]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:28:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_5fzky6skdevstack@QuobyteHD {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:36 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-3b8d2024-6df1-4f27-93c2-7172cd6b95f0 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Acquiring lock "cinder-426d8cf4-6b43-4581-af8a-15d423a627d7-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:28:36 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-3b8d2024-6df1-4f27-93c2-7172cd6b95f0 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Lock "cinder-426d8cf4-6b43-4581-af8a-15d423a627d7-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:28:36 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-3b8d2024-6df1-4f27-93c2-7172cd6b95f0 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Acquiring lock "cinder-quobyte-426d8cf4-6b43-4581-af8a-15d423a627d7" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:28:36 devstack sudo[100465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_5fzky6skdevstack@QuobyteHD Sep 03 14:28:36 devstack sudo[100465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:36 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-3b8d2024-6df1-4f27-93c2-7172cd6b95f0 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Lock "cinder-quobyte-426d8cf4-6b43-4581-af8a-15d423a627d7" acquired by "delete_volume" :: waited 0.025s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:28:36 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53042af-b96e-410b-80f8-08a96b6cbea3]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:28:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3b8d2024-6df1-4f27-93c2-7172cd6b95f0 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-426d8cf4-6b43-4581-af8a-15d423a627d7 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:36 devstack sudo[100463]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:36 devstack sudo[100468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-426d8cf4-6b43-4581-af8a-15d423a627d7 Sep 03 14:28:36 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a545dd3f-dff5-44ca-b04e-2e4d2c35e27b tempest-TestServerVolumeAttachmentScenario-1248877400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.444s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:37 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-a545dd3f-dff5-44ca-b04e-2e4d2c35e27b tempest-TestServerVolumeAttachmentScenario-1248877400 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:28:37 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-a545dd3f-dff5-44ca-b04e-2e4d2c35e27b tempest-TestServerVolumeAttachmentScenario-1248877400 None] Deleted volume successfully. Sep 03 14:28:37 devstack sudo[100465]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_5fzky6skdevstack@QuobyteHD" returned: 0 in 0.436s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:37 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] 49981579-d0a4-4b4a-9bc6-bd809c76cea9 was qcow2, converting to qcow2 {{(pid=87007) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 14:28:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_5fzky6skdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bec3e137-1dcd-45aa-a7e1-44f2bf71a052 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:37 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a545dd3f-dff5-44ca-b04e-2e4d2c35e27b tempest-TestServerVolumeAttachmentScenario-1248877400 None] Lock "cinder-ad30970e-0797-4044-8e29-9a9712a4ce62-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:28:37 devstack sudo[100475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_5fzky6skdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bec3e137-1dcd-45aa-a7e1-44f2bf71a052 Sep 03 14:28:37 devstack sudo[100475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:37 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3b8d2024-6df1-4f27-93c2-7172cd6b95f0 tempest-TestServerVolumeAttachmentScenario-1248877400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-426d8cf4-6b43-4581-af8a-15d423a627d7" returned: 0 in 0.472s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3b8d2024-6df1-4f27-93c2-7172cd6b95f0 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-426d8cf4-6b43-4581-af8a-15d423a627d7 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:37 devstack sudo[100480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-426d8cf4-6b43-4581-af8a-15d423a627d7 Sep 03 14:28:37 devstack sudo[100480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:37 devstack sudo[100480]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3b8d2024-6df1-4f27-93c2-7172cd6b95f0 tempest-TestServerVolumeAttachmentScenario-1248877400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-426d8cf4-6b43-4581-af8a-15d423a627d7" returned: 0 in 0.312s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:37 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-3b8d2024-6df1-4f27-93c2-7172cd6b95f0 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Lock "cinder-quobyte-426d8cf4-6b43-4581-af8a-15d423a627d7" released by "delete_volume" :: held 0.853s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:28:37 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-3b8d2024-6df1-4f27-93c2-7172cd6b95f0 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Created reservations ['0a920144-7700-4824-9cdd-0927a5bb4e2a', 'ba98a115-ecbb-4b98-bc2f-62bf24c9a1ab', '72800f22-0b21-4ce9-ac94-4e30b8832d9b', '12502e63-6d75-4333-842f-219beefac4e1'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:28:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-3b8d2024-6df1-4f27-93c2-7172cd6b95f0 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:28:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-3b8d2024-6df1-4f27-93c2-7172cd6b95f0 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:28:37 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-3b8d2024-6df1-4f27-93c2-7172cd6b95f0 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:28:37 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-3b8d2024-6df1-4f27-93c2-7172cd6b95f0 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:28:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-3b8d2024-6df1-4f27-93c2-7172cd6b95f0 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:28:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3b8d2024-6df1-4f27-93c2-7172cd6b95f0 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:37 devstack sudo[100489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:28:37 devstack sudo[100489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:38 devstack sudo[100489]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3b8d2024-6df1-4f27-93c2-7172cd6b95f0 tempest-TestServerVolumeAttachmentScenario-1248877400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.384s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:38 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-3b8d2024-6df1-4f27-93c2-7172cd6b95f0 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:28:38 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-3b8d2024-6df1-4f27-93c2-7172cd6b95f0 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Deleted volume successfully. Sep 03 14:28:38 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-3b8d2024-6df1-4f27-93c2-7172cd6b95f0 tempest-TestServerVolumeAttachmentScenario-1248877400 None] Lock "cinder-426d8cf4-6b43-4581-af8a-15d423a627d7-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:28:39 devstack sudo[100475]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_5fzky6skdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bec3e137-1dcd-45aa-a7e1-44f2bf71a052" returned: 0 in 2.411s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:39 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_5fzky6skdevstack@QuobyteHD, size 112.00 MB, duration 2.41 sec, destination /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bec3e137-1dcd-45aa-a7e1-44f2bf71a052 {{(pid=87007) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 14:28:39 devstack cinder-volume[87007]: INFO cinder.image.image_utils [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Converted 112.00 MB image at 46.44 MB/s Sep 03 14:28:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bec3e137-1dcd-45aa-a7e1-44f2bf71a052 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:39 devstack sudo[100492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bec3e137-1dcd-45aa-a7e1-44f2bf71a052 1G Sep 03 14:28:39 devstack sudo[100492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:39 devstack sudo[100492]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bec3e137-1dcd-45aa-a7e1-44f2bf71a052 1G" returned: 0 in 0.455s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:39 devstack cinder-volume[87007]: DEBUG cinder.volume.volume_utils [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Downloaded image 49981579-d0a4-4b4a-9bc6-bd809c76cea9 ((None, [{'url': 'file:///opt/stack/data/glance/images/49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'metadata': {}}])) to volume bec3e137-1dcd-45aa-a7e1-44f2bf71a052 successfully. {{(pid=87007) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 14:28:39 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Temporary image 49981579-d0a4-4b4a-9bc6-bd809c76cea9 for user ff9a27661839456a959319dceb9254c8 is deleted. {{(pid=87007) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 14:28:39 devstack cinder-volume[87007]: DEBUG cinder.volume.volume_utils [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Marking volume bec3e137-1dcd-45aa-a7e1-44f2bf71a052 as bootable. {{(pid=87007) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 14:28:39 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Copying metadata from image 49981579-d0a4-4b4a-9bc6-bd809c76cea9 to bec3e137-1dcd-45aa-a7e1-44f2bf71a052. {{(pid=87007) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 14:28:39 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Creating volume glance metadata for volume bec3e137-1dcd-45aa-a7e1-44f2bf71a052 backed by image 49981579-d0a4-4b4a-9bc6-bd809c76cea9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87007) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 14:28:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55764319-b5e2-4f9e-bcb0-f884795ddd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bec3e137-1dcd-45aa-a7e1-44f2bf71a052', 'volume_size': 1, 'image_id': '49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd4e87261137045028f09a9da96d0acd8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'created_at': datetime.datetime(2026, 9, 3, 12, 12, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 12, 12, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/49981579-d0a4-4b4a-9bc6-bd809c76cea9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:28:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7adc7385-89b6-49fd-9b5e-06fe72e8b07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:28:40 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Volume volume-bec3e137-1dcd-45aa-a7e1-44f2bf71a052 (bec3e137-1dcd-45aa-a7e1-44f2bf71a052): created successfully Sep 03 14:28:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7adc7385-89b6-49fd-9b5e-06fe72e8b07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:28:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Flow 'volume_create_manager' (417d5825-9dc9-49b9-bc49-37ada5f57a71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:28:40 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-753cad23-74a4-4cc4-a1ce-f60779ef3572 tempest-VolumesExtendTest-25418097 None] Created volume successfully. Sep 03 14:28:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-9444ec1f-c390-44db-9fa1-a1c4ae466cf7 tempest-VolumesExtendTest-25418097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:28:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-9444ec1f-c390-44db-9fa1-a1c4ae466cf7 tempest-VolumesExtendTest-25418097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:28:40 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d47eb21-2991-4134-8800-e2a69edd9baf]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:28:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9444ec1f-c390-44db-9fa1-a1c4ae466cf7 tempest-VolumesExtendTest-25418097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bec3e137-1dcd-45aa-a7e1-44f2bf71a052 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:41 devstack sudo[100498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bec3e137-1dcd-45aa-a7e1-44f2bf71a052 Sep 03 14:28:41 devstack sudo[100498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:41 devstack sudo[100498]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9444ec1f-c390-44db-9fa1-a1c4ae466cf7 tempest-VolumesExtendTest-25418097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bec3e137-1dcd-45aa-a7e1-44f2bf71a052" returned: 0 in 0.581s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9444ec1f-c390-44db-9fa1-a1c4ae466cf7 tempest-VolumesExtendTest-25418097 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bec3e137-1dcd-45aa-a7e1-44f2bf71a052 2G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9444ec1f-c390-44db-9fa1-a1c4ae466cf7 tempest-VolumesExtendTest-25418097 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bec3e137-1dcd-45aa-a7e1-44f2bf71a052 2G" returned: 0 in 0.137s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-9444ec1f-c390-44db-9fa1-a1c4ae466cf7 tempest-VolumesExtendTest-25418097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.742s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:28:41 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-9444ec1f-c390-44db-9fa1-a1c4ae466cf7 tempest-VolumesExtendTest-25418097 None] Extend volume completed successfully. Sep 03 14:28:41 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2a2e7b74-e256-4e42-9c77-44c53a6c38a8 tempest-VolumesNegativeTest-1350112477 None] Acquiring lock "cinder-92f71c60-326c-494a-9652-309b6377e60f-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:28:41 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2a2e7b74-e256-4e42-9c77-44c53a6c38a8 tempest-VolumesNegativeTest-1350112477 None] Lock "cinder-92f71c60-326c-494a-9652-309b6377e60f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:28:41 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2a2e7b74-e256-4e42-9c77-44c53a6c38a8 tempest-VolumesNegativeTest-1350112477 None] Acquiring lock "cinder-quobyte-92f71c60-326c-494a-9652-309b6377e60f" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:28:41 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2a2e7b74-e256-4e42-9c77-44c53a6c38a8 tempest-VolumesNegativeTest-1350112477 None] Lock "cinder-quobyte-92f71c60-326c-494a-9652-309b6377e60f" acquired by "delete_volume" :: waited 0.020s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:28:41 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b9f79a-9336-416e-9c1c-ee5152ea5b56]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:28:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2a2e7b74-e256-4e42-9c77-44c53a6c38a8 tempest-VolumesNegativeTest-1350112477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-92f71c60-326c-494a-9652-309b6377e60f {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:41 devstack sudo[100507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-92f71c60-326c-494a-9652-309b6377e60f Sep 03 14:28:41 devstack sudo[100507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:42 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-59de090f-f70a-4346-9645-bdbd8c70d5b5 tempest-VolumesExtendTest-25418097 None] Acquiring lock "cinder-bec3e137-1dcd-45aa-a7e1-44f2bf71a052-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:28:42 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-59de090f-f70a-4346-9645-bdbd8c70d5b5 tempest-VolumesExtendTest-25418097 None] Lock "cinder-bec3e137-1dcd-45aa-a7e1-44f2bf71a052-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:28:42 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:UPDATE=116,cinder:INSERT=35,cinder:DELETE=8,cinder:SELECT=105 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:28:42 devstack sudo[100507]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2a2e7b74-e256-4e42-9c77-44c53a6c38a8 tempest-VolumesNegativeTest-1350112477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-92f71c60-326c-494a-9652-309b6377e60f" returned: 0 in 0.453s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2a2e7b74-e256-4e42-9c77-44c53a6c38a8 tempest-VolumesNegativeTest-1350112477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-92f71c60-326c-494a-9652-309b6377e60f {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:42 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-59de090f-f70a-4346-9645-bdbd8c70d5b5 tempest-VolumesExtendTest-25418097 None] Acquiring lock "cinder-quobyte-bec3e137-1dcd-45aa-a7e1-44f2bf71a052" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:28:42 devstack sudo[100512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-92f71c60-326c-494a-9652-309b6377e60f Sep 03 14:28:42 devstack sudo[100512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:42 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-59de090f-f70a-4346-9645-bdbd8c70d5b5 tempest-VolumesExtendTest-25418097 None] Lock "cinder-quobyte-bec3e137-1dcd-45aa-a7e1-44f2bf71a052" acquired by "delete_volume" :: waited 0.028s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:28:42 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de97502-feda-48ab-8a3a-4bfb96fbe008]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:28:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-59de090f-f70a-4346-9645-bdbd8c70d5b5 tempest-VolumesExtendTest-25418097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bec3e137-1dcd-45aa-a7e1-44f2bf71a052 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:42 devstack sudo[100514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bec3e137-1dcd-45aa-a7e1-44f2bf71a052 Sep 03 14:28:42 devstack sudo[100514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:42 devstack sudo[100512]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2a2e7b74-e256-4e42-9c77-44c53a6c38a8 tempest-VolumesNegativeTest-1350112477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-92f71c60-326c-494a-9652-309b6377e60f" returned: 0 in 0.362s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:42 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2a2e7b74-e256-4e42-9c77-44c53a6c38a8 tempest-VolumesNegativeTest-1350112477 None] Lock "cinder-quobyte-92f71c60-326c-494a-9652-309b6377e60f" released by "delete_volume" :: held 0.867s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:28:42 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-2a2e7b74-e256-4e42-9c77-44c53a6c38a8 tempest-VolumesNegativeTest-1350112477 None] Created reservations ['f1f231c5-678c-46cd-a9d4-fdc54f22668e', '9a9419e9-157b-44af-904e-77f3b451ace9', '5790e1fa-2185-4ab9-ab41-d61326c1111c', '15b57df7-1345-4251-a82f-5c5cf308fdb9'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:28:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2a2e7b74-e256-4e42-9c77-44c53a6c38a8 tempest-VolumesNegativeTest-1350112477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:28:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2a2e7b74-e256-4e42-9c77-44c53a6c38a8 tempest-VolumesNegativeTest-1350112477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:28:42 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2a2e7b74-e256-4e42-9c77-44c53a6c38a8 tempest-VolumesNegativeTest-1350112477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:28:42 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2a2e7b74-e256-4e42-9c77-44c53a6c38a8 tempest-VolumesNegativeTest-1350112477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:28:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2a2e7b74-e256-4e42-9c77-44c53a6c38a8 tempest-VolumesNegativeTest-1350112477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:28:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2a2e7b74-e256-4e42-9c77-44c53a6c38a8 tempest-VolumesNegativeTest-1350112477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:42 devstack sudo[100519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:28:42 devstack sudo[100519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:42 devstack sudo[100514]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-59de090f-f70a-4346-9645-bdbd8c70d5b5 tempest-VolumesExtendTest-25418097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bec3e137-1dcd-45aa-a7e1-44f2bf71a052" returned: 0 in 0.587s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-59de090f-f70a-4346-9645-bdbd8c70d5b5 tempest-VolumesExtendTest-25418097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bec3e137-1dcd-45aa-a7e1-44f2bf71a052 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:43 devstack sudo[100522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bec3e137-1dcd-45aa-a7e1-44f2bf71a052 Sep 03 14:28:43 devstack sudo[100522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:43 devstack sudo[100519]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2a2e7b74-e256-4e42-9c77-44c53a6c38a8 tempest-VolumesNegativeTest-1350112477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.346s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:43 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-2a2e7b74-e256-4e42-9c77-44c53a6c38a8 tempest-VolumesNegativeTest-1350112477 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:28:43 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-2a2e7b74-e256-4e42-9c77-44c53a6c38a8 tempest-VolumesNegativeTest-1350112477 None] Deleted volume successfully. Sep 03 14:28:43 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2a2e7b74-e256-4e42-9c77-44c53a6c38a8 tempest-VolumesNegativeTest-1350112477 None] Lock "cinder-92f71c60-326c-494a-9652-309b6377e60f-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:28:43 devstack sudo[100522]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-59de090f-f70a-4346-9645-bdbd8c70d5b5 tempest-VolumesExtendTest-25418097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bec3e137-1dcd-45aa-a7e1-44f2bf71a052" returned: 0 in 0.473s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:43 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-59de090f-f70a-4346-9645-bdbd8c70d5b5 tempest-VolumesExtendTest-25418097 None] Lock "cinder-quobyte-bec3e137-1dcd-45aa-a7e1-44f2bf71a052" released by "delete_volume" :: held 1.133s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:28:43 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-59de090f-f70a-4346-9645-bdbd8c70d5b5 tempest-VolumesExtendTest-25418097 None] Created reservations ['e52e8356-d3f6-427b-9022-ec3ca708ed06', 'e6528159-a302-4aa6-a694-d3d82125e1de', '5ce68f64-58d4-44d6-8efb-d0de00bb5507', '5ba8d58f-a741-4e35-9b1a-19e831b0599e'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:28:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-59de090f-f70a-4346-9645-bdbd8c70d5b5 tempest-VolumesExtendTest-25418097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:28:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-59de090f-f70a-4346-9645-bdbd8c70d5b5 tempest-VolumesExtendTest-25418097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:28:43 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-59de090f-f70a-4346-9645-bdbd8c70d5b5 tempest-VolumesExtendTest-25418097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:28:43 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-59de090f-f70a-4346-9645-bdbd8c70d5b5 tempest-VolumesExtendTest-25418097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:28:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-59de090f-f70a-4346-9645-bdbd8c70d5b5 tempest-VolumesExtendTest-25418097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:28:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-59de090f-f70a-4346-9645-bdbd8c70d5b5 tempest-VolumesExtendTest-25418097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:43 devstack sudo[100527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:28:43 devstack sudo[100527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:43 devstack sudo[100527]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-59de090f-f70a-4346-9645-bdbd8c70d5b5 tempest-VolumesExtendTest-25418097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.279s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:43 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-59de090f-f70a-4346-9645-bdbd8c70d5b5 tempest-VolumesExtendTest-25418097 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:28:43 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-59de090f-f70a-4346-9645-bdbd8c70d5b5 tempest-VolumesExtendTest-25418097 None] Deleted volume successfully. Sep 03 14:28:43 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-59de090f-f70a-4346-9645-bdbd8c70d5b5 tempest-VolumesExtendTest-25418097 None] Lock "cinder-bec3e137-1dcd-45aa-a7e1-44f2bf71a052-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:28:45 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-152c8fa9-0621-47a6-a7b6-f506e541ade0 tempest-VolumesExtendTest-25418097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:28:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-152c8fa9-0621-47a6-a7b6-f506e541ade0 tempest-VolumesExtendTest-25418097 None] Flow 'volume_create_manager' (c351cbdb-0841-4cda-b489-91f44600ba27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:28:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-152c8fa9-0621-47a6-a7b6-f506e541ade0 tempest-VolumesExtendTest-25418097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e22cf6ad-7a9b-4f67-aec7-edfd797e4184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:28:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-152c8fa9-0621-47a6-a7b6-f506e541ade0 tempest-VolumesExtendTest-25418097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e22cf6ad-7a9b-4f67-aec7-edfd797e4184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-19381196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fcc672081414137bf853fd68dc31032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:28:45Z,use_quota=True,user_id='ff9a27661839456a959319dceb9254c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:28:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-152c8fa9-0621-47a6-a7b6-f506e541ade0 tempest-VolumesExtendTest-25418097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c613d785-51c7-4154-b9a6-a4fc9eb9e8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:28:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-152c8fa9-0621-47a6-a7b6-f506e541ade0 tempest-VolumesExtendTest-25418097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c613d785-51c7-4154-b9a6-a4fc9eb9e8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:28:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-152c8fa9-0621-47a6-a7b6-f506e541ade0 tempest-VolumesExtendTest-25418097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec312f7a-cdb9-43be-abac-f24d3c3dd345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:28:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-152c8fa9-0621-47a6-a7b6-f506e541ade0 tempest-VolumesExtendTest-25418097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec312f7a-cdb9-43be-abac-f24d3c3dd345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069', 'volume_name': 'volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:28:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-152c8fa9-0621-47a6-a7b6-f506e541ade0 tempest-VolumesExtendTest-25418097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f99ca966-03b4-458a-be0e-24c13a5e1b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:28:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-152c8fa9-0621-47a6-a7b6-f506e541ade0 tempest-VolumesExtendTest-25418097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f99ca966-03b4-458a-be0e-24c13a5e1b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:28:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-152c8fa9-0621-47a6-a7b6-f506e541ade0 tempest-VolumesExtendTest-25418097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5676fd1d-68a9-4e1f-8291-28323d47a420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:28:45 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-152c8fa9-0621-47a6-a7b6-f506e541ade0 tempest-VolumesExtendTest-25418097 None] Volume 2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069', 'volume_size': 1} Sep 03 14:28:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-152c8fa9-0621-47a6-a7b6-f506e541ade0 tempest-VolumesExtendTest-25418097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:28:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-152c8fa9-0621-47a6-a7b6-f506e541ade0 tempest-VolumesExtendTest-25418097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:28:45 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-152c8fa9-0621-47a6-a7b6-f506e541ade0 tempest-VolumesExtendTest-25418097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-19381196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fcc672081414137bf853fd68dc31032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:28:45Z,use_quota=True,user_id='ff9a27661839456a959319dceb9254c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:28:45 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-152c8fa9-0621-47a6-a7b6-f506e541ade0 tempest-VolumesExtendTest-25418097 None] Creating volume 2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:28:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-152c8fa9-0621-47a6-a7b6-f506e541ade0 tempest-VolumesExtendTest-25418097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:28:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-152c8fa9-0621-47a6-a7b6-f506e541ade0 tempest-VolumesExtendTest-25418097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:28:45 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-152c8fa9-0621-47a6-a7b6-f506e541ade0 tempest-VolumesExtendTest-25418097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:28:45 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-152c8fa9-0621-47a6-a7b6-f506e541ade0 tempest-VolumesExtendTest-25418097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:28:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-152c8fa9-0621-47a6-a7b6-f506e541ade0 tempest-VolumesExtendTest-25418097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:28:45 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-152c8fa9-0621-47a6-a7b6-f506e541ade0 tempest-VolumesExtendTest-25418097 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:28:45 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-152c8fa9-0621-47a6-a7b6-f506e541ade0 tempest-VolumesExtendTest-25418097 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:28:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-152c8fa9-0621-47a6-a7b6-f506e541ade0 tempest-VolumesExtendTest-25418097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:45 devstack sudo[100530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069 1073741824 Sep 03 14:28:45 devstack sudo[100530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:45 devstack sudo[100530]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-152c8fa9-0621-47a6-a7b6-f506e541ade0 tempest-VolumesExtendTest-25418097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069 1073741824" returned: 0 in 0.567s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-152c8fa9-0621-47a6-a7b6-f506e541ade0 tempest-VolumesExtendTest-25418097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:45 devstack sudo[100536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069 Sep 03 14:28:45 devstack sudo[100536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:46 devstack sudo[100536]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-152c8fa9-0621-47a6-a7b6-f506e541ade0 tempest-VolumesExtendTest-25418097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069" returned: 0 in 0.336s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:46 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-152c8fa9-0621-47a6-a7b6-f506e541ade0 tempest-VolumesExtendTest-25418097 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:28:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-152c8fa9-0621-47a6-a7b6-f506e541ade0 tempest-VolumesExtendTest-25418097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:28:46 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-152c8fa9-0621-47a6-a7b6-f506e541ade0 tempest-VolumesExtendTest-25418097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5676fd1d-68a9-4e1f-8291-28323d47a420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:28:46 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-152c8fa9-0621-47a6-a7b6-f506e541ade0 tempest-VolumesExtendTest-25418097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb8d7a1a-4b52-4808-9889-c7b7b9ee5160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:28:46 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-152c8fa9-0621-47a6-a7b6-f506e541ade0 tempest-VolumesExtendTest-25418097 None] Volume volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069 (2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069): created successfully Sep 03 14:28:46 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-152c8fa9-0621-47a6-a7b6-f506e541ade0 tempest-VolumesExtendTest-25418097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb8d7a1a-4b52-4808-9889-c7b7b9ee5160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:28:46 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-152c8fa9-0621-47a6-a7b6-f506e541ade0 tempest-VolumesExtendTest-25418097 None] Flow 'volume_create_manager' (c351cbdb-0841-4cda-b489-91f44600ba27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:28:46 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-152c8fa9-0621-47a6-a7b6-f506e541ade0 tempest-VolumesExtendTest-25418097 None] Created volume successfully. Sep 03 14:28:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-33d11066-1d9c-49bc-af0a-34bb81155f23 tempest-VolumesExtendTest-25418097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:28:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-33d11066-1d9c-49bc-af0a-34bb81155f23 tempest-VolumesExtendTest-25418097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:28:47 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-33d11066-1d9c-49bc-af0a-34bb81155f23 tempest-VolumesExtendTest-25418097 None] Creating offline snapshot 2297175a-7f17-475c-9e79-1af7c0abf6d2 of volume 2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069 {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:28:47 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3eaa3a8-32e8-4ada-a6e4-92f5b672e129]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:28:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-33d11066-1d9c-49bc-af0a-34bb81155f23 tempest-VolumesExtendTest-25418097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:47 devstack sudo[100542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069 Sep 03 14:28:47 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:48 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-33d11066-1d9c-49bc-af0a-34bb81155f23 tempest-VolumesExtendTest-25418097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069" returned: 0 in 0.527s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-33d11066-1d9c-49bc-af0a-34bb81155f23 tempest-VolumesExtendTest-25418097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069.2297175a-7f17-475c-9e79-1af7c0abf6d2 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:48 devstack sudo[100547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069.2297175a-7f17-475c-9e79-1af7c0abf6d2 1G Sep 03 14:28:48 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:48 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-33d11066-1d9c-49bc-af0a-34bb81155f23 tempest-VolumesExtendTest-25418097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069.2297175a-7f17-475c-9e79-1af7c0abf6d2 1G" returned: 0 in 0.480s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-33d11066-1d9c-49bc-af0a-34bb81155f23 tempest-VolumesExtendTest-25418097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069.2297175a-7f17-475c-9e79-1af7c0abf6d2 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:48 devstack sudo[100552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069.2297175a-7f17-475c-9e79-1af7c0abf6d2 Sep 03 14:28:48 devstack sudo[100552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:48 devstack sudo[100552]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-33d11066-1d9c-49bc-af0a-34bb81155f23 tempest-VolumesExtendTest-25418097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069.2297175a-7f17-475c-9e79-1af7c0abf6d2" returned: 0 in 0.340s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:48 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-33d11066-1d9c-49bc-af0a-34bb81155f23 tempest-VolumesExtendTest-25418097 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069.2297175a-7f17-475c-9e79-1af7c0abf6d2 is being set with open permissions: ugo+rw Sep 03 14:28:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-33d11066-1d9c-49bc-af0a-34bb81155f23 tempest-VolumesExtendTest-25418097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069.2297175a-7f17-475c-9e79-1af7c0abf6d2 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:48 devstack sudo[100557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069.2297175a-7f17-475c-9e79-1af7c0abf6d2 Sep 03 14:28:48 devstack sudo[100557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:49 devstack sudo[100557]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-33d11066-1d9c-49bc-af0a-34bb81155f23 tempest-VolumesExtendTest-25418097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069.2297175a-7f17-475c-9e79-1af7c0abf6d2" returned: 0 in 0.423s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-33d11066-1d9c-49bc-af0a-34bb81155f23 tempest-VolumesExtendTest-25418097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:49 devstack sudo[100560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069.info Sep 03 14:28:49 devstack sudo[100560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:49 devstack sudo[100560]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-33d11066-1d9c-49bc-af0a-34bb81155f23 tempest-VolumesExtendTest-25418097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069.info" returned: 0 in 0.407s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:49 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-33d11066-1d9c-49bc-af0a-34bb81155f23 tempest-VolumesExtendTest-25418097 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069.info is being set with open permissions: ugo+rw Sep 03 14:28:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-33d11066-1d9c-49bc-af0a-34bb81155f23 tempest-VolumesExtendTest-25418097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:49 devstack sudo[100563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069.info Sep 03 14:28:49 devstack sudo[100563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:50 devstack sudo[100563]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-33d11066-1d9c-49bc-af0a-34bb81155f23 tempest-VolumesExtendTest-25418097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069.info" returned: 0 in 0.366s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-33d11066-1d9c-49bc-af0a-34bb81155f23 tempest-VolumesExtendTest-25418097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.696s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:28:50 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-7440b8f4-e542-499b-93ee-c7900e62ca42 tempest-VolumeQuotasNegativeTestJSON-2097159084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:28:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7440b8f4-e542-499b-93ee-c7900e62ca42 tempest-VolumeQuotasNegativeTestJSON-2097159084 None] Flow 'volume_create_manager' (8db6a889-f231-433e-b5cf-704c98e6d772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:28:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7440b8f4-e542-499b-93ee-c7900e62ca42 tempest-VolumeQuotasNegativeTestJSON-2097159084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1b48c24-cd7d-4223-b59a-9814c49f7031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:28:50 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-33d11066-1d9c-49bc-af0a-34bb81155f23 tempest-VolumesExtendTest-25418097 None] Create snapshot completed successfully Sep 03 14:28:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7440b8f4-e542-499b-93ee-c7900e62ca42 tempest-VolumeQuotasNegativeTestJSON-2097159084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1b48c24-cd7d-4223-b59a-9814c49f7031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-78971946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf3d3f2f-f37a-478a-a937-49ab6cb8727d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='814a943392a648cea00834899bd8d52a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:28:50Z,use_quota=True,user_id='417731aea9d049cca9b2a18e0a310787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:28:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7440b8f4-e542-499b-93ee-c7900e62ca42 tempest-VolumeQuotasNegativeTestJSON-2097159084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (463176f8-3b25-4685-b064-3582e58e5658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:28:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7440b8f4-e542-499b-93ee-c7900e62ca42 tempest-VolumeQuotasNegativeTestJSON-2097159084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (463176f8-3b25-4685-b064-3582e58e5658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:28:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7440b8f4-e542-499b-93ee-c7900e62ca42 tempest-VolumeQuotasNegativeTestJSON-2097159084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ed84011-942b-48ab-adb7-99af9c4418ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:28:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7440b8f4-e542-499b-93ee-c7900e62ca42 tempest-VolumeQuotasNegativeTestJSON-2097159084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ed84011-942b-48ab-adb7-99af9c4418ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf3d3f2f-f37a-478a-a937-49ab6cb8727d', 'volume_name': 'volume-bf3d3f2f-f37a-478a-a937-49ab6cb8727d', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:28:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7440b8f4-e542-499b-93ee-c7900e62ca42 tempest-VolumeQuotasNegativeTestJSON-2097159084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc8f6868-5eb3-4fd4-86eb-d0ef5791e844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:28:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7440b8f4-e542-499b-93ee-c7900e62ca42 tempest-VolumeQuotasNegativeTestJSON-2097159084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc8f6868-5eb3-4fd4-86eb-d0ef5791e844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:28:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7440b8f4-e542-499b-93ee-c7900e62ca42 tempest-VolumeQuotasNegativeTestJSON-2097159084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c924535-b8f3-4693-bc0e-dad93c2cefd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:28:50 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-7440b8f4-e542-499b-93ee-c7900e62ca42 tempest-VolumeQuotasNegativeTestJSON-2097159084 None] Volume bf3d3f2f-f37a-478a-a937-49ab6cb8727d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf3d3f2f-f37a-478a-a937-49ab6cb8727d', 'volume_size': 1} Sep 03 14:28:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7440b8f4-e542-499b-93ee-c7900e62ca42 tempest-VolumeQuotasNegativeTestJSON-2097159084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:28:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7440b8f4-e542-499b-93ee-c7900e62ca42 tempest-VolumeQuotasNegativeTestJSON-2097159084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:28:50 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-7440b8f4-e542-499b-93ee-c7900e62ca42 tempest-VolumeQuotasNegativeTestJSON-2097159084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-78971946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf3d3f2f-f37a-478a-a937-49ab6cb8727d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='814a943392a648cea00834899bd8d52a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:28:50Z,use_quota=True,user_id='417731aea9d049cca9b2a18e0a310787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:28:50 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-7440b8f4-e542-499b-93ee-c7900e62ca42 tempest-VolumeQuotasNegativeTestJSON-2097159084 None] Creating volume bf3d3f2f-f37a-478a-a937-49ab6cb8727d {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:28:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7440b8f4-e542-499b-93ee-c7900e62ca42 tempest-VolumeQuotasNegativeTestJSON-2097159084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:28:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7440b8f4-e542-499b-93ee-c7900e62ca42 tempest-VolumeQuotasNegativeTestJSON-2097159084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:28:50 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-7440b8f4-e542-499b-93ee-c7900e62ca42 tempest-VolumeQuotasNegativeTestJSON-2097159084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:28:50 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-7440b8f4-e542-499b-93ee-c7900e62ca42 tempest-VolumeQuotasNegativeTestJSON-2097159084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:28:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7440b8f4-e542-499b-93ee-c7900e62ca42 tempest-VolumeQuotasNegativeTestJSON-2097159084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:28:50 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-7440b8f4-e542-499b-93ee-c7900e62ca42 tempest-VolumeQuotasNegativeTestJSON-2097159084 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:28:50 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-7440b8f4-e542-499b-93ee-c7900e62ca42 tempest-VolumeQuotasNegativeTestJSON-2097159084 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:28:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7440b8f4-e542-499b-93ee-c7900e62ca42 tempest-VolumeQuotasNegativeTestJSON-2097159084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bf3d3f2f-f37a-478a-a937-49ab6cb8727d 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:50 devstack sudo[100567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bf3d3f2f-f37a-478a-a937-49ab6cb8727d 1073741824 Sep 03 14:28:50 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b61ce765-6963-4db8-aeb3-afecb12a8dc6 tempest-VolumesExtendTest-25418097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:28:50 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7440b8f4-e542-499b-93ee-c7900e62ca42 tempest-VolumeQuotasNegativeTestJSON-2097159084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bf3d3f2f-f37a-478a-a937-49ab6cb8727d 1073741824" returned: 0 in 0.570s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7440b8f4-e542-499b-93ee-c7900e62ca42 tempest-VolumeQuotasNegativeTestJSON-2097159084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bf3d3f2f-f37a-478a-a937-49ab6cb8727d {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:51 devstack sudo[100573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bf3d3f2f-f37a-478a-a937-49ab6cb8727d Sep 03 14:28:51 devstack sudo[100573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:51 devstack sudo[100573]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7440b8f4-e542-499b-93ee-c7900e62ca42 tempest-VolumeQuotasNegativeTestJSON-2097159084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bf3d3f2f-f37a-478a-a937-49ab6cb8727d" returned: 0 in 0.337s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-7440b8f4-e542-499b-93ee-c7900e62ca42 tempest-VolumeQuotasNegativeTestJSON-2097159084 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:28:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7440b8f4-e542-499b-93ee-c7900e62ca42 tempest-VolumeQuotasNegativeTestJSON-2097159084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:28:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b61ce765-6963-4db8-aeb3-afecb12a8dc6 tempest-VolumesExtendTest-25418097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.497s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:28:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7440b8f4-e542-499b-93ee-c7900e62ca42 tempest-VolumeQuotasNegativeTestJSON-2097159084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c924535-b8f3-4693-bc0e-dad93c2cefd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf3d3f2f-f37a-478a-a937-49ab6cb8727d', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:28:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7440b8f4-e542-499b-93ee-c7900e62ca42 tempest-VolumeQuotasNegativeTestJSON-2097159084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc808cbb-6eef-4788-8a89-ea41d8e7109d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:28:51 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[83470896-edf6-4de4-b372-07cf1df87f57]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:28:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b61ce765-6963-4db8-aeb3-afecb12a8dc6 tempest-VolumesExtendTest-25418097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:51 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-7440b8f4-e542-499b-93ee-c7900e62ca42 tempest-VolumeQuotasNegativeTestJSON-2097159084 None] Volume volume-bf3d3f2f-f37a-478a-a937-49ab6cb8727d (bf3d3f2f-f37a-478a-a937-49ab6cb8727d): created successfully Sep 03 14:28:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7440b8f4-e542-499b-93ee-c7900e62ca42 tempest-VolumeQuotasNegativeTestJSON-2097159084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc808cbb-6eef-4788-8a89-ea41d8e7109d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:28:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7440b8f4-e542-499b-93ee-c7900e62ca42 tempest-VolumeQuotasNegativeTestJSON-2097159084 None] Flow 'volume_create_manager' (8db6a889-f231-433e-b5cf-704c98e6d772) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:28:51 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-7440b8f4-e542-499b-93ee-c7900e62ca42 tempest-VolumeQuotasNegativeTestJSON-2097159084 None] Created volume successfully. Sep 03 14:28:51 devstack sudo[100576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069 Sep 03 14:28:51 devstack sudo[100576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:51 devstack cinder-volume[87007]: DEBUG oslo_service.periodic_task [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87007) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 14:28:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:28:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:28:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:28:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:28:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:28:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:51 devstack sudo[100578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:28:51 devstack sudo[100578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:51 devstack sudo[100576]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b61ce765-6963-4db8-aeb3-afecb12a8dc6 tempest-VolumesExtendTest-25418097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069" returned: 0 in 0.476s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b61ce765-6963-4db8-aeb3-afecb12a8dc6 tempest-VolumesExtendTest-25418097 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069.2297175a-7f17-475c-9e79-1af7c0abf6d2 2G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:52 devstack sudo[100578]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.415s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:52 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:28:52 devstack cinder-volume[87007]: DEBUG oslo_service.periodic_task [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running periodic task VolumeManager._thread_info {{(pid=87007) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 14:28:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] thread count: 28 {{(pid=87007) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 14:28:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] thread info: [<_MainThread(MainThread, started 123689171054720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87007) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 14:28:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b61ce765-6963-4db8-aeb3-afecb12a8dc6 tempest-VolumesExtendTest-25418097 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069.2297175a-7f17-475c-9e79-1af7c0abf6d2 2G" returned: 0 in 0.285s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b61ce765-6963-4db8-aeb3-afecb12a8dc6 tempest-VolumesExtendTest-25418097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.817s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:28:52 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-b61ce765-6963-4db8-aeb3-afecb12a8dc6 tempest-VolumesExtendTest-25418097 None] Extend volume completed successfully. Sep 03 14:28:53 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-715ea813-0496-454f-a607-13319a454933 tempest-VolumesExtendTest-25418097 None] Acquiring lock "cinder-2297175a-7f17-475c-9e79-1af7c0abf6d2-delete_snapshot" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:28:53 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-715ea813-0496-454f-a607-13319a454933 tempest-VolumesExtendTest-25418097 None] Lock "cinder-2297175a-7f17-475c-9e79-1af7c0abf6d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:28:53 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-715ea813-0496-454f-a607-13319a454933 tempest-VolumesExtendTest-25418097 None] Acquiring lock "cinder-quobyte-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:28:53 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-715ea813-0496-454f-a607-13319a454933 tempest-VolumesExtendTest-25418097 None] Lock "cinder-quobyte-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:28:53 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-715ea813-0496-454f-a607-13319a454933 tempest-VolumesExtendTest-25418097 None] Acquiring lock "cinder-quobyte-2297175a-7f17-475c-9e79-1af7c0abf6d2" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:28:53 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-715ea813-0496-454f-a607-13319a454933 tempest-VolumesExtendTest-25418097 None] Lock "cinder-quobyte-2297175a-7f17-475c-9e79-1af7c0abf6d2" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:28:53 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-715ea813-0496-454f-a607-13319a454933 tempest-VolumesExtendTest-25418097 None] Deleting offline snapshot 2297175a-7f17-475c-9e79-1af7c0abf6d2 of volume 2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:28:53 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-715ea813-0496-454f-a607-13319a454933 tempest-VolumesExtendTest-25418097 None] snapshot_file for this snap is: volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069.2297175a-7f17-475c-9e79-1af7c0abf6d2 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:28:53 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9f0754-4b17-4d37-9b71-46c01eeb3eca]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:28:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-715ea813-0496-454f-a607-13319a454933 tempest-VolumesExtendTest-25418097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069.2297175a-7f17-475c-9e79-1af7c0abf6d2 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:53 devstack sudo[100588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069.2297175a-7f17-475c-9e79-1af7c0abf6d2 Sep 03 14:28:53 devstack sudo[100588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:53 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c5278c93-1d47-45c3-8edd-b959df5eeccf tempest-VolumeQuotasNegativeTestJSON-2097159084 None] Acquiring lock "cinder-bf3d3f2f-f37a-478a-a937-49ab6cb8727d-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:28:53 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c5278c93-1d47-45c3-8edd-b959df5eeccf tempest-VolumeQuotasNegativeTestJSON-2097159084 None] Lock "cinder-bf3d3f2f-f37a-478a-a937-49ab6cb8727d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:28:53 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c5278c93-1d47-45c3-8edd-b959df5eeccf tempest-VolumeQuotasNegativeTestJSON-2097159084 None] Acquiring lock "cinder-quobyte-bf3d3f2f-f37a-478a-a937-49ab6cb8727d" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:28:53 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c5278c93-1d47-45c3-8edd-b959df5eeccf tempest-VolumeQuotasNegativeTestJSON-2097159084 None] Lock "cinder-quobyte-bf3d3f2f-f37a-478a-a937-49ab6cb8727d" acquired by "delete_volume" :: waited 0.023s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:28:53 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb4bb57-58ac-4e49-b83a-5c3391f0ed79]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:28:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c5278c93-1d47-45c3-8edd-b959df5eeccf tempest-VolumeQuotasNegativeTestJSON-2097159084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bf3d3f2f-f37a-478a-a937-49ab6cb8727d {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:54 devstack sudo[100592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bf3d3f2f-f37a-478a-a937-49ab6cb8727d Sep 03 14:28:54 devstack sudo[100588]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-715ea813-0496-454f-a607-13319a454933 tempest-VolumesExtendTest-25418097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069.2297175a-7f17-475c-9e79-1af7c0abf6d2" returned: 0 in 0.647s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:54 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-715ea813-0496-454f-a607-13319a454933 tempest-VolumesExtendTest-25418097 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:28:54 devstack sudo[100592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:54 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6359bd9-62ec-4348-9f5d-6272b51c28d7]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:28:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-715ea813-0496-454f-a607-13319a454933 tempest-VolumesExtendTest-25418097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:54 devstack sudo[100595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069 Sep 03 14:28:54 devstack sudo[100595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:54 devstack sudo[100592]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c5278c93-1d47-45c3-8edd-b959df5eeccf tempest-VolumeQuotasNegativeTestJSON-2097159084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bf3d3f2f-f37a-478a-a937-49ab6cb8727d" returned: 0 in 0.572s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c5278c93-1d47-45c3-8edd-b959df5eeccf tempest-VolumeQuotasNegativeTestJSON-2097159084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bf3d3f2f-f37a-478a-a937-49ab6cb8727d {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:54 devstack sudo[100600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bf3d3f2f-f37a-478a-a937-49ab6cb8727d Sep 03 14:28:54 devstack sudo[100600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:54 devstack sudo[100595]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-715ea813-0496-454f-a607-13319a454933 tempest-VolumesExtendTest-25418097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069" returned: 0 in 0.618s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-715ea813-0496-454f-a607-13319a454933 tempest-VolumesExtendTest-25418097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069.2297175a-7f17-475c-9e79-1af7c0abf6d2 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:54 devstack sudo[100605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069.2297175a-7f17-475c-9e79-1af7c0abf6d2 Sep 03 14:28:54 devstack sudo[100605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:54 devstack sudo[100600]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c5278c93-1d47-45c3-8edd-b959df5eeccf tempest-VolumeQuotasNegativeTestJSON-2097159084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bf3d3f2f-f37a-478a-a937-49ab6cb8727d" returned: 0 in 0.439s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:54 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c5278c93-1d47-45c3-8edd-b959df5eeccf tempest-VolumeQuotasNegativeTestJSON-2097159084 None] Lock "cinder-quobyte-bf3d3f2f-f37a-478a-a937-49ab6cb8727d" released by "delete_volume" :: held 1.101s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:28:55 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-c5278c93-1d47-45c3-8edd-b959df5eeccf tempest-VolumeQuotasNegativeTestJSON-2097159084 None] Created reservations ['e7ee65ea-bf3a-45e0-9d6d-77809747542e', '35a6b823-75b4-4f73-8703-5a9ebde8fbf4', '05e8783f-9988-4a82-8aac-66f631520b43', '05f15b50-8039-4c12-8424-64b7885cee32'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:28:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c5278c93-1d47-45c3-8edd-b959df5eeccf tempest-VolumeQuotasNegativeTestJSON-2097159084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:28:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c5278c93-1d47-45c3-8edd-b959df5eeccf tempest-VolumeQuotasNegativeTestJSON-2097159084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:28:55 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-c5278c93-1d47-45c3-8edd-b959df5eeccf tempest-VolumeQuotasNegativeTestJSON-2097159084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:28:55 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-c5278c93-1d47-45c3-8edd-b959df5eeccf tempest-VolumeQuotasNegativeTestJSON-2097159084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:28:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c5278c93-1d47-45c3-8edd-b959df5eeccf tempest-VolumeQuotasNegativeTestJSON-2097159084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:28:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c5278c93-1d47-45c3-8edd-b959df5eeccf tempest-VolumeQuotasNegativeTestJSON-2097159084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:55 devstack sudo[100611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:28:55 devstack sudo[100611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:55 devstack sudo[100605]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-715ea813-0496-454f-a607-13319a454933 tempest-VolumesExtendTest-25418097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069.2297175a-7f17-475c-9e79-1af7c0abf6d2" returned: 0 in 0.585s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-715ea813-0496-454f-a607-13319a454933 tempest-VolumesExtendTest-25418097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069.2297175a-7f17-475c-9e79-1af7c0abf6d2 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:55 devstack sudo[100613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069.2297175a-7f17-475c-9e79-1af7c0abf6d2 Sep 03 14:28:55 devstack sudo[100613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:55 devstack sudo[100611]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c5278c93-1d47-45c3-8edd-b959df5eeccf tempest-VolumeQuotasNegativeTestJSON-2097159084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.345s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:55 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-c5278c93-1d47-45c3-8edd-b959df5eeccf tempest-VolumeQuotasNegativeTestJSON-2097159084 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:28:55 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-c5278c93-1d47-45c3-8edd-b959df5eeccf tempest-VolumeQuotasNegativeTestJSON-2097159084 None] Deleted volume successfully. Sep 03 14:28:55 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c5278c93-1d47-45c3-8edd-b959df5eeccf tempest-VolumeQuotasNegativeTestJSON-2097159084 None] Lock "cinder-bf3d3f2f-f37a-478a-a937-49ab6cb8727d-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:28:55 devstack sudo[100613]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-715ea813-0496-454f-a607-13319a454933 tempest-VolumesExtendTest-25418097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069.2297175a-7f17-475c-9e79-1af7c0abf6d2" returned: 0 in 0.385s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:55 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-715ea813-0496-454f-a607-13319a454933 tempest-VolumesExtendTest-25418097 None] Lock "cinder-quobyte-2297175a-7f17-475c-9e79-1af7c0abf6d2" released by "_delete_snapshot" :: held 2.411s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:28:55 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-715ea813-0496-454f-a607-13319a454933 tempest-VolumesExtendTest-25418097 None] Lock "cinder-quobyte-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069" released by "delete_snapshot" :: held 2.452s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:28:55 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-715ea813-0496-454f-a607-13319a454933 tempest-VolumesExtendTest-25418097 None] Created reservations ['e7191cfe-ed66-4163-9c10-4a7e43cf2042', '7f02c944-d45d-4c54-a8b5-977a57c9889b', 'fcd10d99-c2ef-4c10-bbfa-7b4d2c0dc8a1', 'df921f68-8a91-4693-9bb0-58567732af70'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:28:55 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-715ea813-0496-454f-a607-13319a454933 tempest-VolumesExtendTest-25418097 None] Delete snapshot completed successfully. Sep 03 14:28:55 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-715ea813-0496-454f-a607-13319a454933 tempest-VolumesExtendTest-25418097 None] Lock "cinder-2297175a-7f17-475c-9e79-1af7c0abf6d2-delete_snapshot" released by "delete_snapshot" :: held 2.645s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:28:56 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2d371d28-39fa-450f-a24b-24c02ddf68c5 tempest-VolumesExtendTest-25418097 None] Acquiring lock "cinder-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:28:56 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2d371d28-39fa-450f-a24b-24c02ddf68c5 tempest-VolumesExtendTest-25418097 None] Lock "cinder-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:28:56 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2d371d28-39fa-450f-a24b-24c02ddf68c5 tempest-VolumesExtendTest-25418097 None] Acquiring lock "cinder-quobyte-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:28:56 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2d371d28-39fa-450f-a24b-24c02ddf68c5 tempest-VolumesExtendTest-25418097 None] Lock "cinder-quobyte-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069" acquired by "delete_volume" :: waited 0.022s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:28:56 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[77519dfa-8c03-49d1-8375-f754eecf2361]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:28:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2d371d28-39fa-450f-a24b-24c02ddf68c5 tempest-VolumesExtendTest-25418097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:57 devstack sudo[100618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069 Sep 03 14:28:57 devstack sudo[100618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:57 devstack sudo[100618]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2d371d28-39fa-450f-a24b-24c02ddf68c5 tempest-VolumesExtendTest-25418097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069" returned: 0 in 0.611s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2d371d28-39fa-450f-a24b-24c02ddf68c5 tempest-VolumesExtendTest-25418097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:57 devstack sudo[100623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069 Sep 03 14:28:57 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:57 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2d371d28-39fa-450f-a24b-24c02ddf68c5 tempest-VolumesExtendTest-25418097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069" returned: 0 in 0.332s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:57 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2d371d28-39fa-450f-a24b-24c02ddf68c5 tempest-VolumesExtendTest-25418097 None] Lock "cinder-quobyte-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069" released by "delete_volume" :: held 1.031s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:28:57 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-2d371d28-39fa-450f-a24b-24c02ddf68c5 tempest-VolumesExtendTest-25418097 None] Created reservations ['877fb267-7685-4aee-a7ab-b3ff6a924f6b', 'a7e64562-46dd-43a1-a229-8bce7baf99c8', '3cd1f814-f17c-4a2e-a43f-e1de6e7edf73', '86a32f2e-b654-4aa0-926e-c4013926c830'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:28:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2d371d28-39fa-450f-a24b-24c02ddf68c5 tempest-VolumesExtendTest-25418097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:28:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2d371d28-39fa-450f-a24b-24c02ddf68c5 tempest-VolumesExtendTest-25418097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:28:57 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2d371d28-39fa-450f-a24b-24c02ddf68c5 tempest-VolumesExtendTest-25418097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:28:57 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2d371d28-39fa-450f-a24b-24c02ddf68c5 tempest-VolumesExtendTest-25418097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:28:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2d371d28-39fa-450f-a24b-24c02ddf68c5 tempest-VolumesExtendTest-25418097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:28:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2d371d28-39fa-450f-a24b-24c02ddf68c5 tempest-VolumesExtendTest-25418097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:58 devstack sudo[100626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:28:58 devstack sudo[100626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:58 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-69b4fb7a-65b1-4381-b644-c9f2cc92238b tempest-VolumesSnapshotTestJSON-595514335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:28:58 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-69b4fb7a-65b1-4381-b644-c9f2cc92238b tempest-VolumesSnapshotTestJSON-595514335 None] Flow 'volume_create_manager' (8438f1c7-23e3-4fb3-9558-9ff1df213745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:28:58 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-69b4fb7a-65b1-4381-b644-c9f2cc92238b tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (499cd990-928e-4a4a-bfb6-200b361b551a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:28:58 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-69b4fb7a-65b1-4381-b644-c9f2cc92238b tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (499cd990-928e-4a4a-bfb6-200b361b551a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2138010408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c08c0373-6788-473f-adc8-c5dfabb001a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41da579dea614d719a655b998f608b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:28:58Z,use_quota=True,user_id='efad3035689f423d9267d2e66d9a3cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:28:58 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-69b4fb7a-65b1-4381-b644-c9f2cc92238b tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7447b20-3222-4f83-ac87-a5081c001f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:28:58 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-69b4fb7a-65b1-4381-b644-c9f2cc92238b tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7447b20-3222-4f83-ac87-a5081c001f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:28:58 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-69b4fb7a-65b1-4381-b644-c9f2cc92238b tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c77f1b78-b3a7-4421-b84f-a460711821e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:28:58 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-69b4fb7a-65b1-4381-b644-c9f2cc92238b tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c77f1b78-b3a7-4421-b84f-a460711821e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c08c0373-6788-473f-adc8-c5dfabb001a2', 'volume_name': 'volume-c08c0373-6788-473f-adc8-c5dfabb001a2', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:28:58 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-69b4fb7a-65b1-4381-b644-c9f2cc92238b tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5caf174-f697-43b2-b6c8-9670651d4bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:28:58 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-69b4fb7a-65b1-4381-b644-c9f2cc92238b tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5caf174-f697-43b2-b6c8-9670651d4bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:28:58 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-69b4fb7a-65b1-4381-b644-c9f2cc92238b tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3df4b49-834a-469b-97d8-3d082426ff2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:28:58 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-69b4fb7a-65b1-4381-b644-c9f2cc92238b tempest-VolumesSnapshotTestJSON-595514335 None] Volume c08c0373-6788-473f-adc8-c5dfabb001a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c08c0373-6788-473f-adc8-c5dfabb001a2', 'volume_size': 1} Sep 03 14:28:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-69b4fb7a-65b1-4381-b644-c9f2cc92238b tempest-VolumesSnapshotTestJSON-595514335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:28:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-69b4fb7a-65b1-4381-b644-c9f2cc92238b tempest-VolumesSnapshotTestJSON-595514335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:28:58 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-69b4fb7a-65b1-4381-b644-c9f2cc92238b tempest-VolumesSnapshotTestJSON-595514335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2138010408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c08c0373-6788-473f-adc8-c5dfabb001a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41da579dea614d719a655b998f608b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:28:58Z,use_quota=True,user_id='efad3035689f423d9267d2e66d9a3cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:28:58 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-69b4fb7a-65b1-4381-b644-c9f2cc92238b tempest-VolumesSnapshotTestJSON-595514335 None] Creating volume c08c0373-6788-473f-adc8-c5dfabb001a2 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:28:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-69b4fb7a-65b1-4381-b644-c9f2cc92238b tempest-VolumesSnapshotTestJSON-595514335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:28:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-69b4fb7a-65b1-4381-b644-c9f2cc92238b tempest-VolumesSnapshotTestJSON-595514335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:28:58 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-69b4fb7a-65b1-4381-b644-c9f2cc92238b tempest-VolumesSnapshotTestJSON-595514335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:28:58 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-69b4fb7a-65b1-4381-b644-c9f2cc92238b tempest-VolumesSnapshotTestJSON-595514335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:28:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-69b4fb7a-65b1-4381-b644-c9f2cc92238b tempest-VolumesSnapshotTestJSON-595514335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:28:58 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-69b4fb7a-65b1-4381-b644-c9f2cc92238b tempest-VolumesSnapshotTestJSON-595514335 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:28:58 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-69b4fb7a-65b1-4381-b644-c9f2cc92238b tempest-VolumesSnapshotTestJSON-595514335 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:28:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-69b4fb7a-65b1-4381-b644-c9f2cc92238b tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c08c0373-6788-473f-adc8-c5dfabb001a2 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:58 devstack sudo[100628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c08c0373-6788-473f-adc8-c5dfabb001a2 1073741824 Sep 03 14:28:58 devstack sudo[100628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:58 devstack sudo[100626]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2d371d28-39fa-450f-a24b-24c02ddf68c5 tempest-VolumesExtendTest-25418097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.415s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:58 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-2d371d28-39fa-450f-a24b-24c02ddf68c5 tempest-VolumesExtendTest-25418097 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:28:58 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-2d371d28-39fa-450f-a24b-24c02ddf68c5 tempest-VolumesExtendTest-25418097 None] Deleted volume successfully. Sep 03 14:28:58 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2d371d28-39fa-450f-a24b-24c02ddf68c5 tempest-VolumesExtendTest-25418097 None] Lock "cinder-2d5c8c0c-b1aa-485b-aa46-70c5ab3ab069-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:28:58 devstack sudo[100628]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-69b4fb7a-65b1-4381-b644-c9f2cc92238b tempest-VolumesSnapshotTestJSON-595514335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c08c0373-6788-473f-adc8-c5dfabb001a2 1073741824" returned: 0 in 0.544s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-69b4fb7a-65b1-4381-b644-c9f2cc92238b tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c08c0373-6788-473f-adc8-c5dfabb001a2 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:28:58 devstack sudo[100635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c08c0373-6788-473f-adc8-c5dfabb001a2 Sep 03 14:28:58 devstack sudo[100635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:28:59 devstack sudo[100635]: pam_unix(sudo:session): session closed for user root Sep 03 14:28:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-69b4fb7a-65b1-4381-b644-c9f2cc92238b tempest-VolumesSnapshotTestJSON-595514335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c08c0373-6788-473f-adc8-c5dfabb001a2" returned: 0 in 0.298s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:28:59 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-69b4fb7a-65b1-4381-b644-c9f2cc92238b tempest-VolumesSnapshotTestJSON-595514335 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:28:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-69b4fb7a-65b1-4381-b644-c9f2cc92238b tempest-VolumesSnapshotTestJSON-595514335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:28:59 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-69b4fb7a-65b1-4381-b644-c9f2cc92238b tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3df4b49-834a-469b-97d8-3d082426ff2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c08c0373-6788-473f-adc8-c5dfabb001a2', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:28:59 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-69b4fb7a-65b1-4381-b644-c9f2cc92238b tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a1bb223-85bd-4ee9-b742-8a5247f216dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:28:59 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-69b4fb7a-65b1-4381-b644-c9f2cc92238b tempest-VolumesSnapshotTestJSON-595514335 None] Volume volume-c08c0373-6788-473f-adc8-c5dfabb001a2 (c08c0373-6788-473f-adc8-c5dfabb001a2): created successfully Sep 03 14:28:59 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-69b4fb7a-65b1-4381-b644-c9f2cc92238b tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a1bb223-85bd-4ee9-b742-8a5247f216dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:28:59 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-69b4fb7a-65b1-4381-b644-c9f2cc92238b tempest-VolumesSnapshotTestJSON-595514335 None] Flow 'volume_create_manager' (8438f1c7-23e3-4fb3-9558-9ff1df213745) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:28:59 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-69b4fb7a-65b1-4381-b644-c9f2cc92238b tempest-VolumesSnapshotTestJSON-595514335 None] Created volume successfully. Sep 03 14:29:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-5f8abc45-fc55-40dd-82dc-2bd48f7a8da7 tempest-VolumesSnapshotTestJSON-595514335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-5f8abc45-fc55-40dd-82dc-2bd48f7a8da7 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:00 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-5f8abc45-fc55-40dd-82dc-2bd48f7a8da7 tempest-VolumesSnapshotTestJSON-595514335 None] Creating offline snapshot 1fc1a991-4a75-4409-9c61-e957d83c6813 of volume c08c0373-6788-473f-adc8-c5dfabb001a2 {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:29:00 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[24026c71-f8c1-46c4-aeb9-05a49f04574b]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:29:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5f8abc45-fc55-40dd-82dc-2bd48f7a8da7 tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c08c0373-6788-473f-adc8-c5dfabb001a2 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:00 devstack sudo[100638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c08c0373-6788-473f-adc8-c5dfabb001a2 Sep 03 14:29:00 devstack sudo[100638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:01 devstack sudo[100638]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5f8abc45-fc55-40dd-82dc-2bd48f7a8da7 tempest-VolumesSnapshotTestJSON-595514335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c08c0373-6788-473f-adc8-c5dfabb001a2" returned: 0 in 0.599s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5f8abc45-fc55-40dd-82dc-2bd48f7a8da7 tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c08c0373-6788-473f-adc8-c5dfabb001a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c08c0373-6788-473f-adc8-c5dfabb001a2.1fc1a991-4a75-4409-9c61-e957d83c6813 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:01 devstack sudo[100643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c08c0373-6788-473f-adc8-c5dfabb001a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c08c0373-6788-473f-adc8-c5dfabb001a2.1fc1a991-4a75-4409-9c61-e957d83c6813 1G Sep 03 14:29:01 devstack sudo[100643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:01 devstack sudo[100643]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5f8abc45-fc55-40dd-82dc-2bd48f7a8da7 tempest-VolumesSnapshotTestJSON-595514335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c08c0373-6788-473f-adc8-c5dfabb001a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c08c0373-6788-473f-adc8-c5dfabb001a2.1fc1a991-4a75-4409-9c61-e957d83c6813 1G" returned: 0 in 0.573s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5f8abc45-fc55-40dd-82dc-2bd48f7a8da7 tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c08c0373-6788-473f-adc8-c5dfabb001a2 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c08c0373-6788-473f-adc8-c5dfabb001a2.1fc1a991-4a75-4409-9c61-e957d83c6813 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:01 devstack sudo[100648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c08c0373-6788-473f-adc8-c5dfabb001a2 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c08c0373-6788-473f-adc8-c5dfabb001a2.1fc1a991-4a75-4409-9c61-e957d83c6813 Sep 03 14:29:01 devstack sudo[100648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:02 devstack sudo[100648]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5f8abc45-fc55-40dd-82dc-2bd48f7a8da7 tempest-VolumesSnapshotTestJSON-595514335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c08c0373-6788-473f-adc8-c5dfabb001a2 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c08c0373-6788-473f-adc8-c5dfabb001a2.1fc1a991-4a75-4409-9c61-e957d83c6813" returned: 0 in 0.390s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:02 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-5f8abc45-fc55-40dd-82dc-2bd48f7a8da7 tempest-VolumesSnapshotTestJSON-595514335 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c08c0373-6788-473f-adc8-c5dfabb001a2.1fc1a991-4a75-4409-9c61-e957d83c6813 is being set with open permissions: ugo+rw Sep 03 14:29:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5f8abc45-fc55-40dd-82dc-2bd48f7a8da7 tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c08c0373-6788-473f-adc8-c5dfabb001a2.1fc1a991-4a75-4409-9c61-e957d83c6813 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:02 devstack sudo[100654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c08c0373-6788-473f-adc8-c5dfabb001a2.1fc1a991-4a75-4409-9c61-e957d83c6813 Sep 03 14:29:02 devstack sudo[100654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:02 devstack sudo[100654]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5f8abc45-fc55-40dd-82dc-2bd48f7a8da7 tempest-VolumesSnapshotTestJSON-595514335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c08c0373-6788-473f-adc8-c5dfabb001a2.1fc1a991-4a75-4409-9c61-e957d83c6813" returned: 0 in 0.334s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5f8abc45-fc55-40dd-82dc-2bd48f7a8da7 tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c08c0373-6788-473f-adc8-c5dfabb001a2.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:02 devstack sudo[100657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c08c0373-6788-473f-adc8-c5dfabb001a2.info Sep 03 14:29:02 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:02 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5f8abc45-fc55-40dd-82dc-2bd48f7a8da7 tempest-VolumesSnapshotTestJSON-595514335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c08c0373-6788-473f-adc8-c5dfabb001a2.info" returned: 0 in 0.386s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:02 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-5f8abc45-fc55-40dd-82dc-2bd48f7a8da7 tempest-VolumesSnapshotTestJSON-595514335 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c08c0373-6788-473f-adc8-c5dfabb001a2.info is being set with open permissions: ugo+rw Sep 03 14:29:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5f8abc45-fc55-40dd-82dc-2bd48f7a8da7 tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c08c0373-6788-473f-adc8-c5dfabb001a2.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:02 devstack sudo[100660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c08c0373-6788-473f-adc8-c5dfabb001a2.info Sep 03 14:29:02 devstack sudo[100660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:03 devstack sudo[100660]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5f8abc45-fc55-40dd-82dc-2bd48f7a8da7 tempest-VolumesSnapshotTestJSON-595514335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c08c0373-6788-473f-adc8-c5dfabb001a2.info" returned: 0 in 0.396s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-5f8abc45-fc55-40dd-82dc-2bd48f7a8da7 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.812s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:29:03 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-01401fc5-5a08-4612-998d-92308e6c3a53 tempest-VolumesGetTest-994288544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:29:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-01401fc5-5a08-4612-998d-92308e6c3a53 tempest-VolumesGetTest-994288544 None] Flow 'volume_create_manager' (96610ab9-b802-44ef-8648-14f8dcb29e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:29:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-01401fc5-5a08-4612-998d-92308e6c3a53 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b3c3b7b-3302-4cd2-8d02-5d137d1309a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-01401fc5-5a08-4612-998d-92308e6c3a53 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b3c3b7b-3302-4cd2-8d02-5d137d1309a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2076591723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02f98e49-167b-4952-9ffd-212f3351545a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fdbced0b6bfb442a8fb0d5a0226b4a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:29:03Z,use_quota=True,user_id='b12dc60960114a4c90eefc4a785d7a38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-01401fc5-5a08-4612-998d-92308e6c3a53 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb1d199e-49bd-4b21-a361-09ebe02d480d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-01401fc5-5a08-4612-998d-92308e6c3a53 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb1d199e-49bd-4b21-a361-09ebe02d480d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-01401fc5-5a08-4612-998d-92308e6c3a53 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6a37ef5-0701-41c4-b328-597ce7c401c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-01401fc5-5a08-4612-998d-92308e6c3a53 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6a37ef5-0701-41c4-b328-597ce7c401c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02f98e49-167b-4952-9ffd-212f3351545a', 'volume_name': 'volume-02f98e49-167b-4952-9ffd-212f3351545a', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-01401fc5-5a08-4612-998d-92308e6c3a53 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f14eb788-6cf7-4b2d-a909-12a422e751b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-01401fc5-5a08-4612-998d-92308e6c3a53 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f14eb788-6cf7-4b2d-a909-12a422e751b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-01401fc5-5a08-4612-998d-92308e6c3a53 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64ef6cd2-c6b2-4302-afbb-10b07cdb177d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:03 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-01401fc5-5a08-4612-998d-92308e6c3a53 tempest-VolumesGetTest-994288544 None] Volume 02f98e49-167b-4952-9ffd-212f3351545a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02f98e49-167b-4952-9ffd-212f3351545a', 'volume_size': 1} Sep 03 14:29:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-01401fc5-5a08-4612-998d-92308e6c3a53 tempest-VolumesGetTest-994288544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-01401fc5-5a08-4612-998d-92308e6c3a53 tempest-VolumesGetTest-994288544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:03 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-01401fc5-5a08-4612-998d-92308e6c3a53 tempest-VolumesGetTest-994288544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2076591723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02f98e49-167b-4952-9ffd-212f3351545a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fdbced0b6bfb442a8fb0d5a0226b4a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:29:03Z,use_quota=True,user_id='b12dc60960114a4c90eefc4a785d7a38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:29:03 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-01401fc5-5a08-4612-998d-92308e6c3a53 tempest-VolumesGetTest-994288544 None] Creating volume 02f98e49-167b-4952-9ffd-212f3351545a {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:29:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-01401fc5-5a08-4612-998d-92308e6c3a53 tempest-VolumesGetTest-994288544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-01401fc5-5a08-4612-998d-92308e6c3a53 tempest-VolumesGetTest-994288544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:03 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-01401fc5-5a08-4612-998d-92308e6c3a53 tempest-VolumesGetTest-994288544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:29:03 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-01401fc5-5a08-4612-998d-92308e6c3a53 tempest-VolumesGetTest-994288544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:29:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-01401fc5-5a08-4612-998d-92308e6c3a53 tempest-VolumesGetTest-994288544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:29:03 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-01401fc5-5a08-4612-998d-92308e6c3a53 tempest-VolumesGetTest-994288544 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:29:03 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-01401fc5-5a08-4612-998d-92308e6c3a53 tempest-VolumesGetTest-994288544 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:29:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-01401fc5-5a08-4612-998d-92308e6c3a53 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-02f98e49-167b-4952-9ffd-212f3351545a 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:03 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-5f8abc45-fc55-40dd-82dc-2bd48f7a8da7 tempest-VolumesSnapshotTestJSON-595514335 None] Create snapshot completed successfully Sep 03 14:29:03 devstack sudo[100663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-02f98e49-167b-4952-9ffd-212f3351545a 1073741824 Sep 03 14:29:03 devstack sudo[100663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:03 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-6442a1c0-01af-47aa-9cfd-5080f1075736 tempest-VolumesSnapshotTestJSON-595514335 None] Acquiring lock "cinder-1fc1a991-4a75-4409-9c61-e957d83c6813-delete_snapshot" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:29:03 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-6442a1c0-01af-47aa-9cfd-5080f1075736 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "cinder-1fc1a991-4a75-4409-9c61-e957d83c6813-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:29:04 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-6442a1c0-01af-47aa-9cfd-5080f1075736 tempest-VolumesSnapshotTestJSON-595514335 None] Acquiring lock "cinder-quobyte-c08c0373-6788-473f-adc8-c5dfabb001a2" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:29:04 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-6442a1c0-01af-47aa-9cfd-5080f1075736 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "cinder-quobyte-c08c0373-6788-473f-adc8-c5dfabb001a2" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:29:04 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-6442a1c0-01af-47aa-9cfd-5080f1075736 tempest-VolumesSnapshotTestJSON-595514335 None] Acquiring lock "cinder-quobyte-1fc1a991-4a75-4409-9c61-e957d83c6813" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:29:04 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-6442a1c0-01af-47aa-9cfd-5080f1075736 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "cinder-quobyte-1fc1a991-4a75-4409-9c61-e957d83c6813" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:29:04 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-6442a1c0-01af-47aa-9cfd-5080f1075736 tempest-VolumesSnapshotTestJSON-595514335 None] Deleting offline snapshot 1fc1a991-4a75-4409-9c61-e957d83c6813 of volume c08c0373-6788-473f-adc8-c5dfabb001a2 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:29:04 devstack sudo[100663]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:04 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-6442a1c0-01af-47aa-9cfd-5080f1075736 tempest-VolumesSnapshotTestJSON-595514335 None] snapshot_file for this snap is: volume-c08c0373-6788-473f-adc8-c5dfabb001a2.1fc1a991-4a75-4409-9c61-e957d83c6813 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:29:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-01401fc5-5a08-4612-998d-92308e6c3a53 tempest-VolumesGetTest-994288544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-02f98e49-167b-4952-9ffd-212f3351545a 1073741824" returned: 0 in 0.604s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:04 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6f8f35-0922-4dcf-ac46-dd744ce25e27]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:29:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6442a1c0-01af-47aa-9cfd-5080f1075736 tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c08c0373-6788-473f-adc8-c5dfabb001a2.1fc1a991-4a75-4409-9c61-e957d83c6813 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-01401fc5-5a08-4612-998d-92308e6c3a53 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-02f98e49-167b-4952-9ffd-212f3351545a {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:04 devstack sudo[100670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-02f98e49-167b-4952-9ffd-212f3351545a Sep 03 14:29:04 devstack sudo[100670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:04 devstack sudo[100669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c08c0373-6788-473f-adc8-c5dfabb001a2.1fc1a991-4a75-4409-9c61-e957d83c6813 Sep 03 14:29:04 devstack sudo[100669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:04 devstack sudo[100670]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-01401fc5-5a08-4612-998d-92308e6c3a53 tempest-VolumesGetTest-994288544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-02f98e49-167b-4952-9ffd-212f3351545a" returned: 0 in 0.335s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:04 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-01401fc5-5a08-4612-998d-92308e6c3a53 tempest-VolumesGetTest-994288544 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:29:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-01401fc5-5a08-4612-998d-92308e6c3a53 tempest-VolumesGetTest-994288544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:29:04 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-01401fc5-5a08-4612-998d-92308e6c3a53 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64ef6cd2-c6b2-4302-afbb-10b07cdb177d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02f98e49-167b-4952-9ffd-212f3351545a', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:04 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-01401fc5-5a08-4612-998d-92308e6c3a53 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73969b2d-54ad-484a-941c-12d33ca5b7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:04 devstack sudo[100669]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:04 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-01401fc5-5a08-4612-998d-92308e6c3a53 tempest-VolumesGetTest-994288544 None] Volume volume-02f98e49-167b-4952-9ffd-212f3351545a (02f98e49-167b-4952-9ffd-212f3351545a): created successfully Sep 03 14:29:04 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-01401fc5-5a08-4612-998d-92308e6c3a53 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73969b2d-54ad-484a-941c-12d33ca5b7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:04 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-01401fc5-5a08-4612-998d-92308e6c3a53 tempest-VolumesGetTest-994288544 None] Flow 'volume_create_manager' (96610ab9-b802-44ef-8648-14f8dcb29e71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:29:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6442a1c0-01af-47aa-9cfd-5080f1075736 tempest-VolumesSnapshotTestJSON-595514335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c08c0373-6788-473f-adc8-c5dfabb001a2.1fc1a991-4a75-4409-9c61-e957d83c6813" returned: 0 in 0.477s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:04 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-6442a1c0-01af-47aa-9cfd-5080f1075736 tempest-VolumesSnapshotTestJSON-595514335 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c08c0373-6788-473f-adc8-c5dfabb001a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:29:04 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-01401fc5-5a08-4612-998d-92308e6c3a53 tempest-VolumesGetTest-994288544 None] Created volume successfully. Sep 03 14:29:04 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72d6d6c-6610-435c-88d1-73d95967e066]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:29:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6442a1c0-01af-47aa-9cfd-5080f1075736 tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c08c0373-6788-473f-adc8-c5dfabb001a2 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:04 devstack sudo[100677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c08c0373-6788-473f-adc8-c5dfabb001a2 Sep 03 14:29:04 devstack sudo[100677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:05 devstack sudo[100677]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6442a1c0-01af-47aa-9cfd-5080f1075736 tempest-VolumesSnapshotTestJSON-595514335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c08c0373-6788-473f-adc8-c5dfabb001a2" returned: 0 in 0.458s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6442a1c0-01af-47aa-9cfd-5080f1075736 tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c08c0373-6788-473f-adc8-c5dfabb001a2.1fc1a991-4a75-4409-9c61-e957d83c6813 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:05 devstack sudo[100682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c08c0373-6788-473f-adc8-c5dfabb001a2.1fc1a991-4a75-4409-9c61-e957d83c6813 Sep 03 14:29:05 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:05 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6442a1c0-01af-47aa-9cfd-5080f1075736 tempest-VolumesSnapshotTestJSON-595514335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c08c0373-6788-473f-adc8-c5dfabb001a2.1fc1a991-4a75-4409-9c61-e957d83c6813" returned: 0 in 0.497s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6442a1c0-01af-47aa-9cfd-5080f1075736 tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c08c0373-6788-473f-adc8-c5dfabb001a2.1fc1a991-4a75-4409-9c61-e957d83c6813 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:05 devstack sudo[100688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c08c0373-6788-473f-adc8-c5dfabb001a2.1fc1a991-4a75-4409-9c61-e957d83c6813 Sep 03 14:29:05 devstack sudo[100688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:05 devstack sudo[100688]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6442a1c0-01af-47aa-9cfd-5080f1075736 tempest-VolumesSnapshotTestJSON-595514335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c08c0373-6788-473f-adc8-c5dfabb001a2.1fc1a991-4a75-4409-9c61-e957d83c6813" returned: 0 in 0.335s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:06 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-6442a1c0-01af-47aa-9cfd-5080f1075736 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "cinder-quobyte-1fc1a991-4a75-4409-9c61-e957d83c6813" released by "_delete_snapshot" :: held 1.968s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:29:06 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-6442a1c0-01af-47aa-9cfd-5080f1075736 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "cinder-quobyte-c08c0373-6788-473f-adc8-c5dfabb001a2" released by "delete_snapshot" :: held 2.012s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:29:06 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-6442a1c0-01af-47aa-9cfd-5080f1075736 tempest-VolumesSnapshotTestJSON-595514335 None] Created reservations ['1438a27d-86a2-420d-b6fb-013b0ede749a', '1c6a8025-49ba-4f4e-844b-d117c7e5ecd4', '63c05d79-03a6-4c6e-a7e9-ab3a2ca6c69f', '596d85b0-3c7e-49e4-9fb1-0bc47923c073'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:29:06 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-6442a1c0-01af-47aa-9cfd-5080f1075736 tempest-VolumesSnapshotTestJSON-595514335 None] Delete snapshot completed successfully. Sep 03 14:29:06 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-6442a1c0-01af-47aa-9cfd-5080f1075736 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "cinder-1fc1a991-4a75-4409-9c61-e957d83c6813-delete_snapshot" released by "delete_snapshot" :: held 2.340s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:29:06 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-54039f28-3e4d-4d88-9054-d61a534a5b57 tempest-VolumesGetTest-994288544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:29:06 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-54039f28-3e4d-4d88-9054-d61a534a5b57 tempest-VolumesGetTest-994288544 None] Flow 'volume_create_manager' (1cbb4670-323f-4c00-aa78-146d3e8b5b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:29:06 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-54039f28-3e4d-4d88-9054-d61a534a5b57 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41e5f70a-29e3-4137-b1c3-72b5baa2d08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:06 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-54039f28-3e4d-4d88-9054-d61a534a5b57 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41e5f70a-29e3-4137-b1c3-72b5baa2d08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:29:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-884578462',display_name='tempest-VolumesGetTest-Volume-1195492470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b0ea400-e6ff-4be4-9b70-2edf1668a7a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdbced0b6bfb442a8fb0d5a0226b4a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:29:06Z,use_quota=True,user_id='b12dc60960114a4c90eefc4a785d7a38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:06 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-54039f28-3e4d-4d88-9054-d61a534a5b57 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a164c477-22d6-4d9d-a5a4-aa38ad4608e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:06 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-54039f28-3e4d-4d88-9054-d61a534a5b57 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a164c477-22d6-4d9d-a5a4-aa38ad4608e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:06 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-54039f28-3e4d-4d88-9054-d61a534a5b57 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcc83e61-bd01-4605-9f6a-60da09d14e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:06 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-54039f28-3e4d-4d88-9054-d61a534a5b57 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcc83e61-bd01-4605-9f6a-60da09d14e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b0ea400-e6ff-4be4-9b70-2edf1668a7a8', 'volume_name': 'volume-7b0ea400-e6ff-4be4-9b70-2edf1668a7a8', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:06 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-54039f28-3e4d-4d88-9054-d61a534a5b57 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8ed59e6-7e4c-4ab8-92f5-11c4b58491cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:06 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-54039f28-3e4d-4d88-9054-d61a534a5b57 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8ed59e6-7e4c-4ab8-92f5-11c4b58491cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:06 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-54039f28-3e4d-4d88-9054-d61a534a5b57 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04edee3d-91e7-4fc3-9b67-2aa102e9a9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:06 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-54039f28-3e4d-4d88-9054-d61a534a5b57 tempest-VolumesGetTest-994288544 None] Volume 7b0ea400-e6ff-4be4-9b70-2edf1668a7a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b0ea400-e6ff-4be4-9b70-2edf1668a7a8', 'volume_size': 1} Sep 03 14:29:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-54039f28-3e4d-4d88-9054-d61a534a5b57 tempest-VolumesGetTest-994288544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-54039f28-3e4d-4d88-9054-d61a534a5b57 tempest-VolumesGetTest-994288544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:06 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-54039f28-3e4d-4d88-9054-d61a534a5b57 tempest-VolumesGetTest-994288544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:29:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-884578462',display_name='tempest-VolumesGetTest-Volume-1195492470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b0ea400-e6ff-4be4-9b70-2edf1668a7a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdbced0b6bfb442a8fb0d5a0226b4a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:29:06Z,use_quota=True,user_id='b12dc60960114a4c90eefc4a785d7a38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:29:06 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-54039f28-3e4d-4d88-9054-d61a534a5b57 tempest-VolumesGetTest-994288544 None] Creating volume 7b0ea400-e6ff-4be4-9b70-2edf1668a7a8 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:29:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-54039f28-3e4d-4d88-9054-d61a534a5b57 tempest-VolumesGetTest-994288544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-54039f28-3e4d-4d88-9054-d61a534a5b57 tempest-VolumesGetTest-994288544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:06 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-54039f28-3e4d-4d88-9054-d61a534a5b57 tempest-VolumesGetTest-994288544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:29:06 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-54039f28-3e4d-4d88-9054-d61a534a5b57 tempest-VolumesGetTest-994288544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:29:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-54039f28-3e4d-4d88-9054-d61a534a5b57 tempest-VolumesGetTest-994288544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:29:06 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-54039f28-3e4d-4d88-9054-d61a534a5b57 tempest-VolumesGetTest-994288544 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:29:06 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-54039f28-3e4d-4d88-9054-d61a534a5b57 tempest-VolumesGetTest-994288544 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:29:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-54039f28-3e4d-4d88-9054-d61a534a5b57 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7b0ea400-e6ff-4be4-9b70-2edf1668a7a8 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:06 devstack sudo[100726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7b0ea400-e6ff-4be4-9b70-2edf1668a7a8 1073741824 Sep 03 14:29:06 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:07 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-54039f28-3e4d-4d88-9054-d61a534a5b57 tempest-VolumesGetTest-994288544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7b0ea400-e6ff-4be4-9b70-2edf1668a7a8 1073741824" returned: 0 in 0.614s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-54039f28-3e4d-4d88-9054-d61a534a5b57 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7b0ea400-e6ff-4be4-9b70-2edf1668a7a8 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:07 devstack sudo[100734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7b0ea400-e6ff-4be4-9b70-2edf1668a7a8 Sep 03 14:29:07 devstack sudo[100734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:07 devstack sudo[100734]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-54039f28-3e4d-4d88-9054-d61a534a5b57 tempest-VolumesGetTest-994288544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7b0ea400-e6ff-4be4-9b70-2edf1668a7a8" returned: 0 in 0.388s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:07 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-54039f28-3e4d-4d88-9054-d61a534a5b57 tempest-VolumesGetTest-994288544 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:29:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-54039f28-3e4d-4d88-9054-d61a534a5b57 tempest-VolumesGetTest-994288544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:29:07 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-54039f28-3e4d-4d88-9054-d61a534a5b57 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04edee3d-91e7-4fc3-9b67-2aa102e9a9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b0ea400-e6ff-4be4-9b70-2edf1668a7a8', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:07 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-54039f28-3e4d-4d88-9054-d61a534a5b57 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8980d3ba-1901-4c03-9d83-ee719828b904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:07 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-54039f28-3e4d-4d88-9054-d61a534a5b57 tempest-VolumesGetTest-994288544 None] Volume volume-7b0ea400-e6ff-4be4-9b70-2edf1668a7a8 (7b0ea400-e6ff-4be4-9b70-2edf1668a7a8): created successfully Sep 03 14:29:07 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-54039f28-3e4d-4d88-9054-d61a534a5b57 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8980d3ba-1901-4c03-9d83-ee719828b904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:07 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-54039f28-3e4d-4d88-9054-d61a534a5b57 tempest-VolumesGetTest-994288544 None] Flow 'volume_create_manager' (1cbb4670-323f-4c00-aa78-146d3e8b5b83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:29:07 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-54039f28-3e4d-4d88-9054-d61a534a5b57 tempest-VolumesGetTest-994288544 None] Created volume successfully. Sep 03 14:29:07 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-fab980bd-f6f6-4a19-87d5-6f033fb2a6ab tempest-VolumesSnapshotTestJSON-595514335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:29:07 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fab980bd-f6f6-4a19-87d5-6f033fb2a6ab tempest-VolumesSnapshotTestJSON-595514335 None] Flow 'volume_create_manager' (9d57bd78-e11d-4449-8ff7-0ec1029c29e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:29:07 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fab980bd-f6f6-4a19-87d5-6f033fb2a6ab tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ef3afa3-f3cb-4231-9a9d-5edfeefb9c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:08 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fab980bd-f6f6-4a19-87d5-6f033fb2a6ab tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ef3afa3-f3cb-4231-9a9d-5edfeefb9c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-13624850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef5a1c13-b4fc-4282-b4c4-85bd505c18ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41da579dea614d719a655b998f608b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:29:08Z,use_quota=True,user_id='efad3035689f423d9267d2e66d9a3cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:08 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fab980bd-f6f6-4a19-87d5-6f033fb2a6ab tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f668ce76-83a7-4904-8f9e-bf78d3e14201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:08 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fab980bd-f6f6-4a19-87d5-6f033fb2a6ab tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f668ce76-83a7-4904-8f9e-bf78d3e14201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:08 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fab980bd-f6f6-4a19-87d5-6f033fb2a6ab tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dac6b55f-89ca-487f-acdf-c57b569c91c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:08 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fab980bd-f6f6-4a19-87d5-6f033fb2a6ab tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dac6b55f-89ca-487f-acdf-c57b569c91c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef5a1c13-b4fc-4282-b4c4-85bd505c18ee', 'volume_name': 'volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:08 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fab980bd-f6f6-4a19-87d5-6f033fb2a6ab tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5523c428-b91f-4ae2-a19b-70af0d0d3201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:08 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fab980bd-f6f6-4a19-87d5-6f033fb2a6ab tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5523c428-b91f-4ae2-a19b-70af0d0d3201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:08 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fab980bd-f6f6-4a19-87d5-6f033fb2a6ab tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61420d57-7d32-4235-afe9-39c313fbbc0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:08 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-fab980bd-f6f6-4a19-87d5-6f033fb2a6ab tempest-VolumesSnapshotTestJSON-595514335 None] Volume ef5a1c13-b4fc-4282-b4c4-85bd505c18ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee', 'volume_size': 1} Sep 03 14:29:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-fab980bd-f6f6-4a19-87d5-6f033fb2a6ab tempest-VolumesSnapshotTestJSON-595514335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-fab980bd-f6f6-4a19-87d5-6f033fb2a6ab tempest-VolumesSnapshotTestJSON-595514335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:08 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-fab980bd-f6f6-4a19-87d5-6f033fb2a6ab tempest-VolumesSnapshotTestJSON-595514335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-13624850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef5a1c13-b4fc-4282-b4c4-85bd505c18ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41da579dea614d719a655b998f608b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:29:08Z,use_quota=True,user_id='efad3035689f423d9267d2e66d9a3cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:29:08 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-fab980bd-f6f6-4a19-87d5-6f033fb2a6ab tempest-VolumesSnapshotTestJSON-595514335 None] Creating volume ef5a1c13-b4fc-4282-b4c4-85bd505c18ee {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:29:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-fab980bd-f6f6-4a19-87d5-6f033fb2a6ab tempest-VolumesSnapshotTestJSON-595514335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-fab980bd-f6f6-4a19-87d5-6f033fb2a6ab tempest-VolumesSnapshotTestJSON-595514335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:08 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-fab980bd-f6f6-4a19-87d5-6f033fb2a6ab tempest-VolumesSnapshotTestJSON-595514335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:29:08 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-fab980bd-f6f6-4a19-87d5-6f033fb2a6ab tempest-VolumesSnapshotTestJSON-595514335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:29:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-fab980bd-f6f6-4a19-87d5-6f033fb2a6ab tempest-VolumesSnapshotTestJSON-595514335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:29:08 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-fab980bd-f6f6-4a19-87d5-6f033fb2a6ab tempest-VolumesSnapshotTestJSON-595514335 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:29:08 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-fab980bd-f6f6-4a19-87d5-6f033fb2a6ab tempest-VolumesSnapshotTestJSON-595514335 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:29:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fab980bd-f6f6-4a19-87d5-6f033fb2a6ab tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:08 devstack sudo[100737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee 1073741824 Sep 03 14:29:08 devstack sudo[100737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:08 devstack sudo[100737]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fab980bd-f6f6-4a19-87d5-6f033fb2a6ab tempest-VolumesSnapshotTestJSON-595514335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee 1073741824" returned: 0 in 0.567s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fab980bd-f6f6-4a19-87d5-6f033fb2a6ab tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:08 devstack sudo[100744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee Sep 03 14:29:08 devstack sudo[100744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:08 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-6027d511-8026-4361-8135-b859d6545401 tempest-VolumesGetTest-994288544 None] Acquiring lock "cinder-7b0ea400-e6ff-4be4-9b70-2edf1668a7a8-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:29:08 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-6027d511-8026-4361-8135-b859d6545401 tempest-VolumesGetTest-994288544 None] Lock "cinder-7b0ea400-e6ff-4be4-9b70-2edf1668a7a8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:29:08 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-6027d511-8026-4361-8135-b859d6545401 tempest-VolumesGetTest-994288544 None] Acquiring lock "cinder-quobyte-7b0ea400-e6ff-4be4-9b70-2edf1668a7a8" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:29:08 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-6027d511-8026-4361-8135-b859d6545401 tempest-VolumesGetTest-994288544 None] Lock "cinder-quobyte-7b0ea400-e6ff-4be4-9b70-2edf1668a7a8" acquired by "delete_volume" :: waited 0.016s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:29:08 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0ae0e7-00e4-4035-be3e-220e13c2c44a]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:29:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6027d511-8026-4361-8135-b859d6545401 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7b0ea400-e6ff-4be4-9b70-2edf1668a7a8 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:09 devstack sudo[100744]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fab980bd-f6f6-4a19-87d5-6f033fb2a6ab tempest-VolumesSnapshotTestJSON-595514335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee" returned: 0 in 0.396s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:09 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-fab980bd-f6f6-4a19-87d5-6f033fb2a6ab tempest-VolumesSnapshotTestJSON-595514335 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:29:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-fab980bd-f6f6-4a19-87d5-6f033fb2a6ab tempest-VolumesSnapshotTestJSON-595514335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:29:09 devstack sudo[100746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7b0ea400-e6ff-4be4-9b70-2edf1668a7a8 Sep 03 14:29:09 devstack sudo[100746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:09 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fab980bd-f6f6-4a19-87d5-6f033fb2a6ab tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61420d57-7d32-4235-afe9-39c313fbbc0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:09 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fab980bd-f6f6-4a19-87d5-6f033fb2a6ab tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d70892cb-efec-4549-b029-645fbaf22230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:09 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-fab980bd-f6f6-4a19-87d5-6f033fb2a6ab tempest-VolumesSnapshotTestJSON-595514335 None] Volume volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee (ef5a1c13-b4fc-4282-b4c4-85bd505c18ee): created successfully Sep 03 14:29:09 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fab980bd-f6f6-4a19-87d5-6f033fb2a6ab tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d70892cb-efec-4549-b029-645fbaf22230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:09 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fab980bd-f6f6-4a19-87d5-6f033fb2a6ab tempest-VolumesSnapshotTestJSON-595514335 None] Flow 'volume_create_manager' (9d57bd78-e11d-4449-8ff7-0ec1029c29e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:29:09 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-fab980bd-f6f6-4a19-87d5-6f033fb2a6ab tempest-VolumesSnapshotTestJSON-595514335 None] Created volume successfully. Sep 03 14:29:09 devstack sudo[100746]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6027d511-8026-4361-8135-b859d6545401 tempest-VolumesGetTest-994288544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7b0ea400-e6ff-4be4-9b70-2edf1668a7a8" returned: 0 in 0.505s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6027d511-8026-4361-8135-b859d6545401 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7b0ea400-e6ff-4be4-9b70-2edf1668a7a8 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:09 devstack sudo[100752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7b0ea400-e6ff-4be4-9b70-2edf1668a7a8 Sep 03 14:29:09 devstack sudo[100752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:09 devstack sudo[100752]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6027d511-8026-4361-8135-b859d6545401 tempest-VolumesGetTest-994288544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7b0ea400-e6ff-4be4-9b70-2edf1668a7a8" returned: 0 in 0.276s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:09 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-6027d511-8026-4361-8135-b859d6545401 tempest-VolumesGetTest-994288544 None] Lock "cinder-quobyte-7b0ea400-e6ff-4be4-9b70-2edf1668a7a8" released by "delete_volume" :: held 0.861s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:29:09 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-6027d511-8026-4361-8135-b859d6545401 tempest-VolumesGetTest-994288544 None] Created reservations ['6fb62851-3ff6-4be7-ae6c-9017e02973ca', 'eb782d64-0ddc-4184-a152-8350d766c9d9', 'a302ed5e-51a4-4970-b4b2-09718047cadb', '071e11c1-ecef-46df-8ffa-8fd2e6af3eb6'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:29:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6027d511-8026-4361-8135-b859d6545401 tempest-VolumesGetTest-994288544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6027d511-8026-4361-8135-b859d6545401 tempest-VolumesGetTest-994288544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:09 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-6027d511-8026-4361-8135-b859d6545401 tempest-VolumesGetTest-994288544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:29:09 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-6027d511-8026-4361-8135-b859d6545401 tempest-VolumesGetTest-994288544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:29:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6027d511-8026-4361-8135-b859d6545401 tempest-VolumesGetTest-994288544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:29:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6027d511-8026-4361-8135-b859d6545401 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:09 devstack sudo[100755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:29:09 devstack sudo[100755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:10 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a7227a21-1abf-48ab-9ddb-7371872d9387 tempest-VolumesGetTest-994288544 None] Acquiring lock "cinder-02f98e49-167b-4952-9ffd-212f3351545a-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:29:10 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a7227a21-1abf-48ab-9ddb-7371872d9387 tempest-VolumesGetTest-994288544 None] Lock "cinder-02f98e49-167b-4952-9ffd-212f3351545a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:29:10 devstack sudo[100755]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6027d511-8026-4361-8135-b859d6545401 tempest-VolumesGetTest-994288544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.368s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:10 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-6027d511-8026-4361-8135-b859d6545401 tempest-VolumesGetTest-994288544 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:29:10 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-6027d511-8026-4361-8135-b859d6545401 tempest-VolumesGetTest-994288544 None] Deleted volume successfully. Sep 03 14:29:10 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-6027d511-8026-4361-8135-b859d6545401 tempest-VolumesGetTest-994288544 None] Lock "cinder-7b0ea400-e6ff-4be4-9b70-2edf1668a7a8-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:29:10 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a7227a21-1abf-48ab-9ddb-7371872d9387 tempest-VolumesGetTest-994288544 None] Acquiring lock "cinder-quobyte-02f98e49-167b-4952-9ffd-212f3351545a" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:29:10 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a7227a21-1abf-48ab-9ddb-7371872d9387 tempest-VolumesGetTest-994288544 None] Lock "cinder-quobyte-02f98e49-167b-4952-9ffd-212f3351545a" acquired by "delete_volume" :: waited 0.024s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:29:10 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75c5fc0-9c3c-4a4e-996c-4d0b8af22a28]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:29:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a7227a21-1abf-48ab-9ddb-7371872d9387 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-02f98e49-167b-4952-9ffd-212f3351545a {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:10 devstack sudo[100758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-02f98e49-167b-4952-9ffd-212f3351545a Sep 03 14:29:10 devstack sudo[100758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4e74e5b8-271a-442b-9528-46c08027f22e tempest-VolumesSnapshotTestJSON-595514335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4e74e5b8-271a-442b-9528-46c08027f22e tempest-VolumesSnapshotTestJSON-595514335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:10 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-4e74e5b8-271a-442b-9528-46c08027f22e tempest-VolumesSnapshotTestJSON-595514335 None] Creating offline snapshot b817578a-711a-449c-a8f4-f97b32b4a744 of volume ef5a1c13-b4fc-4282-b4c4-85bd505c18ee {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:29:10 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ad8600-fe5f-4371-bfc2-449e309e4537]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:29:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4e74e5b8-271a-442b-9528-46c08027f22e tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:10 devstack sudo[100760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee Sep 03 14:29:10 devstack sudo[100760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:11 devstack sudo[100758]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a7227a21-1abf-48ab-9ddb-7371872d9387 tempest-VolumesGetTest-994288544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-02f98e49-167b-4952-9ffd-212f3351545a" returned: 0 in 0.633s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a7227a21-1abf-48ab-9ddb-7371872d9387 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-02f98e49-167b-4952-9ffd-212f3351545a {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:11 devstack sudo[100767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-02f98e49-167b-4952-9ffd-212f3351545a Sep 03 14:29:11 devstack sudo[100767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:11 devstack sudo[100760]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4e74e5b8-271a-442b-9528-46c08027f22e tempest-VolumesSnapshotTestJSON-595514335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee" returned: 0 in 0.515s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4e74e5b8-271a-442b-9528-46c08027f22e tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee.b817578a-711a-449c-a8f4-f97b32b4a744 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:11 devstack sudo[100772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee.b817578a-711a-449c-a8f4-f97b32b4a744 1G Sep 03 14:29:11 devstack sudo[100772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:11 devstack sudo[100767]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a7227a21-1abf-48ab-9ddb-7371872d9387 tempest-VolumesGetTest-994288544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-02f98e49-167b-4952-9ffd-212f3351545a" returned: 0 in 0.500s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:11 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a7227a21-1abf-48ab-9ddb-7371872d9387 tempest-VolumesGetTest-994288544 None] Lock "cinder-quobyte-02f98e49-167b-4952-9ffd-212f3351545a" released by "delete_volume" :: held 1.205s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:29:11 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-a7227a21-1abf-48ab-9ddb-7371872d9387 tempest-VolumesGetTest-994288544 None] Created reservations ['974e25ba-092b-4943-b5a8-9c28caae52de', '5300fa40-6029-4de9-bc91-2973684c343d', '83c7b2bc-77eb-4389-8796-be420b3ff5a4', '6908fd30-771a-4d0d-afbd-c46cff7bc508'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:29:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a7227a21-1abf-48ab-9ddb-7371872d9387 tempest-VolumesGetTest-994288544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a7227a21-1abf-48ab-9ddb-7371872d9387 tempest-VolumesGetTest-994288544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:11 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a7227a21-1abf-48ab-9ddb-7371872d9387 tempest-VolumesGetTest-994288544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:29:11 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a7227a21-1abf-48ab-9ddb-7371872d9387 tempest-VolumesGetTest-994288544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:29:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a7227a21-1abf-48ab-9ddb-7371872d9387 tempest-VolumesGetTest-994288544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:29:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a7227a21-1abf-48ab-9ddb-7371872d9387 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:11 devstack sudo[100772]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4e74e5b8-271a-442b-9528-46c08027f22e tempest-VolumesSnapshotTestJSON-595514335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee.b817578a-711a-449c-a8f4-f97b32b4a744 1G" returned: 0 in 0.621s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4e74e5b8-271a-442b-9528-46c08027f22e tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee.b817578a-711a-449c-a8f4-f97b32b4a744 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:11 devstack sudo[100779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee.b817578a-711a-449c-a8f4-f97b32b4a744 Sep 03 14:29:11 devstack sudo[100778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:29:11 devstack sudo[100779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:11 devstack sudo[100778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:12 devstack sudo[100778]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a7227a21-1abf-48ab-9ddb-7371872d9387 tempest-VolumesGetTest-994288544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.358s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:12 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-a7227a21-1abf-48ab-9ddb-7371872d9387 tempest-VolumesGetTest-994288544 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:29:12 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-a7227a21-1abf-48ab-9ddb-7371872d9387 tempest-VolumesGetTest-994288544 None] Deleted volume successfully. Sep 03 14:29:12 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a7227a21-1abf-48ab-9ddb-7371872d9387 tempest-VolumesGetTest-994288544 None] Lock "cinder-02f98e49-167b-4952-9ffd-212f3351545a-delete_volume" released by "delete_volume" :: held 1.960s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:29:12 devstack sudo[100779]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4e74e5b8-271a-442b-9528-46c08027f22e tempest-VolumesSnapshotTestJSON-595514335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee.b817578a-711a-449c-a8f4-f97b32b4a744" returned: 0 in 0.427s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:12 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-4e74e5b8-271a-442b-9528-46c08027f22e tempest-VolumesSnapshotTestJSON-595514335 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee.b817578a-711a-449c-a8f4-f97b32b4a744 is being set with open permissions: ugo+rw Sep 03 14:29:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4e74e5b8-271a-442b-9528-46c08027f22e tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee.b817578a-711a-449c-a8f4-f97b32b4a744 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:12 devstack sudo[100786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee.b817578a-711a-449c-a8f4-f97b32b4a744 Sep 03 14:29:12 devstack sudo[100786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:12 devstack sudo[100786]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4e74e5b8-271a-442b-9528-46c08027f22e tempest-VolumesSnapshotTestJSON-595514335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee.b817578a-711a-449c-a8f4-f97b32b4a744" returned: 0 in 0.290s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4e74e5b8-271a-442b-9528-46c08027f22e tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:12 devstack sudo[100789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee.info Sep 03 14:29:12 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:13 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4e74e5b8-271a-442b-9528-46c08027f22e tempest-VolumesSnapshotTestJSON-595514335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee.info" returned: 0 in 0.461s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:13 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-4e74e5b8-271a-442b-9528-46c08027f22e tempest-VolumesSnapshotTestJSON-595514335 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee.info is being set with open permissions: ugo+rw Sep 03 14:29:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4e74e5b8-271a-442b-9528-46c08027f22e tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:13 devstack sudo[100793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee.info Sep 03 14:29:13 devstack sudo[100793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:13 devstack sudo[100793]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4e74e5b8-271a-442b-9528-46c08027f22e tempest-VolumesSnapshotTestJSON-595514335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee.info" returned: 0 in 0.333s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4e74e5b8-271a-442b-9528-46c08027f22e tempest-VolumesSnapshotTestJSON-595514335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.802s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:29:13 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:UPDATE=173,cinder:DELETE=15,cinder:SELECT=146,cinder:INSERT=37 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:29:13 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0d20dc4-6baf-4d06-bb72-940c1e5fe1d0 tempest-SnapshotMetadataTestJSON-351695960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:29:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d0d20dc4-6baf-4d06-bb72-940c1e5fe1d0 tempest-SnapshotMetadataTestJSON-351695960 None] Flow 'volume_create_manager' (dba9ff61-8ecf-4db9-a581-d3da6d551b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:29:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d0d20dc4-6baf-4d06-bb72-940c1e5fe1d0 tempest-SnapshotMetadataTestJSON-351695960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f655b2-264b-4591-9b91-1ace07f0d4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:13 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-4e74e5b8-271a-442b-9528-46c08027f22e tempest-VolumesSnapshotTestJSON-595514335 None] Create snapshot completed successfully Sep 03 14:29:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d0d20dc4-6baf-4d06-bb72-940c1e5fe1d0 tempest-SnapshotMetadataTestJSON-351695960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f655b2-264b-4591-9b91-1ace07f0d4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:29:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1704653689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2335204e-3996-4b21-9dd1-72433666357c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b94487bc9bb4f0d88bfc409e0c43590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:29:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:29:13Z,use_quota=True,user_id='bce30c0bd0c949ddb970225e8d407ecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d0d20dc4-6baf-4d06-bb72-940c1e5fe1d0 tempest-SnapshotMetadataTestJSON-351695960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5ef37c3-9a6a-48c2-81e2-c876d441a0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d0d20dc4-6baf-4d06-bb72-940c1e5fe1d0 tempest-SnapshotMetadataTestJSON-351695960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5ef37c3-9a6a-48c2-81e2-c876d441a0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d0d20dc4-6baf-4d06-bb72-940c1e5fe1d0 tempest-SnapshotMetadataTestJSON-351695960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d90835a8-20b8-4305-9ce2-43ca48050156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d0d20dc4-6baf-4d06-bb72-940c1e5fe1d0 tempest-SnapshotMetadataTestJSON-351695960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d90835a8-20b8-4305-9ce2-43ca48050156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2335204e-3996-4b21-9dd1-72433666357c', 'volume_name': 'volume-2335204e-3996-4b21-9dd1-72433666357c', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d0d20dc4-6baf-4d06-bb72-940c1e5fe1d0 tempest-SnapshotMetadataTestJSON-351695960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bb2f151-d900-44e4-9a86-ccde481c7d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d0d20dc4-6baf-4d06-bb72-940c1e5fe1d0 tempest-SnapshotMetadataTestJSON-351695960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bb2f151-d900-44e4-9a86-ccde481c7d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d0d20dc4-6baf-4d06-bb72-940c1e5fe1d0 tempest-SnapshotMetadataTestJSON-351695960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe0d9cba-838d-478a-9940-33173e68fb41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:13 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-d0d20dc4-6baf-4d06-bb72-940c1e5fe1d0 tempest-SnapshotMetadataTestJSON-351695960 None] Volume 2335204e-3996-4b21-9dd1-72433666357c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2335204e-3996-4b21-9dd1-72433666357c', 'volume_size': 1} Sep 03 14:29:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d0d20dc4-6baf-4d06-bb72-940c1e5fe1d0 tempest-SnapshotMetadataTestJSON-351695960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d0d20dc4-6baf-4d06-bb72-940c1e5fe1d0 tempest-SnapshotMetadataTestJSON-351695960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:13 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d0d20dc4-6baf-4d06-bb72-940c1e5fe1d0 tempest-SnapshotMetadataTestJSON-351695960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:29:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1704653689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2335204e-3996-4b21-9dd1-72433666357c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b94487bc9bb4f0d88bfc409e0c43590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:29:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:29:13Z,use_quota=True,user_id='bce30c0bd0c949ddb970225e8d407ecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:29:13 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-d0d20dc4-6baf-4d06-bb72-940c1e5fe1d0 tempest-SnapshotMetadataTestJSON-351695960 None] Creating volume 2335204e-3996-4b21-9dd1-72433666357c {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:29:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d0d20dc4-6baf-4d06-bb72-940c1e5fe1d0 tempest-SnapshotMetadataTestJSON-351695960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d0d20dc4-6baf-4d06-bb72-940c1e5fe1d0 tempest-SnapshotMetadataTestJSON-351695960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:13 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d0d20dc4-6baf-4d06-bb72-940c1e5fe1d0 tempest-SnapshotMetadataTestJSON-351695960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:29:13 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d0d20dc4-6baf-4d06-bb72-940c1e5fe1d0 tempest-SnapshotMetadataTestJSON-351695960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:29:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d0d20dc4-6baf-4d06-bb72-940c1e5fe1d0 tempest-SnapshotMetadataTestJSON-351695960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:29:13 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d0d20dc4-6baf-4d06-bb72-940c1e5fe1d0 tempest-SnapshotMetadataTestJSON-351695960 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:29:13 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-d0d20dc4-6baf-4d06-bb72-940c1e5fe1d0 tempest-SnapshotMetadataTestJSON-351695960 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:29:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d0d20dc4-6baf-4d06-bb72-940c1e5fe1d0 tempest-SnapshotMetadataTestJSON-351695960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2335204e-3996-4b21-9dd1-72433666357c 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:13 devstack sudo[100797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2335204e-3996-4b21-9dd1-72433666357c 1073741824 Sep 03 14:29:13 devstack sudo[100797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:13 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6b6ffb5-526b-44dc-85a7-51ccf7d6b423 tempest-VolumesGetTest-994288544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:29:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b6b6ffb5-526b-44dc-85a7-51ccf7d6b423 tempest-VolumesGetTest-994288544 None] Flow 'volume_create_manager' (bb9f82b0-b5f7-4e64-a1ce-bf1dc0f4e37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:29:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b6b6ffb5-526b-44dc-85a7-51ccf7d6b423 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bb3db92-731e-4071-8005-f5bd7617468e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b6b6ffb5-526b-44dc-85a7-51ccf7d6b423 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bb3db92-731e-4071-8005-f5bd7617468e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:29:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1842967135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64389e37-9577-45c9-af98-2af0e4b37aec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdbced0b6bfb442a8fb0d5a0226b4a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:29:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:29:13Z,use_quota=True,user_id='b12dc60960114a4c90eefc4a785d7a38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b6b6ffb5-526b-44dc-85a7-51ccf7d6b423 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bb75f72-7a6e-4d25-8756-65e7b9bfdf0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b6b6ffb5-526b-44dc-85a7-51ccf7d6b423 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bb75f72-7a6e-4d25-8756-65e7b9bfdf0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b6b6ffb5-526b-44dc-85a7-51ccf7d6b423 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6411f261-68be-4b43-ad82-155b97b07da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b6b6ffb5-526b-44dc-85a7-51ccf7d6b423 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6411f261-68be-4b43-ad82-155b97b07da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64389e37-9577-45c9-af98-2af0e4b37aec', 'volume_name': 'volume-64389e37-9577-45c9-af98-2af0e4b37aec', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b6b6ffb5-526b-44dc-85a7-51ccf7d6b423 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0b1ba22-3dfd-4ecf-94f1-4e3a293e516c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b6b6ffb5-526b-44dc-85a7-51ccf7d6b423 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0b1ba22-3dfd-4ecf-94f1-4e3a293e516c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b6b6ffb5-526b-44dc-85a7-51ccf7d6b423 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (839ec09f-f939-416e-a8bc-689ce10f7ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:13 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-b6b6ffb5-526b-44dc-85a7-51ccf7d6b423 tempest-VolumesGetTest-994288544 None] Volume 64389e37-9577-45c9-af98-2af0e4b37aec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64389e37-9577-45c9-af98-2af0e4b37aec', 'volume_size': 1} Sep 03 14:29:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b6b6ffb5-526b-44dc-85a7-51ccf7d6b423 tempest-VolumesGetTest-994288544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:14 devstack sudo[100797]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d0d20dc4-6baf-4d06-bb72-940c1e5fe1d0 tempest-SnapshotMetadataTestJSON-351695960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2335204e-3996-4b21-9dd1-72433666357c 1073741824" returned: 0 in 0.487s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d0d20dc4-6baf-4d06-bb72-940c1e5fe1d0 tempest-SnapshotMetadataTestJSON-351695960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2335204e-3996-4b21-9dd1-72433666357c {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:14 devstack sudo[100802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2335204e-3996-4b21-9dd1-72433666357c Sep 03 14:29:14 devstack sudo[100802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:14 devstack sudo[100802]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d0d20dc4-6baf-4d06-bb72-940c1e5fe1d0 tempest-SnapshotMetadataTestJSON-351695960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2335204e-3996-4b21-9dd1-72433666357c" returned: 0 in 0.281s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d0d20dc4-6baf-4d06-bb72-940c1e5fe1d0 tempest-SnapshotMetadataTestJSON-351695960 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:29:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d0d20dc4-6baf-4d06-bb72-940c1e5fe1d0 tempest-SnapshotMetadataTestJSON-351695960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:29:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b6b6ffb5-526b-44dc-85a7-51ccf7d6b423 tempest-VolumesGetTest-994288544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.688s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b6b6ffb5-526b-44dc-85a7-51ccf7d6b423 tempest-VolumesGetTest-994288544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:29:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1842967135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64389e37-9577-45c9-af98-2af0e4b37aec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdbced0b6bfb442a8fb0d5a0226b4a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:29:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:29:13Z,use_quota=True,user_id='b12dc60960114a4c90eefc4a785d7a38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:29:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-b6b6ffb5-526b-44dc-85a7-51ccf7d6b423 tempest-VolumesGetTest-994288544 None] Creating volume 64389e37-9577-45c9-af98-2af0e4b37aec {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:29:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b6b6ffb5-526b-44dc-85a7-51ccf7d6b423 tempest-VolumesGetTest-994288544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b6b6ffb5-526b-44dc-85a7-51ccf7d6b423 tempest-VolumesGetTest-994288544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b6b6ffb5-526b-44dc-85a7-51ccf7d6b423 tempest-VolumesGetTest-994288544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:29:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b6b6ffb5-526b-44dc-85a7-51ccf7d6b423 tempest-VolumesGetTest-994288544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:29:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b6b6ffb5-526b-44dc-85a7-51ccf7d6b423 tempest-VolumesGetTest-994288544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:29:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b6b6ffb5-526b-44dc-85a7-51ccf7d6b423 tempest-VolumesGetTest-994288544 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:29:14 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-b6b6ffb5-526b-44dc-85a7-51ccf7d6b423 tempest-VolumesGetTest-994288544 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:29:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b6b6ffb5-526b-44dc-85a7-51ccf7d6b423 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d0d20dc4-6baf-4d06-bb72-940c1e5fe1d0 tempest-SnapshotMetadataTestJSON-351695960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe0d9cba-838d-478a-9940-33173e68fb41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2335204e-3996-4b21-9dd1-72433666357c', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d0d20dc4-6baf-4d06-bb72-940c1e5fe1d0 tempest-SnapshotMetadataTestJSON-351695960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ab60695-f0d4-4ce6-a4a4-364985117152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:14 devstack sudo[100805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec 1073741824 Sep 03 14:29:14 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:14 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-d0d20dc4-6baf-4d06-bb72-940c1e5fe1d0 tempest-SnapshotMetadataTestJSON-351695960 None] Volume volume-2335204e-3996-4b21-9dd1-72433666357c (2335204e-3996-4b21-9dd1-72433666357c): created successfully Sep 03 14:29:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d0d20dc4-6baf-4d06-bb72-940c1e5fe1d0 tempest-SnapshotMetadataTestJSON-351695960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ab60695-f0d4-4ce6-a4a4-364985117152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d0d20dc4-6baf-4d06-bb72-940c1e5fe1d0 tempest-SnapshotMetadataTestJSON-351695960 None] Flow 'volume_create_manager' (dba9ff61-8ecf-4db9-a581-d3da6d551b69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:29:14 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-d0d20dc4-6baf-4d06-bb72-940c1e5fe1d0 tempest-SnapshotMetadataTestJSON-351695960 None] Created volume successfully. Sep 03 14:29:14 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:29:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Flow 'volume_create_manager' (7085b054-ced7-433c-b086-dec040d50504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:29:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d21b67da-8c73-4da5-b23a-7f93ad42b376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d21b67da-8c73-4da5-b23a-7f93ad42b376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1491948923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfac50ff-33b3-48dc-bfd8-01dcbd8c7c23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41da579dea614d719a655b998f608b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:29:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=b817578a-711a-449c-a8f4-f97b32b4a744,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:29:15Z,use_quota=True,user_id='efad3035689f423d9267d2e66d9a3cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6334bde-ada4-4c91-a34e-692e887baba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6334bde-ada4-4c91-a34e-692e887baba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a707fac8-617d-4b4e-9c49-eab3571d06a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a707fac8-617d-4b4e-9c49-eab3571d06a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bfac50ff-33b3-48dc-bfd8-01dcbd8c7c23', 'volume_name': 'volume-bfac50ff-33b3-48dc-bfd8-01dcbd8c7c23', 'volume_size': 2, 'snapshot_id': 'b817578a-711a-449c-a8f4-f97b32b4a744'}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b55d3e7e-dff4-47df-b2f1-54c4dcdae9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b55d3e7e-dff4-47df-b2f1-54c4dcdae9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a5079a8-350f-4bf7-bbcc-d539963fdfc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:14 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Volume bfac50ff-33b3-48dc-bfd8-01dcbd8c7c23: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bfac50ff-33b3-48dc-bfd8-01dcbd8c7c23', 'volume_size': 2, 'snapshot_id': 'b817578a-711a-449c-a8f4-f97b32b4a744'} Sep 03 14:29:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:14 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b6b6ffb5-526b-44dc-85a7-51ccf7d6b423 tempest-VolumesGetTest-994288544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec 1073741824" returned: 0 in 0.559s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b6b6ffb5-526b-44dc-85a7-51ccf7d6b423 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:15 devstack sudo[100811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec Sep 03 14:29:15 devstack sudo[100811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:15 devstack sudo[100811]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b6b6ffb5-526b-44dc-85a7-51ccf7d6b423 tempest-VolumesGetTest-994288544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec" returned: 0 in 0.297s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:15 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b6b6ffb5-526b-44dc-85a7-51ccf7d6b423 tempest-VolumesGetTest-994288544 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:29:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b6b6ffb5-526b-44dc-85a7-51ccf7d6b423 tempest-VolumesGetTest-994288544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:29:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.428s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:15 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Acquiring lock "cinder-quobyte-b817578a-711a-449c-a8f4-f97b32b4a744-bfac50ff-33b3-48dc-bfd8-01dcbd8c7c23" by "_create_volume_from_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:29:15 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b6b6ffb5-526b-44dc-85a7-51ccf7d6b423 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (839ec09f-f939-416e-a8bc-689ce10f7ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64389e37-9577-45c9-af98-2af0e4b37aec', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:15 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b6b6ffb5-526b-44dc-85a7-51ccf7d6b423 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59c04660-203c-4e8a-aa24-b02eb2f1dc6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:15 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-b6b6ffb5-526b-44dc-85a7-51ccf7d6b423 tempest-VolumesGetTest-994288544 None] Volume volume-64389e37-9577-45c9-af98-2af0e4b37aec (64389e37-9577-45c9-af98-2af0e4b37aec): created successfully Sep 03 14:29:15 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b6b6ffb5-526b-44dc-85a7-51ccf7d6b423 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59c04660-203c-4e8a-aa24-b02eb2f1dc6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:15 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b6b6ffb5-526b-44dc-85a7-51ccf7d6b423 tempest-VolumesGetTest-994288544 None] Flow 'volume_create_manager' (bb9f82b0-b5f7-4e64-a1ce-bf1dc0f4e37c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:29:15 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Lock "cinder-quobyte-b817578a-711a-449c-a8f4-f97b32b4a744-bfac50ff-33b3-48dc-bfd8-01dcbd8c7c23" acquired by "_create_volume_from_snapshot" :: waited 0.067s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:29:15 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Creating volume bfac50ff-33b3-48dc-bfd8-01dcbd8c7c23 from snapshot b817578a-711a-449c-a8f4-f97b32b4a744 {{(pid=87007) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 14:29:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:15 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:29:15 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:29:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:29:15 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:29:15 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Acquiring lock "cinder-quobyte-bfac50ff-33b3-48dc-bfd8-01dcbd8c7c23" by "_copy_volume_from_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:29:15 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-b6b6ffb5-526b-44dc-85a7-51ccf7d6b423 tempest-VolumesGetTest-994288544 None] Created volume successfully. Sep 03 14:29:15 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Lock "cinder-quobyte-bfac50ff-33b3-48dc-bfd8-01dcbd8c7c23" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:29:15 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] snapshot: b817578a-711a-449c-a8f4-f97b32b4a744, volume: bfac50ff-33b3-48dc-bfd8-01dcbd8c7c23, {{(pid=87007) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 14:29:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:15 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:29:15 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:29:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:29:15 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd25728-cd83-4bbd-97f6-712855baf83d]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:29:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee.b817578a-711a-449c-a8f4-f97b32b4a744 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d716102f-0d75-46fc-8309-75486c27283d tempest-SnapshotMetadataTestJSON-351695960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:15 devstack sudo[100814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee.b817578a-711a-449c-a8f4-f97b32b4a744 Sep 03 14:29:15 devstack sudo[100814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:15 devstack sudo[100814]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee.b817578a-711a-449c-a8f4-f97b32b4a744" returned: 0 in 0.376s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:15 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:29:15 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[872f638d-7853-465c-b84b-c8d51154fe21]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:29:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:16 devstack sudo[100819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee Sep 03 14:29:16 devstack sudo[100819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:16 devstack sudo[100819]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee" returned: 0 in 0.414s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:16 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee {{(pid=87007) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 14:29:16 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Creating direct copy from snapshot {{(pid=87007) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 14:29:16 devstack cinder-volume[87007]: DEBUG cinder.utils [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Path /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bfac50ff-33b3-48dc-bfd8-01dcbd8c7c23 not found in is_blk_device check {{(pid=87007) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 14:29:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bfac50ff-33b3-48dc-bfd8-01dcbd8c7c23 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:16 devstack sudo[100825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bfac50ff-33b3-48dc-bfd8-01dcbd8c7c23 Sep 03 14:29:16 devstack sudo[100825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:17 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:29:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Flow 'volume_create_manager' (bf201a2f-b0dc-48a1-a293-12c168177d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:29:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be1caae4-b219-4344-a75a-9cbade1aac75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be1caae4-b219-4344-a75a-9cbade1aac75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:29:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1159431396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d13fa8ba-26a4-4356-b7de-37a10b35ff77,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fdbced0b6bfb442a8fb0d5a0226b4a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:29:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=64389e37-9577-45c9-af98-2af0e4b37aec,status='creating',terminated_at=None,updated_at=2026-09-03T12:29:17Z,use_quota=True,user_id='b12dc60960114a4c90eefc4a785d7a38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be973fe9-3c54-4360-b6d6-cd1bb169a801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be973fe9-3c54-4360-b6d6-cd1bb169a801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a109fc18-8e30-4767-8794-77d35d294aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a109fc18-8e30-4767-8794-77d35d294aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd13fa8ba-26a4-4356-b7de-37a10b35ff77', 'volume_name': 'volume-d13fa8ba-26a4-4356-b7de-37a10b35ff77', 'volume_size': 1, 'source_volid': '64389e37-9577-45c9-af98-2af0e4b37aec', 'source_volstatus': 'available'}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c29ca154-7ccc-41b1-961c-26b3db636522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c29ca154-7ccc-41b1-961c-26b3db636522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4bef491-5d35-4b16-b417-970481b38564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:17 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Volume d13fa8ba-26a4-4356-b7de-37a10b35ff77: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d13fa8ba-26a4-4356-b7de-37a10b35ff77', 'volume_size': 1, 'source_volid': '64389e37-9577-45c9-af98-2af0e4b37aec', 'source_volstatus': 'available'} Sep 03 14:29:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:21 devstack sudo[100825]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bfac50ff-33b3-48dc-bfd8-01dcbd8c7c23" returned: 0 in 5.498s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:21 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Image conversion details: src /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee, size 1024.00 MB, duration 5.50 sec, destination /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bfac50ff-33b3-48dc-bfd8-01dcbd8c7c23 {{(pid=87007) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 14:29:21 devstack cinder-volume[87007]: INFO cinder.image.image_utils [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Converted 1024.00 MB image at 186.22 MB/s Sep 03 14:29:21 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bfac50ff-33b3-48dc-bfd8-01dcbd8c7c23 is being set with open permissions: ugo+rw Sep 03 14:29:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bfac50ff-33b3-48dc-bfd8-01dcbd8c7c23 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:21 devstack sudo[100840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bfac50ff-33b3-48dc-bfd8-01dcbd8c7c23 Sep 03 14:29:21 devstack sudo[100840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:22 devstack sudo[100840]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bfac50ff-33b3-48dc-bfd8-01dcbd8c7c23" returned: 0 in 0.265s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Lock "cinder-quobyte-bfac50ff-33b3-48dc-bfd8-01dcbd8c7c23" released by "_copy_volume_from_snapshot" :: held 6.683s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:29:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Lock "cinder-quobyte-b817578a-711a-449c-a8f4-f97b32b4a744-bfac50ff-33b3-48dc-bfd8-01dcbd8c7c23" released by "_create_volume_from_snapshot" :: held 6.788s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:29:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.858s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:29:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d716102f-0d75-46fc-8309-75486c27283d tempest-SnapshotMetadataTestJSON-351695960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.604s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:22 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-d716102f-0d75-46fc-8309-75486c27283d tempest-SnapshotMetadataTestJSON-351695960 None] Creating offline snapshot ddc4b618-4b5a-48d4-a50a-514a8a26b76c of volume 2335204e-3996-4b21-9dd1-72433666357c {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:29:22 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a5079a8-350f-4bf7-bbcc-d539963fdfc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfac50ff-33b3-48dc-bfd8-01dcbd8c7c23', 'volume_size': 2, 'snapshot_id': 'b817578a-711a-449c-a8f4-f97b32b4a744'}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:22 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84e1fb5e-86b5-4816-9a32-85bc7077866f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:22 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7dcb0a1-a23d-4591-bb36-49b6386e35ed]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:29:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d716102f-0d75-46fc-8309-75486c27283d tempest-SnapshotMetadataTestJSON-351695960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2335204e-3996-4b21-9dd1-72433666357c {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:22 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Volume volume-bfac50ff-33b3-48dc-bfd8-01dcbd8c7c23 (bfac50ff-33b3-48dc-bfd8-01dcbd8c7c23): created successfully Sep 03 14:29:22 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84e1fb5e-86b5-4816-9a32-85bc7077866f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:22 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Flow 'volume_create_manager' (7085b054-ced7-433c-b086-dec040d50504) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:29:22 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-2f1ce50b-8131-449c-9d22-3c6a9e47317c tempest-VolumesSnapshotTestJSON-595514335 None] Created volume successfully. Sep 03 14:29:22 devstack sudo[100843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2335204e-3996-4b21-9dd1-72433666357c Sep 03 14:29:22 devstack sudo[100843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:22 devstack sudo[100843]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d716102f-0d75-46fc-8309-75486c27283d tempest-SnapshotMetadataTestJSON-351695960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2335204e-3996-4b21-9dd1-72433666357c" returned: 0 in 0.383s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d716102f-0d75-46fc-8309-75486c27283d tempest-SnapshotMetadataTestJSON-351695960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2335204e-3996-4b21-9dd1-72433666357c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2335204e-3996-4b21-9dd1-72433666357c.ddc4b618-4b5a-48d4-a50a-514a8a26b76c 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d6fb78a3-cf91-4efa-b20a-7317423a848e tempest-VolumesSnapshotTestJSON-595514335 None] Acquiring lock "cinder-bfac50ff-33b3-48dc-bfd8-01dcbd8c7c23-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:29:22 devstack sudo[100848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2335204e-3996-4b21-9dd1-72433666357c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2335204e-3996-4b21-9dd1-72433666357c.ddc4b618-4b5a-48d4-a50a-514a8a26b76c 1G Sep 03 14:29:22 devstack sudo[100848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d6fb78a3-cf91-4efa-b20a-7317423a848e tempest-VolumesSnapshotTestJSON-595514335 None] Lock "cinder-bfac50ff-33b3-48dc-bfd8-01dcbd8c7c23-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:29:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d6fb78a3-cf91-4efa-b20a-7317423a848e tempest-VolumesSnapshotTestJSON-595514335 None] Acquiring lock "cinder-quobyte-bfac50ff-33b3-48dc-bfd8-01dcbd8c7c23" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:29:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d6fb78a3-cf91-4efa-b20a-7317423a848e tempest-VolumesSnapshotTestJSON-595514335 None] Lock "cinder-quobyte-bfac50ff-33b3-48dc-bfd8-01dcbd8c7c23" acquired by "delete_volume" :: waited 0.016s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:29:22 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[149b442d-abe6-46b1-99c0-45eb7400ca26]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:29:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d6fb78a3-cf91-4efa-b20a-7317423a848e tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bfac50ff-33b3-48dc-bfd8-01dcbd8c7c23 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:22 devstack sudo[100850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bfac50ff-33b3-48dc-bfd8-01dcbd8c7c23 Sep 03 14:29:22 devstack sudo[100850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:23 devstack sudo[100848]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d716102f-0d75-46fc-8309-75486c27283d tempest-SnapshotMetadataTestJSON-351695960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2335204e-3996-4b21-9dd1-72433666357c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2335204e-3996-4b21-9dd1-72433666357c.ddc4b618-4b5a-48d4-a50a-514a8a26b76c 1G" returned: 0 in 0.501s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d716102f-0d75-46fc-8309-75486c27283d tempest-SnapshotMetadataTestJSON-351695960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2335204e-3996-4b21-9dd1-72433666357c -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2335204e-3996-4b21-9dd1-72433666357c.ddc4b618-4b5a-48d4-a50a-514a8a26b76c {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:23 devstack sudo[100858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2335204e-3996-4b21-9dd1-72433666357c -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2335204e-3996-4b21-9dd1-72433666357c.ddc4b618-4b5a-48d4-a50a-514a8a26b76c Sep 03 14:29:23 devstack sudo[100858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:23 devstack sudo[100850]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d6fb78a3-cf91-4efa-b20a-7317423a848e tempest-VolumesSnapshotTestJSON-595514335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bfac50ff-33b3-48dc-bfd8-01dcbd8c7c23" returned: 0 in 0.404s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d6fb78a3-cf91-4efa-b20a-7317423a848e tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bfac50ff-33b3-48dc-bfd8-01dcbd8c7c23 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:23 devstack sudo[100861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bfac50ff-33b3-48dc-bfd8-01dcbd8c7c23 Sep 03 14:29:23 devstack sudo[100861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:23 devstack sudo[100858]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d716102f-0d75-46fc-8309-75486c27283d tempest-SnapshotMetadataTestJSON-351695960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2335204e-3996-4b21-9dd1-72433666357c -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2335204e-3996-4b21-9dd1-72433666357c.ddc4b618-4b5a-48d4-a50a-514a8a26b76c" returned: 0 in 0.341s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:23 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-d716102f-0d75-46fc-8309-75486c27283d tempest-SnapshotMetadataTestJSON-351695960 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2335204e-3996-4b21-9dd1-72433666357c.ddc4b618-4b5a-48d4-a50a-514a8a26b76c is being set with open permissions: ugo+rw Sep 03 14:29:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d716102f-0d75-46fc-8309-75486c27283d tempest-SnapshotMetadataTestJSON-351695960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2335204e-3996-4b21-9dd1-72433666357c.ddc4b618-4b5a-48d4-a50a-514a8a26b76c {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:23 devstack sudo[100861]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d6fb78a3-cf91-4efa-b20a-7317423a848e tempest-VolumesSnapshotTestJSON-595514335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bfac50ff-33b3-48dc-bfd8-01dcbd8c7c23" returned: 0 in 0.293s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:23 devstack sudo[100867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2335204e-3996-4b21-9dd1-72433666357c.ddc4b618-4b5a-48d4-a50a-514a8a26b76c Sep 03 14:29:23 devstack sudo[100867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:23 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d6fb78a3-cf91-4efa-b20a-7317423a848e tempest-VolumesSnapshotTestJSON-595514335 None] Lock "cinder-quobyte-bfac50ff-33b3-48dc-bfd8-01dcbd8c7c23" released by "delete_volume" :: held 0.755s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:29:23 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-d6fb78a3-cf91-4efa-b20a-7317423a848e tempest-VolumesSnapshotTestJSON-595514335 None] Created reservations ['ad329a09-30ad-47a5-a2c2-6c93280b6bdc', '99cd168f-643c-4b92-aaa7-ba96e6ad9520', 'c8c1d39a-2d00-422a-98e4-3154efe7b064', '797c4776-0b22-45bf-b756-a7d9d4f7bbca'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:29:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d6fb78a3-cf91-4efa-b20a-7317423a848e tempest-VolumesSnapshotTestJSON-595514335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d6fb78a3-cf91-4efa-b20a-7317423a848e tempest-VolumesSnapshotTestJSON-595514335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:23 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d6fb78a3-cf91-4efa-b20a-7317423a848e tempest-VolumesSnapshotTestJSON-595514335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:29:23 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d6fb78a3-cf91-4efa-b20a-7317423a848e tempest-VolumesSnapshotTestJSON-595514335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:29:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d6fb78a3-cf91-4efa-b20a-7317423a848e tempest-VolumesSnapshotTestJSON-595514335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:29:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d6fb78a3-cf91-4efa-b20a-7317423a848e tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:23 devstack sudo[100869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:29:23 devstack sudo[100869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:23 devstack sudo[100867]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d716102f-0d75-46fc-8309-75486c27283d tempest-SnapshotMetadataTestJSON-351695960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2335204e-3996-4b21-9dd1-72433666357c.ddc4b618-4b5a-48d4-a50a-514a8a26b76c" returned: 0 in 0.293s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d716102f-0d75-46fc-8309-75486c27283d tempest-SnapshotMetadataTestJSON-351695960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2335204e-3996-4b21-9dd1-72433666357c.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:23 devstack sudo[100872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2335204e-3996-4b21-9dd1-72433666357c.info Sep 03 14:29:23 devstack sudo[100872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:23 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-e14850f2-88de-451e-b6a3-4d1f77e54e6c tempest-VolumesSnapshotTestJSON-595514335 None] Acquiring lock "cinder-b817578a-711a-449c-a8f4-f97b32b4a744-delete_snapshot" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:29:23 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-e14850f2-88de-451e-b6a3-4d1f77e54e6c tempest-VolumesSnapshotTestJSON-595514335 None] Lock "cinder-b817578a-711a-449c-a8f4-f97b32b4a744-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:29:23 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-e14850f2-88de-451e-b6a3-4d1f77e54e6c tempest-VolumesSnapshotTestJSON-595514335 None] Acquiring lock "cinder-quobyte-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:29:24 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-e14850f2-88de-451e-b6a3-4d1f77e54e6c tempest-VolumesSnapshotTestJSON-595514335 None] Lock "cinder-quobyte-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:29:24 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-e14850f2-88de-451e-b6a3-4d1f77e54e6c tempest-VolumesSnapshotTestJSON-595514335 None] Acquiring lock "cinder-quobyte-b817578a-711a-449c-a8f4-f97b32b4a744" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:29:24 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-e14850f2-88de-451e-b6a3-4d1f77e54e6c tempest-VolumesSnapshotTestJSON-595514335 None] Lock "cinder-quobyte-b817578a-711a-449c-a8f4-f97b32b4a744" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:29:24 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-e14850f2-88de-451e-b6a3-4d1f77e54e6c tempest-VolumesSnapshotTestJSON-595514335 None] Deleting offline snapshot b817578a-711a-449c-a8f4-f97b32b4a744 of volume ef5a1c13-b4fc-4282-b4c4-85bd505c18ee {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:29:24 devstack sudo[100869]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:24 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-e14850f2-88de-451e-b6a3-4d1f77e54e6c tempest-VolumesSnapshotTestJSON-595514335 None] snapshot_file for this snap is: volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee.b817578a-711a-449c-a8f4-f97b32b4a744 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:29:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d6fb78a3-cf91-4efa-b20a-7317423a848e tempest-VolumesSnapshotTestJSON-595514335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.389s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:24 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-d6fb78a3-cf91-4efa-b20a-7317423a848e tempest-VolumesSnapshotTestJSON-595514335 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:29:24 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-d6fb78a3-cf91-4efa-b20a-7317423a848e tempest-VolumesSnapshotTestJSON-595514335 None] Deleted volume successfully. Sep 03 14:29:24 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb709063-a44f-4554-9ccd-da9dd548bef9]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:29:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e14850f2-88de-451e-b6a3-4d1f77e54e6c tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee.b817578a-711a-449c-a8f4-f97b32b4a744 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:24 devstack sudo[100872]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:24 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d6fb78a3-cf91-4efa-b20a-7317423a848e tempest-VolumesSnapshotTestJSON-595514335 None] Lock "cinder-bfac50ff-33b3-48dc-bfd8-01dcbd8c7c23-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:29:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d716102f-0d75-46fc-8309-75486c27283d tempest-SnapshotMetadataTestJSON-351695960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2335204e-3996-4b21-9dd1-72433666357c.info" returned: 0 in 0.332s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:24 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-d716102f-0d75-46fc-8309-75486c27283d tempest-SnapshotMetadataTestJSON-351695960 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2335204e-3996-4b21-9dd1-72433666357c.info is being set with open permissions: ugo+rw Sep 03 14:29:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d716102f-0d75-46fc-8309-75486c27283d tempest-SnapshotMetadataTestJSON-351695960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2335204e-3996-4b21-9dd1-72433666357c.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:24 devstack sudo[100877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2335204e-3996-4b21-9dd1-72433666357c.info Sep 03 14:29:24 devstack sudo[100877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:24 devstack sudo[100876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee.b817578a-711a-449c-a8f4-f97b32b4a744 Sep 03 14:29:24 devstack sudo[100876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:24 devstack sudo[100877]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d716102f-0d75-46fc-8309-75486c27283d tempest-SnapshotMetadataTestJSON-351695960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2335204e-3996-4b21-9dd1-72433666357c.info" returned: 0 in 0.298s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d716102f-0d75-46fc-8309-75486c27283d tempest-SnapshotMetadataTestJSON-351695960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.268s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:29:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 6.673s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:24 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Cloning volume 64389e37-9577-45c9-af98-2af0e4b37aec to volume d13fa8ba-26a4-4356-b7de-37a10b35ff77 Sep 03 14:29:24 devstack sudo[100876]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e14850f2-88de-451e-b6a3-4d1f77e54e6c tempest-VolumesSnapshotTestJSON-595514335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee.b817578a-711a-449c-a8f4-f97b32b4a744" returned: 0 in 0.404s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:24 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-e14850f2-88de-451e-b6a3-4d1f77e54e6c tempest-VolumesSnapshotTestJSON-595514335 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:29:24 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-d716102f-0d75-46fc-8309-75486c27283d tempest-SnapshotMetadataTestJSON-351695960 None] Create snapshot completed successfully Sep 03 14:29:24 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad4b1b5-3f24-4310-826a-1cb1569fe772]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:29:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e14850f2-88de-451e-b6a3-4d1f77e54e6c tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:24 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Creating offline snapshot 1ffbdb6f-816d-4e4c-9043-753046c37964 of volume 64389e37-9577-45c9-af98-2af0e4b37aec {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:29:24 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3717b8-6d91-48c2-aea9-48b1f8154e07]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:29:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:24 devstack sudo[100890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee Sep 03 14:29:24 devstack sudo[100890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:24 devstack sudo[100891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec Sep 03 14:29:24 devstack sudo[100891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:25 devstack sudo[100891]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec" returned: 0 in 0.414s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec.1ffbdb6f-816d-4e4c-9043-753046c37964 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:25 devstack sudo[100899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec.1ffbdb6f-816d-4e4c-9043-753046c37964 1G Sep 03 14:29:25 devstack sudo[100899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:25 devstack sudo[100890]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e14850f2-88de-451e-b6a3-4d1f77e54e6c tempest-VolumesSnapshotTestJSON-595514335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee" returned: 0 in 0.717s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e14850f2-88de-451e-b6a3-4d1f77e54e6c tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee.b817578a-711a-449c-a8f4-f97b32b4a744 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:25 devstack sudo[100902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee.b817578a-711a-449c-a8f4-f97b32b4a744 Sep 03 14:29:25 devstack sudo[100902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:25 devstack sudo[100899]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec.1ffbdb6f-816d-4e4c-9043-753046c37964 1G" returned: 0 in 0.786s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64389e37-9577-45c9-af98-2af0e4b37aec -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec.1ffbdb6f-816d-4e4c-9043-753046c37964 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:25 devstack sudo[100902]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e14850f2-88de-451e-b6a3-4d1f77e54e6c tempest-VolumesSnapshotTestJSON-595514335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee.b817578a-711a-449c-a8f4-f97b32b4a744" returned: 0 in 0.553s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e14850f2-88de-451e-b6a3-4d1f77e54e6c tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee.b817578a-711a-449c-a8f4-f97b32b4a744 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:25 devstack sudo[100911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64389e37-9577-45c9-af98-2af0e4b37aec -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec.1ffbdb6f-816d-4e4c-9043-753046c37964 Sep 03 14:29:25 devstack sudo[100911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:25 devstack sudo[100912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee.b817578a-711a-449c-a8f4-f97b32b4a744 Sep 03 14:29:25 devstack sudo[100912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:26 devstack sudo[100912]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e14850f2-88de-451e-b6a3-4d1f77e54e6c tempest-VolumesSnapshotTestJSON-595514335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee.b817578a-711a-449c-a8f4-f97b32b4a744" returned: 0 in 0.335s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:26 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-5506d394-a45f-459e-b3f6-2e45606d8b01 tempest-SnapshotMetadataTestJSON-351695960 None] Acquiring lock "cinder-ddc4b618-4b5a-48d4-a50a-514a8a26b76c-delete_snapshot" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:29:26 devstack sudo[100911]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:26 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-5506d394-a45f-459e-b3f6-2e45606d8b01 tempest-SnapshotMetadataTestJSON-351695960 None] Lock "cinder-ddc4b618-4b5a-48d4-a50a-514a8a26b76c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:29:26 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-5506d394-a45f-459e-b3f6-2e45606d8b01 tempest-SnapshotMetadataTestJSON-351695960 None] Acquiring lock "cinder-quobyte-2335204e-3996-4b21-9dd1-72433666357c" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:29:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64389e37-9577-45c9-af98-2af0e4b37aec -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec.1ffbdb6f-816d-4e4c-9043-753046c37964" returned: 0 in 0.446s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:26 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec.1ffbdb6f-816d-4e4c-9043-753046c37964 is being set with open permissions: ugo+rw Sep 03 14:29:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec.1ffbdb6f-816d-4e4c-9043-753046c37964 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:26 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-e14850f2-88de-451e-b6a3-4d1f77e54e6c tempest-VolumesSnapshotTestJSON-595514335 None] Lock "cinder-quobyte-b817578a-711a-449c-a8f4-f97b32b4a744" released by "_delete_snapshot" :: held 2.206s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:29:26 devstack sudo[100920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec.1ffbdb6f-816d-4e4c-9043-753046c37964 Sep 03 14:29:26 devstack sudo[100920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:26 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-e14850f2-88de-451e-b6a3-4d1f77e54e6c tempest-VolumesSnapshotTestJSON-595514335 None] Lock "cinder-quobyte-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee" released by "delete_snapshot" :: held 2.251s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:29:26 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-5506d394-a45f-459e-b3f6-2e45606d8b01 tempest-SnapshotMetadataTestJSON-351695960 None] Lock "cinder-quobyte-2335204e-3996-4b21-9dd1-72433666357c" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:29:26 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-5506d394-a45f-459e-b3f6-2e45606d8b01 tempest-SnapshotMetadataTestJSON-351695960 None] Acquiring lock "cinder-quobyte-ddc4b618-4b5a-48d4-a50a-514a8a26b76c" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:29:26 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-5506d394-a45f-459e-b3f6-2e45606d8b01 tempest-SnapshotMetadataTestJSON-351695960 None] Lock "cinder-quobyte-ddc4b618-4b5a-48d4-a50a-514a8a26b76c" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:29:26 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-5506d394-a45f-459e-b3f6-2e45606d8b01 tempest-SnapshotMetadataTestJSON-351695960 None] Deleting offline snapshot ddc4b618-4b5a-48d4-a50a-514a8a26b76c of volume 2335204e-3996-4b21-9dd1-72433666357c {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:29:26 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-5506d394-a45f-459e-b3f6-2e45606d8b01 tempest-SnapshotMetadataTestJSON-351695960 None] snapshot_file for this snap is: volume-2335204e-3996-4b21-9dd1-72433666357c.ddc4b618-4b5a-48d4-a50a-514a8a26b76c {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:29:26 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2adfc4-1126-4200-bf31-daed66804d0e]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:29:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5506d394-a45f-459e-b3f6-2e45606d8b01 tempest-SnapshotMetadataTestJSON-351695960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2335204e-3996-4b21-9dd1-72433666357c.ddc4b618-4b5a-48d4-a50a-514a8a26b76c {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:26 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-e14850f2-88de-451e-b6a3-4d1f77e54e6c tempest-VolumesSnapshotTestJSON-595514335 None] Created reservations ['d34af9ce-2b67-482f-b1b6-087275023d90', '709ec8be-980d-4d91-a787-95f89b2d6ee3', 'fb51c285-a995-412c-bb9a-3747bfa063bf', '10a16706-1439-4243-a280-13c42c5cb32f'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:29:26 devstack sudo[100922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2335204e-3996-4b21-9dd1-72433666357c.ddc4b618-4b5a-48d4-a50a-514a8a26b76c Sep 03 14:29:26 devstack sudo[100922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:26 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-e14850f2-88de-451e-b6a3-4d1f77e54e6c tempest-VolumesSnapshotTestJSON-595514335 None] Delete snapshot completed successfully. Sep 03 14:29:26 devstack sudo[100920]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:26 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-e14850f2-88de-451e-b6a3-4d1f77e54e6c tempest-VolumesSnapshotTestJSON-595514335 None] Lock "cinder-b817578a-711a-449c-a8f4-f97b32b4a744-delete_snapshot" released by "delete_snapshot" :: held 2.520s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:29:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec.1ffbdb6f-816d-4e4c-9043-753046c37964" returned: 0 in 0.270s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:26 devstack sudo[100925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec.info Sep 03 14:29:26 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:26 devstack sudo[100922]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5506d394-a45f-459e-b3f6-2e45606d8b01 tempest-SnapshotMetadataTestJSON-351695960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2335204e-3996-4b21-9dd1-72433666357c.ddc4b618-4b5a-48d4-a50a-514a8a26b76c" returned: 0 in 0.407s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:26 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-5506d394-a45f-459e-b3f6-2e45606d8b01 tempest-SnapshotMetadataTestJSON-351695960 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2335204e-3996-4b21-9dd1-72433666357c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:29:26 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55500f8-f590-40fb-a1cf-2e84aa6368fd]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:29:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5506d394-a45f-459e-b3f6-2e45606d8b01 tempest-SnapshotMetadataTestJSON-351695960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2335204e-3996-4b21-9dd1-72433666357c {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:26 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec.info" returned: 0 in 0.274s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:26 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec.info is being set with open permissions: ugo+rw Sep 03 14:29:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:26 devstack sudo[100932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec.info Sep 03 14:29:26 devstack sudo[100932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:26 devstack sudo[100931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2335204e-3996-4b21-9dd1-72433666357c Sep 03 14:29:26 devstack sudo[100931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:27 devstack sudo[100932]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec.info" returned: 0 in 0.344s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:27 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Acquiring lock "cinder-quobyte-d13fa8ba-26a4-4356-b7de-37a10b35ff77" by "_copy_volume_from_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:29:27 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Lock "cinder-quobyte-d13fa8ba-26a4-4356-b7de-37a10b35ff77" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:29:27 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] snapshot: 1ffbdb6f-816d-4e4c-9043-753046c37964, volume: d13fa8ba-26a4-4356-b7de-37a10b35ff77, {{(pid=87007) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 14:29:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:27 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:29:27 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:29:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:29:27 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd97bc1-9aec-4ea4-a837-c23cc4311f2e]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:29:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec.1ffbdb6f-816d-4e4c-9043-753046c37964 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:27 devstack sudo[100931]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5506d394-a45f-459e-b3f6-2e45606d8b01 tempest-SnapshotMetadataTestJSON-351695960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2335204e-3996-4b21-9dd1-72433666357c" returned: 0 in 0.493s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5506d394-a45f-459e-b3f6-2e45606d8b01 tempest-SnapshotMetadataTestJSON-351695960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2335204e-3996-4b21-9dd1-72433666357c.ddc4b618-4b5a-48d4-a50a-514a8a26b76c {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:27 devstack sudo[100940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2335204e-3996-4b21-9dd1-72433666357c.ddc4b618-4b5a-48d4-a50a-514a8a26b76c Sep 03 14:29:27 devstack sudo[100940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:27 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b50f68a2-55aa-4ac6-835e-4e4de6ca5614 tempest-VolumesSnapshotTestJSON-595514335 None] Acquiring lock "cinder-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:29:27 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b50f68a2-55aa-4ac6-835e-4e4de6ca5614 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "cinder-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:29:27 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b50f68a2-55aa-4ac6-835e-4e4de6ca5614 tempest-VolumesSnapshotTestJSON-595514335 None] Acquiring lock "cinder-quobyte-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:29:27 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b50f68a2-55aa-4ac6-835e-4e4de6ca5614 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "cinder-quobyte-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee" acquired by "delete_volume" :: waited 0.020s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:29:27 devstack sudo[100939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec.1ffbdb6f-816d-4e4c-9043-753046c37964 Sep 03 14:29:27 devstack sudo[100939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:27 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0981ee58-e498-49c9-b442-79d7a0bab1f5]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:29:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b50f68a2-55aa-4ac6-835e-4e4de6ca5614 tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:27 devstack sudo[100943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee Sep 03 14:29:27 devstack sudo[100943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:27 devstack sudo[100940]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5506d394-a45f-459e-b3f6-2e45606d8b01 tempest-SnapshotMetadataTestJSON-351695960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2335204e-3996-4b21-9dd1-72433666357c.ddc4b618-4b5a-48d4-a50a-514a8a26b76c" returned: 0 in 0.470s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5506d394-a45f-459e-b3f6-2e45606d8b01 tempest-SnapshotMetadataTestJSON-351695960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2335204e-3996-4b21-9dd1-72433666357c.ddc4b618-4b5a-48d4-a50a-514a8a26b76c {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:27 devstack sudo[100939]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec.1ffbdb6f-816d-4e4c-9043-753046c37964" returned: 0 in 0.504s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:27 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64389e37-9577-45c9-af98-2af0e4b37aec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:29:27 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[451216d3-8b0a-4b09-ab8a-7f9fd107872c]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:29:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:27 devstack sudo[100952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2335204e-3996-4b21-9dd1-72433666357c.ddc4b618-4b5a-48d4-a50a-514a8a26b76c Sep 03 14:29:27 devstack sudo[100952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:27 devstack sudo[100954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec Sep 03 14:29:27 devstack sudo[100954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:27 devstack sudo[100943]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b50f68a2-55aa-4ac6-835e-4e4de6ca5614 tempest-VolumesSnapshotTestJSON-595514335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee" returned: 0 in 0.463s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b50f68a2-55aa-4ac6-835e-4e4de6ca5614 tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:27 devstack sudo[100959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee Sep 03 14:29:27 devstack sudo[100959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:28 devstack sudo[100952]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5506d394-a45f-459e-b3f6-2e45606d8b01 tempest-SnapshotMetadataTestJSON-351695960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2335204e-3996-4b21-9dd1-72433666357c.ddc4b618-4b5a-48d4-a50a-514a8a26b76c" returned: 0 in 0.321s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:28 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-5506d394-a45f-459e-b3f6-2e45606d8b01 tempest-SnapshotMetadataTestJSON-351695960 None] Lock "cinder-quobyte-ddc4b618-4b5a-48d4-a50a-514a8a26b76c" released by "_delete_snapshot" :: held 1.854s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:29:28 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-5506d394-a45f-459e-b3f6-2e45606d8b01 tempest-SnapshotMetadataTestJSON-351695960 None] Lock "cinder-quobyte-2335204e-3996-4b21-9dd1-72433666357c" released by "delete_snapshot" :: held 1.892s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:29:28 devstack sudo[100959]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b50f68a2-55aa-4ac6-835e-4e4de6ca5614 tempest-VolumesSnapshotTestJSON-595514335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee" returned: 0 in 0.323s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:28 devstack sudo[100954]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:28 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b50f68a2-55aa-4ac6-835e-4e4de6ca5614 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "cinder-quobyte-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee" released by "delete_volume" :: held 0.872s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:29:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec" returned: 0 in 0.509s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:28 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec {{(pid=87007) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 14:29:28 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Creating direct copy from snapshot {{(pid=87007) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 14:29:28 devstack cinder-volume[87007]: DEBUG cinder.utils [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Path /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d13fa8ba-26a4-4356-b7de-37a10b35ff77 not found in is_blk_device check {{(pid=87007) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 14:29:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d13fa8ba-26a4-4356-b7de-37a10b35ff77 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:28 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-5506d394-a45f-459e-b3f6-2e45606d8b01 tempest-SnapshotMetadataTestJSON-351695960 None] Created reservations ['8eb45f35-f840-4404-9158-f8097a062871', '204bb311-89fb-470f-8dbe-bbd1ee2e3ec7', '0d664197-e72e-4404-bbf4-f4edfa697a48', 'a3156f65-d417-4d43-95c3-8423778205c5'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:29:28 devstack sudo[100966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d13fa8ba-26a4-4356-b7de-37a10b35ff77 Sep 03 14:29:28 devstack sudo[100966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:28 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-5506d394-a45f-459e-b3f6-2e45606d8b01 tempest-SnapshotMetadataTestJSON-351695960 None] Delete snapshot completed successfully. Sep 03 14:29:28 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-5506d394-a45f-459e-b3f6-2e45606d8b01 tempest-SnapshotMetadataTestJSON-351695960 None] Lock "cinder-ddc4b618-4b5a-48d4-a50a-514a8a26b76c-delete_snapshot" released by "delete_snapshot" :: held 2.213s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:29:28 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-b50f68a2-55aa-4ac6-835e-4e4de6ca5614 tempest-VolumesSnapshotTestJSON-595514335 None] Created reservations ['67272ae5-9c38-4290-90dc-9dcc7891f39e', 'cf04de7a-0be9-49df-8de3-52b6a1b4f21b', '6ff85a9b-fcbf-47eb-9a79-06055602eb89', '759dc7d8-b970-43d1-bead-3e9d22733ee9'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:29:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b50f68a2-55aa-4ac6-835e-4e4de6ca5614 tempest-VolumesSnapshotTestJSON-595514335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b50f68a2-55aa-4ac6-835e-4e4de6ca5614 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:28 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b50f68a2-55aa-4ac6-835e-4e4de6ca5614 tempest-VolumesSnapshotTestJSON-595514335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:29:28 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b50f68a2-55aa-4ac6-835e-4e4de6ca5614 tempest-VolumesSnapshotTestJSON-595514335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:29:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b50f68a2-55aa-4ac6-835e-4e4de6ca5614 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:29:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b50f68a2-55aa-4ac6-835e-4e4de6ca5614 tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:28 devstack sudo[100970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:29:28 devstack sudo[100970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:28 devstack sudo[100970]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b50f68a2-55aa-4ac6-835e-4e4de6ca5614 tempest-VolumesSnapshotTestJSON-595514335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.278s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:28 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-b50f68a2-55aa-4ac6-835e-4e4de6ca5614 tempest-VolumesSnapshotTestJSON-595514335 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:29:28 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-b50f68a2-55aa-4ac6-835e-4e4de6ca5614 tempest-VolumesSnapshotTestJSON-595514335 None] Deleted volume successfully. Sep 03 14:29:28 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b50f68a2-55aa-4ac6-835e-4e4de6ca5614 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "cinder-ef5a1c13-b4fc-4282-b4c4-85bd505c18ee-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:29:29 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-449ecca5-9494-4f4d-8486-813ab06b2c92 tempest-SnapshotMetadataTestJSON-351695960 None] Acquiring lock "cinder-2335204e-3996-4b21-9dd1-72433666357c-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:29:29 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-449ecca5-9494-4f4d-8486-813ab06b2c92 tempest-SnapshotMetadataTestJSON-351695960 None] Lock "cinder-2335204e-3996-4b21-9dd1-72433666357c-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:29:30 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1472db3-ca6a-43f6-bc0d-107044a63856 tempest-VolumesSnapshotTestJSON-595514335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:29:30 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f1472db3-ca6a-43f6-bc0d-107044a63856 tempest-VolumesSnapshotTestJSON-595514335 None] Flow 'volume_create_manager' (7b93e369-2277-4d1f-81d4-7f0c6850b236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:29:30 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f1472db3-ca6a-43f6-bc0d-107044a63856 tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ec53f97-ee37-42c3-9382-c744048abf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:30 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-449ecca5-9494-4f4d-8486-813ab06b2c92 tempest-SnapshotMetadataTestJSON-351695960 None] Acquiring lock "cinder-quobyte-2335204e-3996-4b21-9dd1-72433666357c" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:29:30 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f1472db3-ca6a-43f6-bc0d-107044a63856 tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ec53f97-ee37-42c3-9382-c744048abf2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:29:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1323564037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f44087bd-ac91-4a62-9efc-c1b285bccb30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41da579dea614d719a655b998f608b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:29:30Z,use_quota=True,user_id='efad3035689f423d9267d2e66d9a3cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:30 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f1472db3-ca6a-43f6-bc0d-107044a63856 tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17d145af-f521-4e9e-a63c-72005687869c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:30 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f1472db3-ca6a-43f6-bc0d-107044a63856 tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17d145af-f521-4e9e-a63c-72005687869c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:30 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f1472db3-ca6a-43f6-bc0d-107044a63856 tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (606b3c72-0e3d-407f-af67-d8dbbd45c830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:30 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f1472db3-ca6a-43f6-bc0d-107044a63856 tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (606b3c72-0e3d-407f-af67-d8dbbd45c830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f44087bd-ac91-4a62-9efc-c1b285bccb30', 'volume_name': 'volume-f44087bd-ac91-4a62-9efc-c1b285bccb30', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:30 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f1472db3-ca6a-43f6-bc0d-107044a63856 tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d18aa0b1-3d39-40ee-bea9-6c4a533cd7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:30 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f1472db3-ca6a-43f6-bc0d-107044a63856 tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d18aa0b1-3d39-40ee-bea9-6c4a533cd7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:30 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f1472db3-ca6a-43f6-bc0d-107044a63856 tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7025eb62-7568-441a-8fc0-e712e5643cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:30 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-f1472db3-ca6a-43f6-bc0d-107044a63856 tempest-VolumesSnapshotTestJSON-595514335 None] Volume f44087bd-ac91-4a62-9efc-c1b285bccb30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f44087bd-ac91-4a62-9efc-c1b285bccb30', 'volume_size': 1} Sep 03 14:29:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f1472db3-ca6a-43f6-bc0d-107044a63856 tempest-VolumesSnapshotTestJSON-595514335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:30 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-449ecca5-9494-4f4d-8486-813ab06b2c92 tempest-SnapshotMetadataTestJSON-351695960 None] Lock "cinder-quobyte-2335204e-3996-4b21-9dd1-72433666357c" acquired by "delete_volume" :: waited 0.238s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:29:30 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[128061d8-d0a7-44ea-83ad-68232f6b5d3e]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:29:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-449ecca5-9494-4f4d-8486-813ab06b2c92 tempest-SnapshotMetadataTestJSON-351695960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2335204e-3996-4b21-9dd1-72433666357c {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:30 devstack sudo[100981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2335204e-3996-4b21-9dd1-72433666357c Sep 03 14:29:30 devstack sudo[100981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:31 devstack sudo[100981]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-449ecca5-9494-4f4d-8486-813ab06b2c92 tempest-SnapshotMetadataTestJSON-351695960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2335204e-3996-4b21-9dd1-72433666357c" returned: 0 in 0.988s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-449ecca5-9494-4f4d-8486-813ab06b2c92 tempest-SnapshotMetadataTestJSON-351695960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2335204e-3996-4b21-9dd1-72433666357c {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:31 devstack sudo[100987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2335204e-3996-4b21-9dd1-72433666357c Sep 03 14:29:31 devstack sudo[100987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:32 devstack sudo[100987]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-449ecca5-9494-4f4d-8486-813ab06b2c92 tempest-SnapshotMetadataTestJSON-351695960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2335204e-3996-4b21-9dd1-72433666357c" returned: 0 in 0.801s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:32 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-449ecca5-9494-4f4d-8486-813ab06b2c92 tempest-SnapshotMetadataTestJSON-351695960 None] Lock "cinder-quobyte-2335204e-3996-4b21-9dd1-72433666357c" released by "delete_volume" :: held 1.978s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:29:32 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:29:32 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Flow 'volume_create_manager' (f5adf2d2-a47c-4055-a2a6-44d36a07c58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:29:32 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08d6f3ca-8a71-436a-a458-6595b9952d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:32 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08d6f3ca-8a71-436a-a458-6595b9952d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2096486701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4dd7dd9-9573-478f-924d-a6a911b72ce9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='194de95cdc8044a2a239d591647cfb0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:29:32Z,use_quota=True,user_id='ca00637ed008455881f80dca4a6069ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:32 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e6a92ae-cda2-43d0-893a-d20f336a2718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:32 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e6a92ae-cda2-43d0-893a-d20f336a2718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:32 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1681526e-4e84-49c4-bccc-c1418160e06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:32 devstack cinder-volume[87007]: DEBUG cinder.image.glance [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Creating Keystone auth plugin from conf {{(pid=87007) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 14:29:32 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-449ecca5-9494-4f4d-8486-813ab06b2c92 tempest-SnapshotMetadataTestJSON-351695960 None] Created reservations ['fe89a27e-da51-49f1-a788-62dd26c90f8c', 'bff3b79c-9d93-4e85-abb3-92b049a80ef7', '502ed380-c2b8-45aa-a8d8-287b8bf0b484', '0b027233-30ba-400c-849c-040aec8c6e16'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:29:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-449ecca5-9494-4f4d-8486-813ab06b2c92 tempest-SnapshotMetadataTestJSON-351695960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-449ecca5-9494-4f4d-8486-813ab06b2c92 tempest-SnapshotMetadataTestJSON-351695960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:32 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-449ecca5-9494-4f4d-8486-813ab06b2c92 tempest-SnapshotMetadataTestJSON-351695960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:29:32 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-449ecca5-9494-4f4d-8486-813ab06b2c92 tempest-SnapshotMetadataTestJSON-351695960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:29:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-449ecca5-9494-4f4d-8486-813ab06b2c92 tempest-SnapshotMetadataTestJSON-351695960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:29:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-449ecca5-9494-4f4d-8486-813ab06b2c92 tempest-SnapshotMetadataTestJSON-351695960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:33 devstack sudo[100990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:29:33 devstack sudo[100990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:33 devstack sudo[100990]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:33 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-449ecca5-9494-4f4d-8486-813ab06b2c92 tempest-SnapshotMetadataTestJSON-351695960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.541s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:33 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-449ecca5-9494-4f4d-8486-813ab06b2c92 tempest-SnapshotMetadataTestJSON-351695960 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:29:33 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1681526e-4e84-49c4-bccc-c1418160e06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b4dd7dd9-9573-478f-924d-a6a911b72ce9', 'volume_name': 'volume-b4dd7dd9-9573-478f-924d-a6a911b72ce9', 'volume_size': 1, 'image_id': '49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd4e87261137045028f09a9da96d0acd8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'created_at': datetime.datetime(2026, 9, 3, 12, 12, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 12, 12, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/49981579-d0a4-4b4a-9bc6-bd809c76cea9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:33 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68d7748f-3185-4569-ade0-62e9a8e54446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:33 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68d7748f-3185-4569-ade0-62e9a8e54446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:33 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45b611e5-3bfc-43b5-949c-bdb38269dd47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:33 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Volume b4dd7dd9-9573-478f-924d-a6a911b72ce9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b4dd7dd9-9573-478f-924d-a6a911b72ce9', 'volume_size': 1, 'image_id': '49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd4e87261137045028f09a9da96d0acd8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'created_at': datetime.datetime(2026, 9, 3, 12, 12, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 12, 12, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/49981579-d0a4-4b4a-9bc6-bd809c76cea9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 03 14:29:33 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Trying to clone b4dd7dd9-9573-478f-924d-a6a911b72ce9 from image 49981579-d0a4-4b4a-9bc6-bd809c76cea9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'metadata': {}}]). {{(pid=87007) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 14:29:33 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-449ecca5-9494-4f4d-8486-813ab06b2c92 tempest-SnapshotMetadataTestJSON-351695960 None] Deleted volume successfully. Sep 03 14:29:33 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-449ecca5-9494-4f4d-8486-813ab06b2c92 tempest-SnapshotMetadataTestJSON-351695960 None] Lock "cinder-2335204e-3996-4b21-9dd1-72433666357c-delete_volume" released by "delete_volume" :: held 3.766s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:29:34 devstack sudo[100966]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d13fa8ba-26a4-4356-b7de-37a10b35ff77" returned: 0 in 5.747s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:34 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Image conversion details: src /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec, size 1024.00 MB, duration 5.75 sec, destination /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d13fa8ba-26a4-4356-b7de-37a10b35ff77 {{(pid=87007) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 14:29:34 devstack cinder-volume[87007]: INFO cinder.image.image_utils [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Converted 1024.00 MB image at 178.16 MB/s Sep 03 14:29:34 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d13fa8ba-26a4-4356-b7de-37a10b35ff77 is being set with open permissions: ugo+rw Sep 03 14:29:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d13fa8ba-26a4-4356-b7de-37a10b35ff77 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:34 devstack sudo[100993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d13fa8ba-26a4-4356-b7de-37a10b35ff77 Sep 03 14:29:34 devstack sudo[100993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:34 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_8a5_6kipdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87007) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 14:29:34 devstack cinder-volume[87007]: INFO cinder.image.image_utils [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Image download 20.69 MB at 20.69 MB/s Sep 03 14:29:34 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26659d1-8d90-41f9-8bf3-5e8b18775bbc]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:29:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_8a5_6kipdevstack@QuobyteHD {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:34 devstack sudo[100993]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d13fa8ba-26a4-4356-b7de-37a10b35ff77" returned: 0 in 0.299s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:34 devstack sudo[100996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_8a5_6kipdevstack@QuobyteHD Sep 03 14:29:34 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Lock "cinder-quobyte-d13fa8ba-26a4-4356-b7de-37a10b35ff77" released by "_copy_volume_from_snapshot" :: held 7.164s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:29:34 devstack sudo[100996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:34 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Acquiring lock "cinder-quobyte-1ffbdb6f-816d-4e4c-9043-753046c37964" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:29:34 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Lock "cinder-quobyte-1ffbdb6f-816d-4e4c-9043-753046c37964" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:29:34 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Deleting offline snapshot 1ffbdb6f-816d-4e4c-9043-753046c37964 of volume 64389e37-9577-45c9-af98-2af0e4b37aec {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:29:34 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] snapshot_file for this snap is: volume-64389e37-9577-45c9-af98-2af0e4b37aec.1ffbdb6f-816d-4e4c-9043-753046c37964 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:29:34 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ad17bd-420f-4381-8187-d68947d6c238]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:29:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec.1ffbdb6f-816d-4e4c-9043-753046c37964 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:34 devstack sudo[101000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec.1ffbdb6f-816d-4e4c-9043-753046c37964 Sep 03 14:29:34 devstack sudo[101000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:34 devstack sudo[100996]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_8a5_6kipdevstack@QuobyteHD" returned: 0 in 0.342s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:34 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Temporary image 49981579-d0a4-4b4a-9bc6-bd809c76cea9 is fetched for user ca00637ed008455881f80dca4a6069ad. {{(pid=87007) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 14:29:34 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f098fdb-9e83-4869-894d-1d3b9b67189e]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:29:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_8a5_6kipdevstack@QuobyteHD {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:34 devstack sudo[101005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_8a5_6kipdevstack@QuobyteHD Sep 03 14:29:34 devstack sudo[101005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:34 devstack sudo[101000]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec.1ffbdb6f-816d-4e4c-9043-753046c37964" returned: 0 in 0.418s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:34 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64389e37-9577-45c9-af98-2af0e4b37aec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:29:34 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[830956c2-1426-4f23-a177-1dc91705560a]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:29:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:35 devstack sudo[101011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec Sep 03 14:29:35 devstack sudo[101011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:35 devstack sudo[101005]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_8a5_6kipdevstack@QuobyteHD" returned: 0 in 0.397s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:35 devstack sudo[101011]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec" returned: 0 in 0.570s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec.1ffbdb6f-816d-4e4c-9043-753046c37964 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:35 devstack sudo[101019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec.1ffbdb6f-816d-4e4c-9043-753046c37964 Sep 03 14:29:35 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:35 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec.1ffbdb6f-816d-4e4c-9043-753046c37964" returned: 0 in 0.341s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec.1ffbdb6f-816d-4e4c-9043-753046c37964 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:35 devstack sudo[101024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec.1ffbdb6f-816d-4e4c-9043-753046c37964 Sep 03 14:29:35 devstack sudo[101024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:36 devstack sudo[101024]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec.1ffbdb6f-816d-4e4c-9043-753046c37964" returned: 0 in 0.271s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:36 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Lock "cinder-quobyte-1ffbdb6f-816d-4e4c-9043-753046c37964" released by "_delete_snapshot" :: held 1.706s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:29:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.696s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:29:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f1472db3-ca6a-43f6-bc0d-107044a63856 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.877s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:36 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f1472db3-ca6a-43f6-bc0d-107044a63856 tempest-VolumesSnapshotTestJSON-595514335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:29:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1323564037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f44087bd-ac91-4a62-9efc-c1b285bccb30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41da579dea614d719a655b998f608b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:29:30Z,use_quota=True,user_id='efad3035689f423d9267d2e66d9a3cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:29:36 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-f1472db3-ca6a-43f6-bc0d-107044a63856 tempest-VolumesSnapshotTestJSON-595514335 None] Creating volume f44087bd-ac91-4a62-9efc-c1b285bccb30 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:29:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f1472db3-ca6a-43f6-bc0d-107044a63856 tempest-VolumesSnapshotTestJSON-595514335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f1472db3-ca6a-43f6-bc0d-107044a63856 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:36 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f1472db3-ca6a-43f6-bc0d-107044a63856 tempest-VolumesSnapshotTestJSON-595514335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:29:36 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f1472db3-ca6a-43f6-bc0d-107044a63856 tempest-VolumesSnapshotTestJSON-595514335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:29:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f1472db3-ca6a-43f6-bc0d-107044a63856 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:29:36 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f1472db3-ca6a-43f6-bc0d-107044a63856 tempest-VolumesSnapshotTestJSON-595514335 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:29:36 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-f1472db3-ca6a-43f6-bc0d-107044a63856 tempest-VolumesSnapshotTestJSON-595514335 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:29:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f1472db3-ca6a-43f6-bc0d-107044a63856 tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:36 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4bef491-5d35-4b16-b417-970481b38564) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d13fa8ba-26a4-4356-b7de-37a10b35ff77', 'volume_size': 1, 'source_volid': '64389e37-9577-45c9-af98-2af0e4b37aec', 'source_volstatus': 'available'}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:36 devstack sudo[101028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30 1073741824 Sep 03 14:29:36 devstack sudo[101028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:36 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94075430-d615-4353-8a9d-c39726761065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:36 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Volume volume-d13fa8ba-26a4-4356-b7de-37a10b35ff77 (d13fa8ba-26a4-4356-b7de-37a10b35ff77): created successfully Sep 03 14:29:36 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94075430-d615-4353-8a9d-c39726761065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:36 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Flow 'volume_create_manager' (bf201a2f-b0dc-48a1-a293-12c168177d07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:29:36 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-3d6edc43-cacb-4054-a690-0b73456ced39 tempest-VolumesGetTest-994288544 None] Created volume successfully. Sep 03 14:29:36 devstack sudo[101028]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f1472db3-ca6a-43f6-bc0d-107044a63856 tempest-VolumesSnapshotTestJSON-595514335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30 1073741824" returned: 0 in 0.428s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f1472db3-ca6a-43f6-bc0d-107044a63856 tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:36 devstack sudo[101033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30 Sep 03 14:29:36 devstack sudo[101033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:36 devstack sudo[101033]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f1472db3-ca6a-43f6-bc0d-107044a63856 tempest-VolumesSnapshotTestJSON-595514335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30" returned: 0 in 0.260s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:36 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f1472db3-ca6a-43f6-bc0d-107044a63856 tempest-VolumesSnapshotTestJSON-595514335 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:29:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f1472db3-ca6a-43f6-bc0d-107044a63856 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:29:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.823s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:36 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2096486701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4dd7dd9-9573-478f-924d-a6a911b72ce9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='194de95cdc8044a2a239d591647cfb0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:29:32Z,use_quota=True,user_id='ca00637ed008455881f80dca4a6069ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:29:36 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Creating volume b4dd7dd9-9573-478f-924d-a6a911b72ce9 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:29:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:36 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:29:36 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:29:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:29:36 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:29:36 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:29:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b4dd7dd9-9573-478f-924d-a6a911b72ce9 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:36 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f1472db3-ca6a-43f6-bc0d-107044a63856 tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7025eb62-7568-441a-8fc0-e712e5643cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f44087bd-ac91-4a62-9efc-c1b285bccb30', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:36 devstack sudo[101036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b4dd7dd9-9573-478f-924d-a6a911b72ce9 1073741824 Sep 03 14:29:36 devstack sudo[101036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:36 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f1472db3-ca6a-43f6-bc0d-107044a63856 tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (859d3edb-d5ed-4804-98db-b5c47e94070e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:36 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-f1472db3-ca6a-43f6-bc0d-107044a63856 tempest-VolumesSnapshotTestJSON-595514335 None] Volume volume-f44087bd-ac91-4a62-9efc-c1b285bccb30 (f44087bd-ac91-4a62-9efc-c1b285bccb30): created successfully Sep 03 14:29:36 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f1472db3-ca6a-43f6-bc0d-107044a63856 tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (859d3edb-d5ed-4804-98db-b5c47e94070e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:36 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f1472db3-ca6a-43f6-bc0d-107044a63856 tempest-VolumesSnapshotTestJSON-595514335 None] Flow 'volume_create_manager' (7b93e369-2277-4d1f-81d4-7f0c6850b236) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:29:37 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-f1472db3-ca6a-43f6-bc0d-107044a63856 tempest-VolumesSnapshotTestJSON-595514335 None] Created volume successfully. Sep 03 14:29:37 devstack sudo[101036]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b4dd7dd9-9573-478f-924d-a6a911b72ce9 1073741824" returned: 0 in 0.536s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b4dd7dd9-9573-478f-924d-a6a911b72ce9 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:37 devstack sudo[101042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b4dd7dd9-9573-478f-924d-a6a911b72ce9 Sep 03 14:29:37 devstack sudo[101042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-9db5d8cb-97e7-4d36-8960-8c494af2daa0 tempest-VolumesSnapshotTestJSON-595514335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:37 devstack sudo[101042]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b4dd7dd9-9573-478f-924d-a6a911b72ce9" returned: 0 in 0.330s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:37 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:29:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:29:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-9db5d8cb-97e7-4d36-8960-8c494af2daa0 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.155s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:37 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-9db5d8cb-97e7-4d36-8960-8c494af2daa0 tempest-VolumesSnapshotTestJSON-595514335 None] Creating offline snapshot 82fe68f0-9191-41cf-a6a6-c769db715106 of volume f44087bd-ac91-4a62-9efc-c1b285bccb30 {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:29:37 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b05b16-ca96-4b0d-9591-d606e8dc4814]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:29:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9db5d8cb-97e7-4d36-8960-8c494af2daa0 tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:37 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-356318a8-8eac-4230-a028-427fd7210a44 tempest-AbsoluteLimitsTests-896608184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:29:37 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-356318a8-8eac-4230-a028-427fd7210a44 tempest-AbsoluteLimitsTests-896608184 None] Flow 'volume_create_manager' (78a3bc4a-4d49-4e00-a23a-284461cd96e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:29:37 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-356318a8-8eac-4230-a028-427fd7210a44 tempest-AbsoluteLimitsTests-896608184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (724f64a3-1e87-4433-8353-0fe4683dd5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:37 devstack cinder-volume[87007]: DEBUG cinder.volume.volume_utils [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Attempting download of 49981579-d0a4-4b4a-9bc6-bd809c76cea9 ((None, [{'url': 'file:///opt/stack/data/glance/images/49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'metadata': {}}])) to volume b4dd7dd9-9573-478f-924d-a6a911b72ce9. {{(pid=87007) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 14:29:37 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-356318a8-8eac-4230-a028-427fd7210a44 tempest-AbsoluteLimitsTests-896608184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (724f64a3-1e87-4433-8353-0fe4683dd5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:29:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1313161140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dbad110-0c47-4f7f-956e-0c4452519715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61f2bbdb71844e579418abec76ccd0b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:29:38Z,use_quota=True,user_id='91f9db00df8545339080a9127eb97c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:37 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-356318a8-8eac-4230-a028-427fd7210a44 tempest-AbsoluteLimitsTests-896608184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c5a6861-78e6-447f-b88f-7b5616ea8501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:37 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-356318a8-8eac-4230-a028-427fd7210a44 tempest-AbsoluteLimitsTests-896608184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c5a6861-78e6-447f-b88f-7b5616ea8501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:37 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-356318a8-8eac-4230-a028-427fd7210a44 tempest-AbsoluteLimitsTests-896608184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (603a8812-46f5-4183-b472-8ac5f9141562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:37 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-356318a8-8eac-4230-a028-427fd7210a44 tempest-AbsoluteLimitsTests-896608184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (603a8812-46f5-4183-b472-8ac5f9141562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dbad110-0c47-4f7f-956e-0c4452519715', 'volume_name': 'volume-9dbad110-0c47-4f7f-956e-0c4452519715', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:37 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-356318a8-8eac-4230-a028-427fd7210a44 tempest-AbsoluteLimitsTests-896608184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d621b8b5-2a30-4a60-b5a2-fbebc2b08536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:38 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-356318a8-8eac-4230-a028-427fd7210a44 tempest-AbsoluteLimitsTests-896608184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d621b8b5-2a30-4a60-b5a2-fbebc2b08536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:38 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-356318a8-8eac-4230-a028-427fd7210a44 tempest-AbsoluteLimitsTests-896608184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71e54c18-d947-429b-bab9-4c1ef9239647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:38 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-356318a8-8eac-4230-a028-427fd7210a44 tempest-AbsoluteLimitsTests-896608184 None] Volume 9dbad110-0c47-4f7f-956e-0c4452519715: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dbad110-0c47-4f7f-956e-0c4452519715', 'volume_size': 1} Sep 03 14:29:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-356318a8-8eac-4230-a028-427fd7210a44 tempest-AbsoluteLimitsTests-896608184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:38 devstack sudo[101046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30 Sep 03 14:29:38 devstack sudo[101046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:38 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e176d3c-d37f-4ad9-bed3-29d51711f3f0]: (4, 'raw') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:29:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_49981579-d0a4-4b4a-9bc6-bd809c76cea9_ef11u2zi {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:38 devstack sudo[101048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_49981579-d0a4-4b4a-9bc6-bd809c76cea9_ef11u2zi Sep 03 14:29:38 devstack sudo[101048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:38 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-22219825-1682-4d10-af3e-bcf4f4dc3c37 tempest-VolumesGetTest-994288544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:29:38 devstack sudo[101046]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:38 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-22219825-1682-4d10-af3e-bcf4f4dc3c37 tempest-VolumesGetTest-994288544 None] Flow 'volume_create_manager' (20d6a2fa-7c93-4d59-bd77-3869d421f2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:29:38 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-22219825-1682-4d10-af3e-bcf4f4dc3c37 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca47f40f-0979-45ab-bdb2-9711fc6373d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9db5d8cb-97e7-4d36-8960-8c494af2daa0 tempest-VolumesSnapshotTestJSON-595514335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30" returned: 0 in 0.501s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9db5d8cb-97e7-4d36-8960-8c494af2daa0 tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30.82fe68f0-9191-41cf-a6a6-c769db715106 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:38 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-22219825-1682-4d10-af3e-bcf4f4dc3c37 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca47f40f-0979-45ab-bdb2-9711fc6373d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:29:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2025438080',display_name='tempest-VolumesGetTest-Volume-425730764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6f1dc1f-6fcf-4f2e-b0e6-df03c1de7fea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdbced0b6bfb442a8fb0d5a0226b4a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:29:38Z,use_quota=True,user_id='b12dc60960114a4c90eefc4a785d7a38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:38 devstack sudo[101054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30.82fe68f0-9191-41cf-a6a6-c769db715106 1G Sep 03 14:29:38 devstack sudo[101054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:38 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-22219825-1682-4d10-af3e-bcf4f4dc3c37 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (098e763c-dcbc-4292-8259-fa651d2f5611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:38 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-22219825-1682-4d10-af3e-bcf4f4dc3c37 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (098e763c-dcbc-4292-8259-fa651d2f5611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:38 devstack sudo[101048]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:38 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-22219825-1682-4d10-af3e-bcf4f4dc3c37 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a725aaca-945a-405e-9a4d-1d548edd134f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:38 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-22219825-1682-4d10-af3e-bcf4f4dc3c37 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a725aaca-945a-405e-9a4d-1d548edd134f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6f1dc1f-6fcf-4f2e-b0e6-df03c1de7fea', 'volume_name': 'volume-a6f1dc1f-6fcf-4f2e-b0e6-df03c1de7fea', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:38 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-22219825-1682-4d10-af3e-bcf4f4dc3c37 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dba34184-ce0d-44a3-8785-889daf873042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:38 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-22219825-1682-4d10-af3e-bcf4f4dc3c37 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dba34184-ce0d-44a3-8785-889daf873042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:38 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-22219825-1682-4d10-af3e-bcf4f4dc3c37 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d10a7227-299d-4261-ac5c-192fe3ce41aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:38 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-22219825-1682-4d10-af3e-bcf4f4dc3c37 tempest-VolumesGetTest-994288544 None] Volume a6f1dc1f-6fcf-4f2e-b0e6-df03c1de7fea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6f1dc1f-6fcf-4f2e-b0e6-df03c1de7fea', 'volume_size': 1} Sep 03 14:29:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-22219825-1682-4d10-af3e-bcf4f4dc3c37 tempest-VolumesGetTest-994288544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_49981579-d0a4-4b4a-9bc6-bd809c76cea9_ef11u2zi" returned: 0 in 0.405s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49981579-d0a4-4b4a-9bc6-bd809c76cea9_ef11u2zi {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:38 devstack sudo[101057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49981579-d0a4-4b4a-9bc6-bd809c76cea9_ef11u2zi Sep 03 14:29:38 devstack sudo[101057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:38 devstack sudo[101057]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49981579-d0a4-4b4a-9bc6-bd809c76cea9_ef11u2zi" returned: 1 in 0.346s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49981579-d0a4-4b4a-9bc6-bd809c76cea9_ef11u2zi' failed. Not Retrying. {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 14:29:38 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3da532-f9b9-499d-9fa8-6bd0a39cdacc]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:29:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_8a5_6kipdevstack@QuobyteHD {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:38 devstack sudo[101054]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9db5d8cb-97e7-4d36-8960-8c494af2daa0 tempest-VolumesSnapshotTestJSON-595514335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30.82fe68f0-9191-41cf-a6a6-c769db715106 1G" returned: 0 in 0.441s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9db5d8cb-97e7-4d36-8960-8c494af2daa0 tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f44087bd-ac91-4a62-9efc-c1b285bccb30 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30.82fe68f0-9191-41cf-a6a6-c769db715106 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:38 devstack sudo[101066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f44087bd-ac91-4a62-9efc-c1b285bccb30 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30.82fe68f0-9191-41cf-a6a6-c769db715106 Sep 03 14:29:38 devstack sudo[101066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:38 devstack sudo[101065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_8a5_6kipdevstack@QuobyteHD Sep 03 14:29:38 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:39 devstack sudo[101066]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9db5d8cb-97e7-4d36-8960-8c494af2daa0 tempest-VolumesSnapshotTestJSON-595514335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f44087bd-ac91-4a62-9efc-c1b285bccb30 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30.82fe68f0-9191-41cf-a6a6-c769db715106" returned: 0 in 0.289s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:39 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-9db5d8cb-97e7-4d36-8960-8c494af2daa0 tempest-VolumesSnapshotTestJSON-595514335 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30.82fe68f0-9191-41cf-a6a6-c769db715106 is being set with open permissions: ugo+rw Sep 03 14:29:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9db5d8cb-97e7-4d36-8960-8c494af2daa0 tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30.82fe68f0-9191-41cf-a6a6-c769db715106 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:39 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_8a5_6kipdevstack@QuobyteHD" returned: 0 in 0.335s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:39 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] 49981579-d0a4-4b4a-9bc6-bd809c76cea9 was qcow2, converting to qcow2 {{(pid=87007) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 14:29:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_8a5_6kipdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b4dd7dd9-9573-478f-924d-a6a911b72ce9 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:39 devstack sudo[101075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30.82fe68f0-9191-41cf-a6a6-c769db715106 Sep 03 14:29:39 devstack sudo[101075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:39 devstack sudo[101077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_8a5_6kipdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b4dd7dd9-9573-478f-924d-a6a911b72ce9 Sep 03 14:29:39 devstack sudo[101077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:39 devstack sudo[101075]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9db5d8cb-97e7-4d36-8960-8c494af2daa0 tempest-VolumesSnapshotTestJSON-595514335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30.82fe68f0-9191-41cf-a6a6-c769db715106" returned: 0 in 0.248s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9db5d8cb-97e7-4d36-8960-8c494af2daa0 tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:39 devstack sudo[101083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30.info Sep 03 14:29:39 devstack sudo[101083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:39 devstack sudo[101083]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9db5d8cb-97e7-4d36-8960-8c494af2daa0 tempest-VolumesSnapshotTestJSON-595514335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30.info" returned: 0 in 0.260s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:39 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-9db5d8cb-97e7-4d36-8960-8c494af2daa0 tempest-VolumesSnapshotTestJSON-595514335 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30.info is being set with open permissions: ugo+rw Sep 03 14:29:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9db5d8cb-97e7-4d36-8960-8c494af2daa0 tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:39 devstack sudo[101088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30.info Sep 03 14:29:39 devstack sudo[101088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:39 devstack sudo[101088]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9db5d8cb-97e7-4d36-8960-8c494af2daa0 tempest-VolumesSnapshotTestJSON-595514335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30.info" returned: 0 in 0.247s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-9db5d8cb-97e7-4d36-8960-8c494af2daa0 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.095s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:29:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-356318a8-8eac-4230-a028-427fd7210a44 tempest-AbsoluteLimitsTests-896608184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.930s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:39 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-356318a8-8eac-4230-a028-427fd7210a44 tempest-AbsoluteLimitsTests-896608184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:29:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1313161140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dbad110-0c47-4f7f-956e-0c4452519715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61f2bbdb71844e579418abec76ccd0b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:29:38Z,use_quota=True,user_id='91f9db00df8545339080a9127eb97c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:29:39 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-356318a8-8eac-4230-a028-427fd7210a44 tempest-AbsoluteLimitsTests-896608184 None] Creating volume 9dbad110-0c47-4f7f-956e-0c4452519715 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:29:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-356318a8-8eac-4230-a028-427fd7210a44 tempest-AbsoluteLimitsTests-896608184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-356318a8-8eac-4230-a028-427fd7210a44 tempest-AbsoluteLimitsTests-896608184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:39 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-356318a8-8eac-4230-a028-427fd7210a44 tempest-AbsoluteLimitsTests-896608184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:29:39 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-356318a8-8eac-4230-a028-427fd7210a44 tempest-AbsoluteLimitsTests-896608184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:29:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-356318a8-8eac-4230-a028-427fd7210a44 tempest-AbsoluteLimitsTests-896608184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:29:39 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-356318a8-8eac-4230-a028-427fd7210a44 tempest-AbsoluteLimitsTests-896608184 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:29:39 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-356318a8-8eac-4230-a028-427fd7210a44 tempest-AbsoluteLimitsTests-896608184 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:29:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-356318a8-8eac-4230-a028-427fd7210a44 tempest-AbsoluteLimitsTests-896608184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9dbad110-0c47-4f7f-956e-0c4452519715 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:39 devstack sudo[101091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9dbad110-0c47-4f7f-956e-0c4452519715 1073741824 Sep 03 14:29:39 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:39 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-9db5d8cb-97e7-4d36-8960-8c494af2daa0 tempest-VolumesSnapshotTestJSON-595514335 None] Create snapshot completed successfully Sep 03 14:29:40 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-356318a8-8eac-4230-a028-427fd7210a44 tempest-AbsoluteLimitsTests-896608184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9dbad110-0c47-4f7f-956e-0c4452519715 1073741824" returned: 0 in 0.523s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-356318a8-8eac-4230-a028-427fd7210a44 tempest-AbsoluteLimitsTests-896608184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9dbad110-0c47-4f7f-956e-0c4452519715 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:40 devstack sudo[101096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9dbad110-0c47-4f7f-956e-0c4452519715 Sep 03 14:29:40 devstack sudo[101096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:40 devstack sudo[101077]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_8a5_6kipdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b4dd7dd9-9573-478f-924d-a6a911b72ce9" returned: 0 in 1.599s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:40 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_8a5_6kipdevstack@QuobyteHD, size 112.00 MB, duration 1.60 sec, destination /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b4dd7dd9-9573-478f-924d-a6a911b72ce9 {{(pid=87007) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 14:29:40 devstack cinder-volume[87007]: INFO cinder.image.image_utils [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Converted 112.00 MB image at 69.99 MB/s Sep 03 14:29:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b4dd7dd9-9573-478f-924d-a6a911b72ce9 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:40 devstack sudo[101096]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-356318a8-8eac-4230-a028-427fd7210a44 tempest-AbsoluteLimitsTests-896608184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9dbad110-0c47-4f7f-956e-0c4452519715" returned: 0 in 0.260s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:40 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-356318a8-8eac-4230-a028-427fd7210a44 tempest-AbsoluteLimitsTests-896608184 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:29:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-356318a8-8eac-4230-a028-427fd7210a44 tempest-AbsoluteLimitsTests-896608184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:29:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-22219825-1682-4d10-af3e-bcf4f4dc3c37 tempest-VolumesGetTest-994288544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.325s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:40 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-22219825-1682-4d10-af3e-bcf4f4dc3c37 tempest-VolumesGetTest-994288544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:29:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2025438080',display_name='tempest-VolumesGetTest-Volume-425730764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6f1dc1f-6fcf-4f2e-b0e6-df03c1de7fea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdbced0b6bfb442a8fb0d5a0226b4a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:29:38Z,use_quota=True,user_id='b12dc60960114a4c90eefc4a785d7a38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:29:40 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-22219825-1682-4d10-af3e-bcf4f4dc3c37 tempest-VolumesGetTest-994288544 None] Creating volume a6f1dc1f-6fcf-4f2e-b0e6-df03c1de7fea {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:29:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-22219825-1682-4d10-af3e-bcf4f4dc3c37 tempest-VolumesGetTest-994288544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-22219825-1682-4d10-af3e-bcf4f4dc3c37 tempest-VolumesGetTest-994288544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:40 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-22219825-1682-4d10-af3e-bcf4f4dc3c37 tempest-VolumesGetTest-994288544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:29:40 devstack sudo[101099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b4dd7dd9-9573-478f-924d-a6a911b72ce9 1G Sep 03 14:29:40 devstack sudo[101099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:40 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-22219825-1682-4d10-af3e-bcf4f4dc3c37 tempest-VolumesGetTest-994288544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:29:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-22219825-1682-4d10-af3e-bcf4f4dc3c37 tempest-VolumesGetTest-994288544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:29:40 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-22219825-1682-4d10-af3e-bcf4f4dc3c37 tempest-VolumesGetTest-994288544 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:29:40 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-22219825-1682-4d10-af3e-bcf4f4dc3c37 tempest-VolumesGetTest-994288544 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:29:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-22219825-1682-4d10-af3e-bcf4f4dc3c37 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a6f1dc1f-6fcf-4f2e-b0e6-df03c1de7fea 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:40 devstack sudo[101101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a6f1dc1f-6fcf-4f2e-b0e6-df03c1de7fea 1073741824 Sep 03 14:29:40 devstack sudo[101101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-356318a8-8eac-4230-a028-427fd7210a44 tempest-AbsoluteLimitsTests-896608184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71e54c18-d947-429b-bab9-4c1ef9239647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dbad110-0c47-4f7f-956e-0c4452519715', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-356318a8-8eac-4230-a028-427fd7210a44 tempest-AbsoluteLimitsTests-896608184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bbd2fb1-4b0c-4834-9a53-d3f38bdf8e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:40 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-356318a8-8eac-4230-a028-427fd7210a44 tempest-AbsoluteLimitsTests-896608184 None] Volume volume-9dbad110-0c47-4f7f-956e-0c4452519715 (9dbad110-0c47-4f7f-956e-0c4452519715): created successfully Sep 03 14:29:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-356318a8-8eac-4230-a028-427fd7210a44 tempest-AbsoluteLimitsTests-896608184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bbd2fb1-4b0c-4834-9a53-d3f38bdf8e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-356318a8-8eac-4230-a028-427fd7210a44 tempest-AbsoluteLimitsTests-896608184 None] Flow 'volume_create_manager' (78a3bc4a-4d49-4e00-a23a-284461cd96e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:29:40 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-356318a8-8eac-4230-a028-427fd7210a44 tempest-AbsoluteLimitsTests-896608184 None] Created volume successfully. Sep 03 14:29:41 devstack sudo[101099]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b4dd7dd9-9573-478f-924d-a6a911b72ce9 1G" returned: 0 in 0.356s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG cinder.volume.volume_utils [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Downloaded image 49981579-d0a4-4b4a-9bc6-bd809c76cea9 ((None, [{'url': 'file:///opt/stack/data/glance/images/49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'metadata': {}}])) to volume b4dd7dd9-9573-478f-924d-a6a911b72ce9 successfully. {{(pid=87007) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Temporary image 49981579-d0a4-4b4a-9bc6-bd809c76cea9 for user ca00637ed008455881f80dca4a6069ad is deleted. {{(pid=87007) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG cinder.volume.volume_utils [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Marking volume b4dd7dd9-9573-478f-924d-a6a911b72ce9 as bootable. {{(pid=87007) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Copying metadata from image 49981579-d0a4-4b4a-9bc6-bd809c76cea9 to b4dd7dd9-9573-478f-924d-a6a911b72ce9. {{(pid=87007) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Creating volume glance metadata for volume b4dd7dd9-9573-478f-924d-a6a911b72ce9 backed by image 49981579-d0a4-4b4a-9bc6-bd809c76cea9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87007) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45b611e5-3bfc-43b5-949c-bdb38269dd47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4dd7dd9-9573-478f-924d-a6a911b72ce9', 'volume_size': 1, 'image_id': '49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd4e87261137045028f09a9da96d0acd8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'created_at': datetime.datetime(2026, 9, 3, 12, 12, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 12, 12, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/49981579-d0a4-4b4a-9bc6-bd809c76cea9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afed8dc8-36b1-4e7f-9d5b-13bc89e1825b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:41 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Volume volume-b4dd7dd9-9573-478f-924d-a6a911b72ce9 (b4dd7dd9-9573-478f-924d-a6a911b72ce9): created successfully Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afed8dc8-36b1-4e7f-9d5b-13bc89e1825b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Flow 'volume_create_manager' (f5adf2d2-a47c-4055-a2a6-44d36a07c58e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:29:41 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-a5b5d6f1-0085-48c9-a4b4-138a726be454 tempest-TestShelveInstance-1205513418 None] Created volume successfully. Sep 03 14:29:41 devstack sudo[101101]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-22219825-1682-4d10-af3e-bcf4f4dc3c37 tempest-VolumesGetTest-994288544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a6f1dc1f-6fcf-4f2e-b0e6-df03c1de7fea 1073741824" returned: 0 in 0.560s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-22219825-1682-4d10-af3e-bcf4f4dc3c37 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a6f1dc1f-6fcf-4f2e-b0e6-df03c1de7fea {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:41 devstack sudo[101111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a6f1dc1f-6fcf-4f2e-b0e6-df03c1de7fea Sep 03 14:29:41 devstack sudo[101111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Flow 'volume_create_manager' (c9b692f0-939a-4bf1-86e7-c9fb096ec019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82f5ca20-5419-4228-bd3b-959df893783a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82f5ca20-5419-4228-bd3b-959df893783a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2139708898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e3a84ae-4a37-4420-8236-df94a184af8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41da579dea614d719a655b998f608b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:29:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=82fe68f0-9191-41cf-a6a6-c769db715106,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:29:41Z,use_quota=True,user_id='efad3035689f423d9267d2e66d9a3cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29283d2a-12f2-4d83-b526-db5e3e2b45f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29283d2a-12f2-4d83-b526-db5e3e2b45f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd854830-8f71-4714-9fcc-b093d3b30900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd854830-8f71-4714-9fcc-b093d3b30900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5e3a84ae-4a37-4420-8236-df94a184af8d', 'volume_name': 'volume-5e3a84ae-4a37-4420-8236-df94a184af8d', 'volume_size': 1, 'snapshot_id': '82fe68f0-9191-41cf-a6a6-c769db715106'}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfb9bce1-d4f5-4cd7-9fc1-8b80aa89ad76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfb9bce1-d4f5-4cd7-9fc1-8b80aa89ad76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c22d6a01-736c-4b7d-996d-d942c09c2ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:41 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Volume 5e3a84ae-4a37-4420-8236-df94a184af8d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5e3a84ae-4a37-4420-8236-df94a184af8d', 'volume_size': 1, 'snapshot_id': '82fe68f0-9191-41cf-a6a6-c769db715106'} Sep 03 14:29:41 devstack sudo[101111]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-22219825-1682-4d10-af3e-bcf4f4dc3c37 tempest-VolumesGetTest-994288544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a6f1dc1f-6fcf-4f2e-b0e6-df03c1de7fea" returned: 0 in 0.252s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-22219825-1682-4d10-af3e-bcf4f4dc3c37 tempest-VolumesGetTest-994288544 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-22219825-1682-4d10-af3e-bcf4f4dc3c37 tempest-VolumesGetTest-994288544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.005s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Acquiring lock "cinder-quobyte-82fe68f0-9191-41cf-a6a6-c769db715106-5e3a84ae-4a37-4420-8236-df94a184af8d" by "_create_volume_from_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-22219825-1682-4d10-af3e-bcf4f4dc3c37 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d10a7227-299d-4261-ac5c-192fe3ce41aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6f1dc1f-6fcf-4f2e-b0e6-df03c1de7fea', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-22219825-1682-4d10-af3e-bcf4f4dc3c37 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (561cb03a-017b-4b8d-9ae1-fa45ec2eaa72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "cinder-quobyte-82fe68f0-9191-41cf-a6a6-c769db715106-5e3a84ae-4a37-4420-8236-df94a184af8d" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Creating volume 5e3a84ae-4a37-4420-8236-df94a184af8d from snapshot 82fe68f0-9191-41cf-a6a6-c769db715106 {{(pid=87007) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Acquiring lock "cinder-quobyte-5e3a84ae-4a37-4420-8236-df94a184af8d" by "_copy_volume_from_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:29:41 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-22219825-1682-4d10-af3e-bcf4f4dc3c37 tempest-VolumesGetTest-994288544 None] Volume volume-a6f1dc1f-6fcf-4f2e-b0e6-df03c1de7fea (a6f1dc1f-6fcf-4f2e-b0e6-df03c1de7fea): created successfully Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-22219825-1682-4d10-af3e-bcf4f4dc3c37 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (561cb03a-017b-4b8d-9ae1-fa45ec2eaa72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-22219825-1682-4d10-af3e-bcf4f4dc3c37 tempest-VolumesGetTest-994288544 None] Flow 'volume_create_manager' (20d6a2fa-7c93-4d59-bd77-3869d421f2d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "cinder-quobyte-5e3a84ae-4a37-4420-8236-df94a184af8d" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] snapshot: 82fe68f0-9191-41cf-a6a6-c769db715106, volume: 5e3a84ae-4a37-4420-8236-df94a184af8d, {{(pid=87007) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 14:29:41 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-22219825-1682-4d10-af3e-bcf4f4dc3c37 tempest-VolumesGetTest-994288544 None] Created volume successfully. Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[687345a0-a3af-4661-b184-5907da5b06ab]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:29:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30.82fe68f0-9191-41cf-a6a6-c769db715106 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:41 devstack sudo[101114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30.82fe68f0-9191-41cf-a6a6-c769db715106 Sep 03 14:29:41 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:42 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30.82fe68f0-9191-41cf-a6a6-c769db715106" returned: 0 in 0.395s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:42 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f44087bd-ac91-4a62-9efc-c1b285bccb30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:29:42 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba337915-8dff-4cbd-915a-61ff9a46dc4e]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:29:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:42 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-481dc6cb-02a6-4675-b5da-49404ec63cf8 tempest-AbsoluteLimitsTests-896608184 None] Acquiring lock "cinder-9dbad110-0c47-4f7f-956e-0c4452519715-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:29:42 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-481dc6cb-02a6-4675-b5da-49404ec63cf8 tempest-AbsoluteLimitsTests-896608184 None] Lock "cinder-9dbad110-0c47-4f7f-956e-0c4452519715-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:29:42 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:INSERT=47,cinder:UPDATE=145,cinder:SELECT=132,cinder:DELETE=13 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:29:42 devstack sudo[101119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30 Sep 03 14:29:42 devstack sudo[101119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:42 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-481dc6cb-02a6-4675-b5da-49404ec63cf8 tempest-AbsoluteLimitsTests-896608184 None] Acquiring lock "cinder-quobyte-9dbad110-0c47-4f7f-956e-0c4452519715" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:29:42 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-481dc6cb-02a6-4675-b5da-49404ec63cf8 tempest-AbsoluteLimitsTests-896608184 None] Lock "cinder-quobyte-9dbad110-0c47-4f7f-956e-0c4452519715" acquired by "delete_volume" :: waited 0.024s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:29:42 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[188960af-fd7f-4333-9373-a6268f974b0d]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:29:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-481dc6cb-02a6-4675-b5da-49404ec63cf8 tempest-AbsoluteLimitsTests-896608184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9dbad110-0c47-4f7f-956e-0c4452519715 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:42 devstack sudo[101121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9dbad110-0c47-4f7f-956e-0c4452519715 Sep 03 14:29:42 devstack sudo[101121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:42 devstack sudo[101119]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30" returned: 0 in 0.474s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:42 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30 {{(pid=87007) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 14:29:42 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Creating direct copy from snapshot {{(pid=87007) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 14:29:42 devstack cinder-volume[87007]: DEBUG cinder.utils [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Path /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e3a84ae-4a37-4420-8236-df94a184af8d not found in is_blk_device check {{(pid=87007) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 14:29:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e3a84ae-4a37-4420-8236-df94a184af8d {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:42 devstack sudo[101127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e3a84ae-4a37-4420-8236-df94a184af8d Sep 03 14:29:42 devstack sudo[101127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:42 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b1b78322-4329-48f9-94ea-d0727d8a0a96 tempest-VolumesGetTest-994288544 None] Acquiring lock "cinder-a6f1dc1f-6fcf-4f2e-b0e6-df03c1de7fea-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:29:42 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b1b78322-4329-48f9-94ea-d0727d8a0a96 tempest-VolumesGetTest-994288544 None] Lock "cinder-a6f1dc1f-6fcf-4f2e-b0e6-df03c1de7fea-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:29:42 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b1b78322-4329-48f9-94ea-d0727d8a0a96 tempest-VolumesGetTest-994288544 None] Acquiring lock "cinder-quobyte-a6f1dc1f-6fcf-4f2e-b0e6-df03c1de7fea" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:29:42 devstack sudo[101121]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:42 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b1b78322-4329-48f9-94ea-d0727d8a0a96 tempest-VolumesGetTest-994288544 None] Lock "cinder-quobyte-a6f1dc1f-6fcf-4f2e-b0e6-df03c1de7fea" acquired by "delete_volume" :: waited 0.022s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:29:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-481dc6cb-02a6-4675-b5da-49404ec63cf8 tempest-AbsoluteLimitsTests-896608184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9dbad110-0c47-4f7f-956e-0c4452519715" returned: 0 in 0.494s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-481dc6cb-02a6-4675-b5da-49404ec63cf8 tempest-AbsoluteLimitsTests-896608184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9dbad110-0c47-4f7f-956e-0c4452519715 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:42 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6832e95f-59d4-4700-a4a1-4bffe30c990e]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:29:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b1b78322-4329-48f9-94ea-d0727d8a0a96 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a6f1dc1f-6fcf-4f2e-b0e6-df03c1de7fea {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:42 devstack sudo[101132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9dbad110-0c47-4f7f-956e-0c4452519715 Sep 03 14:29:42 devstack sudo[101132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:43 devstack sudo[101133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a6f1dc1f-6fcf-4f2e-b0e6-df03c1de7fea Sep 03 14:29:43 devstack sudo[101133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:43 devstack sudo[101132]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-481dc6cb-02a6-4675-b5da-49404ec63cf8 tempest-AbsoluteLimitsTests-896608184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9dbad110-0c47-4f7f-956e-0c4452519715" returned: 0 in 0.316s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:43 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-481dc6cb-02a6-4675-b5da-49404ec63cf8 tempest-AbsoluteLimitsTests-896608184 None] Lock "cinder-quobyte-9dbad110-0c47-4f7f-956e-0c4452519715" released by "delete_volume" :: held 0.862s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:29:43 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-481dc6cb-02a6-4675-b5da-49404ec63cf8 tempest-AbsoluteLimitsTests-896608184 None] Created reservations ['9498ae9c-9162-4c72-a03d-03bff5c1f8ea', '573ee4a4-42ec-4eb5-9cdc-f62db5521ecd', '292e07c1-f7af-488e-8d98-cb37f696a4c8', '29a105a5-7f66-499d-898b-8239fb98c275'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:29:43 devstack sudo[101133]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b1b78322-4329-48f9-94ea-d0727d8a0a96 tempest-VolumesGetTest-994288544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a6f1dc1f-6fcf-4f2e-b0e6-df03c1de7fea" returned: 0 in 0.651s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b1b78322-4329-48f9-94ea-d0727d8a0a96 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a6f1dc1f-6fcf-4f2e-b0e6-df03c1de7fea {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:43 devstack sudo[101150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a6f1dc1f-6fcf-4f2e-b0e6-df03c1de7fea Sep 03 14:29:43 devstack sudo[101150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-481dc6cb-02a6-4675-b5da-49404ec63cf8 tempest-AbsoluteLimitsTests-896608184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-481dc6cb-02a6-4675-b5da-49404ec63cf8 tempest-AbsoluteLimitsTests-896608184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:43 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-481dc6cb-02a6-4675-b5da-49404ec63cf8 tempest-AbsoluteLimitsTests-896608184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:29:43 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-481dc6cb-02a6-4675-b5da-49404ec63cf8 tempest-AbsoluteLimitsTests-896608184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:29:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-481dc6cb-02a6-4675-b5da-49404ec63cf8 tempest-AbsoluteLimitsTests-896608184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:29:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-481dc6cb-02a6-4675-b5da-49404ec63cf8 tempest-AbsoluteLimitsTests-896608184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:43 devstack sudo[101153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:29:43 devstack sudo[101153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:44 devstack sudo[101153]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-481dc6cb-02a6-4675-b5da-49404ec63cf8 tempest-AbsoluteLimitsTests-896608184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.634s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:44 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-481dc6cb-02a6-4675-b5da-49404ec63cf8 tempest-AbsoluteLimitsTests-896608184 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:29:44 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-481dc6cb-02a6-4675-b5da-49404ec63cf8 tempest-AbsoluteLimitsTests-896608184 None] Deleted volume successfully. Sep 03 14:29:44 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-481dc6cb-02a6-4675-b5da-49404ec63cf8 tempest-AbsoluteLimitsTests-896608184 None] Lock "cinder-9dbad110-0c47-4f7f-956e-0c4452519715-delete_volume" released by "delete_volume" :: held 2.128s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:29:44 devstack sudo[101150]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b1b78322-4329-48f9-94ea-d0727d8a0a96 tempest-VolumesGetTest-994288544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a6f1dc1f-6fcf-4f2e-b0e6-df03c1de7fea" returned: 0 in 0.968s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:44 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b1b78322-4329-48f9-94ea-d0727d8a0a96 tempest-VolumesGetTest-994288544 None] Lock "cinder-quobyte-a6f1dc1f-6fcf-4f2e-b0e6-df03c1de7fea" released by "delete_volume" :: held 1.723s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:29:44 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-b1b78322-4329-48f9-94ea-d0727d8a0a96 tempest-VolumesGetTest-994288544 None] Created reservations ['c7c2bac8-ca44-4252-b8ba-d0dae37ccbbd', '75bc780d-5000-4dca-80de-21024a2e19e9', 'f6062b89-d2a4-4b63-863e-1dc1a8aa58f8', '6e89f9ac-2903-440f-a8c5-af7f8e50b55a'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:29:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b1b78322-4329-48f9-94ea-d0727d8a0a96 tempest-VolumesGetTest-994288544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b1b78322-4329-48f9-94ea-d0727d8a0a96 tempest-VolumesGetTest-994288544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:44 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b1b78322-4329-48f9-94ea-d0727d8a0a96 tempest-VolumesGetTest-994288544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:29:44 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b1b78322-4329-48f9-94ea-d0727d8a0a96 tempest-VolumesGetTest-994288544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:29:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b1b78322-4329-48f9-94ea-d0727d8a0a96 tempest-VolumesGetTest-994288544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:29:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b1b78322-4329-48f9-94ea-d0727d8a0a96 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:44 devstack sudo[101160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:29:44 devstack sudo[101160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:45 devstack sudo[101160]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b1b78322-4329-48f9-94ea-d0727d8a0a96 tempest-VolumesGetTest-994288544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.561s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:45 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-b1b78322-4329-48f9-94ea-d0727d8a0a96 tempest-VolumesGetTest-994288544 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:29:45 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-b1b78322-4329-48f9-94ea-d0727d8a0a96 tempest-VolumesGetTest-994288544 None] Deleted volume successfully. Sep 03 14:29:45 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b1b78322-4329-48f9-94ea-d0727d8a0a96 tempest-VolumesGetTest-994288544 None] Lock "cinder-a6f1dc1f-6fcf-4f2e-b0e6-df03c1de7fea-delete_volume" released by "delete_volume" :: held 2.765s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:29:45 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2f4c0f98-a422-4929-8dd6-d9a895886939 tempest-VolumesGetTest-994288544 None] Acquiring lock "cinder-d13fa8ba-26a4-4356-b7de-37a10b35ff77-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:29:45 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2f4c0f98-a422-4929-8dd6-d9a895886939 tempest-VolumesGetTest-994288544 None] Lock "cinder-d13fa8ba-26a4-4356-b7de-37a10b35ff77-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:29:45 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2f4c0f98-a422-4929-8dd6-d9a895886939 tempest-VolumesGetTest-994288544 None] Acquiring lock "cinder-quobyte-d13fa8ba-26a4-4356-b7de-37a10b35ff77" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:29:45 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2f4c0f98-a422-4929-8dd6-d9a895886939 tempest-VolumesGetTest-994288544 None] Lock "cinder-quobyte-d13fa8ba-26a4-4356-b7de-37a10b35ff77" acquired by "delete_volume" :: waited 0.026s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:29:45 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[edec01a1-1ed3-4345-95e5-baa6fd3225c8]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:29:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2f4c0f98-a422-4929-8dd6-d9a895886939 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d13fa8ba-26a4-4356-b7de-37a10b35ff77 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:45 devstack sudo[101163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d13fa8ba-26a4-4356-b7de-37a10b35ff77 Sep 03 14:29:45 devstack sudo[101163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:46 devstack sudo[101163]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2f4c0f98-a422-4929-8dd6-d9a895886939 tempest-VolumesGetTest-994288544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d13fa8ba-26a4-4356-b7de-37a10b35ff77" returned: 0 in 0.713s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2f4c0f98-a422-4929-8dd6-d9a895886939 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d13fa8ba-26a4-4356-b7de-37a10b35ff77 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:46 devstack sudo[101169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d13fa8ba-26a4-4356-b7de-37a10b35ff77 Sep 03 14:29:46 devstack sudo[101169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:47 devstack sudo[101169]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2f4c0f98-a422-4929-8dd6-d9a895886939 tempest-VolumesGetTest-994288544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d13fa8ba-26a4-4356-b7de-37a10b35ff77" returned: 0 in 0.551s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:47 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2f4c0f98-a422-4929-8dd6-d9a895886939 tempest-VolumesGetTest-994288544 None] Lock "cinder-quobyte-d13fa8ba-26a4-4356-b7de-37a10b35ff77" released by "delete_volume" :: held 1.419s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:29:47 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-2f4c0f98-a422-4929-8dd6-d9a895886939 tempest-VolumesGetTest-994288544 None] Created reservations ['89d43bcf-99f8-4dc9-a901-ff360e6f2e56', '3b554985-9700-4d6e-b0dc-7f538e446f56', 'fbb25de8-0d73-42e8-ba63-54fa6afbca73', 'f25e0ebd-5bde-44f6-a1d1-29da85a108ed'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:29:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2f4c0f98-a422-4929-8dd6-d9a895886939 tempest-VolumesGetTest-994288544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2f4c0f98-a422-4929-8dd6-d9a895886939 tempest-VolumesGetTest-994288544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:47 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2f4c0f98-a422-4929-8dd6-d9a895886939 tempest-VolumesGetTest-994288544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:29:47 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2f4c0f98-a422-4929-8dd6-d9a895886939 tempest-VolumesGetTest-994288544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:29:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2f4c0f98-a422-4929-8dd6-d9a895886939 tempest-VolumesGetTest-994288544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:29:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2f4c0f98-a422-4929-8dd6-d9a895886939 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:47 devstack sudo[101179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:29:47 devstack sudo[101179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-e8703d26-ab45-4c40-ae65-4997fb2410e4 req-5255a011-fbd4-4cc4-a942-6e16e58008e6 tempest-TestShelveInstance-1205513418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:48 devstack sudo[101179]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2f4c0f98-a422-4929-8dd6-d9a895886939 tempest-VolumesGetTest-994288544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.759s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:48 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-2f4c0f98-a422-4929-8dd6-d9a895886939 tempest-VolumesGetTest-994288544 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:29:48 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-2f4c0f98-a422-4929-8dd6-d9a895886939 tempest-VolumesGetTest-994288544 None] Deleted volume successfully. Sep 03 14:29:48 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2f4c0f98-a422-4929-8dd6-d9a895886939 tempest-VolumesGetTest-994288544 None] Lock "cinder-d13fa8ba-26a4-4356-b7de-37a10b35ff77-delete_volume" released by "delete_volume" :: held 2.709s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:29:48 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c2776574-9b33-4802-af4e-fe1448cb033e tempest-VolumesGetTest-994288544 None] Acquiring lock "cinder-64389e37-9577-45c9-af98-2af0e4b37aec-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:29:48 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c2776574-9b33-4802-af4e-fe1448cb033e tempest-VolumesGetTest-994288544 None] Lock "cinder-64389e37-9577-45c9-af98-2af0e4b37aec-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:29:48 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c2776574-9b33-4802-af4e-fe1448cb033e tempest-VolumesGetTest-994288544 None] Acquiring lock "cinder-quobyte-64389e37-9577-45c9-af98-2af0e4b37aec" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:29:48 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c2776574-9b33-4802-af4e-fe1448cb033e tempest-VolumesGetTest-994288544 None] Lock "cinder-quobyte-64389e37-9577-45c9-af98-2af0e4b37aec" acquired by "delete_volume" :: waited 0.027s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:29:48 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e486eddd-057a-4950-bf28-e6f61fb14993]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:29:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c2776574-9b33-4802-af4e-fe1448cb033e tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:49 devstack sudo[101184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec Sep 03 14:29:49 devstack sudo[101184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:49 devstack sudo[101127]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e3a84ae-4a37-4420-8236-df94a184af8d" returned: 0 in 7.020s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:49 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Image conversion details: src /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30, size 1024.00 MB, duration 7.02 sec, destination /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e3a84ae-4a37-4420-8236-df94a184af8d {{(pid=87007) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 14:29:49 devstack cinder-volume[87007]: INFO cinder.image.image_utils [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Converted 1024.00 MB image at 145.84 MB/s Sep 03 14:29:49 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e3a84ae-4a37-4420-8236-df94a184af8d is being set with open permissions: ugo+rw Sep 03 14:29:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e3a84ae-4a37-4420-8236-df94a184af8d {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:49 devstack sudo[101188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e3a84ae-4a37-4420-8236-df94a184af8d Sep 03 14:29:49 devstack sudo[101188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:49 devstack sudo[101184]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c2776574-9b33-4802-af4e-fe1448cb033e tempest-VolumesGetTest-994288544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec" returned: 0 in 0.904s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c2776574-9b33-4802-af4e-fe1448cb033e tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:49 devstack sudo[101191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec Sep 03 14:29:49 devstack sudo[101191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:50 devstack sudo[101188]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e3a84ae-4a37-4420-8236-df94a184af8d" returned: 0 in 0.425s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:50 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "cinder-quobyte-5e3a84ae-4a37-4420-8236-df94a184af8d" released by "_copy_volume_from_snapshot" :: held 8.424s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:29:50 devstack sudo[101191]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c2776574-9b33-4802-af4e-fe1448cb033e tempest-VolumesGetTest-994288544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-64389e37-9577-45c9-af98-2af0e4b37aec" returned: 0 in 0.321s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:50 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c2776574-9b33-4802-af4e-fe1448cb033e tempest-VolumesGetTest-994288544 None] Lock "cinder-quobyte-64389e37-9577-45c9-af98-2af0e4b37aec" released by "delete_volume" :: held 1.378s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:29:50 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "cinder-quobyte-82fe68f0-9191-41cf-a6a6-c769db715106-5e3a84ae-4a37-4420-8236-df94a184af8d" released by "_create_volume_from_snapshot" :: held 8.547s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:29:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.574s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:29:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-e8703d26-ab45-4c40-ae65-4997fb2410e4 req-5255a011-fbd4-4cc4-a942-6e16e58008e6 tempest-TestShelveInstance-1205513418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.138s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-e8703d26-ab45-4c40-ae65-4997fb2410e4 req-5255a011-fbd4-4cc4-a942-6e16e58008e6 tempest-TestShelveInstance-1205513418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:29:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c22d6a01-736c-4b7d-996d-d942c09c2ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e3a84ae-4a37-4420-8236-df94a184af8d', 'volume_size': 1, 'snapshot_id': '82fe68f0-9191-41cf-a6a6-c769db715106'}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68363bd2-d003-4e52-b650-0e34f9646486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:50 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Volume volume-5e3a84ae-4a37-4420-8236-df94a184af8d (5e3a84ae-4a37-4420-8236-df94a184af8d): created successfully Sep 03 14:29:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68363bd2-d003-4e52-b650-0e34f9646486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Flow 'volume_create_manager' (c9b692f0-939a-4bf1-86e7-c9fb096ec019) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:29:50 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-c2776574-9b33-4802-af4e-fe1448cb033e tempest-VolumesGetTest-994288544 None] Created reservations ['3213046e-38be-4c79-9ece-32bed321d489', 'a106d09d-5a24-4933-abc1-3eeea20e463c', 'b3bc7763-73f9-4d40-8619-a5af80f51382', '5e378a18-1206-4710-b035-e930916c28a9'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:29:50 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-178f3931-9b52-4f20-94e8-ba49d079a5c6 tempest-VolumesSnapshotTestJSON-595514335 None] Created volume successfully. Sep 03 14:29:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-e8703d26-ab45-4c40-ae65-4997fb2410e4 req-5255a011-fbd4-4cc4-a942-6e16e58008e6 tempest-TestShelveInstance-1205513418 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713', 'name': 'volume-b4dd7dd9-9573-478f-924d-a6a911b72ce9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c87395ee-c61c-4c87-b04c-5adddf54237e', 'enforce_multipath': True} {{(pid=87007) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 14:29:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c2776574-9b33-4802-af4e-fe1448cb033e tempest-VolumesGetTest-994288544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c2776574-9b33-4802-af4e-fe1448cb033e tempest-VolumesGetTest-994288544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:50 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-c2776574-9b33-4802-af4e-fe1448cb033e tempest-VolumesGetTest-994288544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:29:50 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-c2776574-9b33-4802-af4e-fe1448cb033e tempest-VolumesGetTest-994288544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:29:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c2776574-9b33-4802-af4e-fe1448cb033e tempest-VolumesGetTest-994288544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:29:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c2776574-9b33-4802-af4e-fe1448cb033e tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:50 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-e8703d26-ab45-4c40-ae65-4997fb2410e4 req-5255a011-fbd4-4cc4-a942-6e16e58008e6 tempest-TestShelveInstance-1205513418 None] attachment_update completed successfully. Sep 03 14:29:50 devstack sudo[101195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:29:50 devstack sudo[101195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:50 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8c430440-e7ff-4fc2-a9a5-b432639028db tempest-VolumesSnapshotTestJSON-595514335 None] Acquiring lock "cinder-5e3a84ae-4a37-4420-8236-df94a184af8d-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:29:50 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8c430440-e7ff-4fc2-a9a5-b432639028db tempest-VolumesSnapshotTestJSON-595514335 None] Lock "cinder-5e3a84ae-4a37-4420-8236-df94a184af8d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:29:50 devstack sudo[101195]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c2776574-9b33-4802-af4e-fe1448cb033e tempest-VolumesGetTest-994288544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.345s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:50 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-c2776574-9b33-4802-af4e-fe1448cb033e tempest-VolumesGetTest-994288544 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:29:50 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-c2776574-9b33-4802-af4e-fe1448cb033e tempest-VolumesGetTest-994288544 None] Deleted volume successfully. Sep 03 14:29:50 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8c430440-e7ff-4fc2-a9a5-b432639028db tempest-VolumesSnapshotTestJSON-595514335 None] Acquiring lock "cinder-quobyte-5e3a84ae-4a37-4420-8236-df94a184af8d" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:29:50 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c2776574-9b33-4802-af4e-fe1448cb033e tempest-VolumesGetTest-994288544 None] Lock "cinder-64389e37-9577-45c9-af98-2af0e4b37aec-delete_volume" released by "delete_volume" :: held 2.147s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:29:50 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8c430440-e7ff-4fc2-a9a5-b432639028db tempest-VolumesSnapshotTestJSON-595514335 None] Lock "cinder-quobyte-5e3a84ae-4a37-4420-8236-df94a184af8d" acquired by "delete_volume" :: waited 0.025s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:29:50 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e2b4af-6455-4cca-a06f-16044126f450]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:29:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8c430440-e7ff-4fc2-a9a5-b432639028db tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e3a84ae-4a37-4420-8236-df94a184af8d {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:51 devstack sudo[101198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e3a84ae-4a37-4420-8236-df94a184af8d Sep 03 14:29:51 devstack sudo[101198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:51 devstack sudo[101198]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8c430440-e7ff-4fc2-a9a5-b432639028db tempest-VolumesSnapshotTestJSON-595514335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e3a84ae-4a37-4420-8236-df94a184af8d" returned: 0 in 0.580s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8c430440-e7ff-4fc2-a9a5-b432639028db tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e3a84ae-4a37-4420-8236-df94a184af8d {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:51 devstack sudo[101203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e3a84ae-4a37-4420-8236-df94a184af8d Sep 03 14:29:51 devstack sudo[101203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:51 devstack cinder-volume[87007]: DEBUG oslo_service.periodic_task [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87007) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 14:29:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:29:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:29:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:29:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:51 devstack sudo[101206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:29:51 devstack sudo[101206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:51 devstack sudo[101206]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.334s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:51 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:29:51 devstack cinder-volume[87007]: DEBUG oslo_service.periodic_task [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running periodic task VolumeManager._thread_info {{(pid=87007) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 14:29:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] thread count: 28 {{(pid=87007) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 14:29:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] thread info: [<_MainThread(MainThread, started 123689171054720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87007) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 14:29:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8c430440-e7ff-4fc2-a9a5-b432639028db tempest-VolumesSnapshotTestJSON-595514335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5e3a84ae-4a37-4420-8236-df94a184af8d" returned: 0 in 0.513s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:51 devstack sudo[101203]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:52 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8c430440-e7ff-4fc2-a9a5-b432639028db tempest-VolumesSnapshotTestJSON-595514335 None] Lock "cinder-quobyte-5e3a84ae-4a37-4420-8236-df94a184af8d" released by "delete_volume" :: held 1.180s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:29:52 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-8c430440-e7ff-4fc2-a9a5-b432639028db tempest-VolumesSnapshotTestJSON-595514335 None] Created reservations ['d5c8e9e3-8e12-4250-92ce-a425f774f4dc', '0731983a-2f92-4736-9876-bd3e7f6a8228', '109fe5ae-30d0-4797-8c83-0ade544e629c', '308c4c5a-e597-4ac4-ae1a-7ee1f04bd887'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:29:52 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:29:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Flow 'volume_create_manager' (9d97ee58-65b1-4e78-aecf-e04acd4329b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:29:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6618a603-7deb-4a66-b25b-44464fbb8535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6618a603-7deb-4a66-b25b-44464fbb8535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1174532351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caa999be-2a7a-479f-8045-4136d04f3108,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fdbced0b6bfb442a8fb0d5a0226b4a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:29:52Z,use_quota=True,user_id='b12dc60960114a4c90eefc4a785d7a38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f58dec22-21ed-4525-93f5-a10383cfcf4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f58dec22-21ed-4525-93f5-a10383cfcf4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eb9580e-10e1-4d51-a059-623ba8a21f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:52 devstack cinder-volume[87007]: DEBUG cinder.image.glance [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Creating Keystone auth plugin from conf {{(pid=87007) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 14:29:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8c430440-e7ff-4fc2-a9a5-b432639028db tempest-VolumesSnapshotTestJSON-595514335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8c430440-e7ff-4fc2-a9a5-b432639028db tempest-VolumesSnapshotTestJSON-595514335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:52 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-8c430440-e7ff-4fc2-a9a5-b432639028db tempest-VolumesSnapshotTestJSON-595514335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:29:52 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-8c430440-e7ff-4fc2-a9a5-b432639028db tempest-VolumesSnapshotTestJSON-595514335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:29:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8c430440-e7ff-4fc2-a9a5-b432639028db tempest-VolumesSnapshotTestJSON-595514335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:29:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8c430440-e7ff-4fc2-a9a5-b432639028db tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:52 devstack sudo[101210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:29:52 devstack sudo[101210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:52 devstack sudo[101210]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8c430440-e7ff-4fc2-a9a5-b432639028db tempest-VolumesSnapshotTestJSON-595514335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.370s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:52 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-8c430440-e7ff-4fc2-a9a5-b432639028db tempest-VolumesSnapshotTestJSON-595514335 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:29:52 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-8c430440-e7ff-4fc2-a9a5-b432639028db tempest-VolumesSnapshotTestJSON-595514335 None] Deleted volume successfully. Sep 03 14:29:52 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8c430440-e7ff-4fc2-a9a5-b432639028db tempest-VolumesSnapshotTestJSON-595514335 None] Lock "cinder-5e3a84ae-4a37-4420-8236-df94a184af8d-delete_volume" released by "delete_volume" :: held 1.962s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:29:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eb9580e-10e1-4d51-a059-623ba8a21f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'caa999be-2a7a-479f-8045-4136d04f3108', 'volume_name': 'volume-caa999be-2a7a-479f-8045-4136d04f3108', 'volume_size': 1, 'image_id': '49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd4e87261137045028f09a9da96d0acd8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'created_at': datetime.datetime(2026, 9, 3, 12, 12, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 12, 12, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/49981579-d0a4-4b4a-9bc6-bd809c76cea9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (138eb61d-e969-44b1-bf1c-60bcf8100bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (138eb61d-e969-44b1-bf1c-60bcf8100bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1af0c7a6-615f-4453-803e-3723eb963041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:52 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Volume caa999be-2a7a-479f-8045-4136d04f3108: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-caa999be-2a7a-479f-8045-4136d04f3108', 'volume_size': 1, 'image_id': '49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd4e87261137045028f09a9da96d0acd8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'created_at': datetime.datetime(2026, 9, 3, 12, 12, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 12, 12, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/49981579-d0a4-4b4a-9bc6-bd809c76cea9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 03 14:29:52 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Trying to clone caa999be-2a7a-479f-8045-4136d04f3108 from image 49981579-d0a4-4b4a-9bc6-bd809c76cea9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'metadata': {}}]). {{(pid=87007) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 14:29:53 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-6ed73709-b4e6-4929-9953-0bedd21c16d9 tempest-VolumesSnapshotTestJSON-595514335 None] Acquiring lock "cinder-82fe68f0-9191-41cf-a6a6-c769db715106-delete_snapshot" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:29:53 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-6ed73709-b4e6-4929-9953-0bedd21c16d9 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "cinder-82fe68f0-9191-41cf-a6a6-c769db715106-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:29:53 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-6ed73709-b4e6-4929-9953-0bedd21c16d9 tempest-VolumesSnapshotTestJSON-595514335 None] Acquiring lock "cinder-quobyte-f44087bd-ac91-4a62-9efc-c1b285bccb30" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:29:53 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-6ed73709-b4e6-4929-9953-0bedd21c16d9 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "cinder-quobyte-f44087bd-ac91-4a62-9efc-c1b285bccb30" acquired by "delete_snapshot" :: waited 0.069s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:29:53 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-6ed73709-b4e6-4929-9953-0bedd21c16d9 tempest-VolumesSnapshotTestJSON-595514335 None] Acquiring lock "cinder-quobyte-82fe68f0-9191-41cf-a6a6-c769db715106" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:29:53 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-6ed73709-b4e6-4929-9953-0bedd21c16d9 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "cinder-quobyte-82fe68f0-9191-41cf-a6a6-c769db715106" acquired by "_delete_snapshot" :: waited 0.056s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:29:53 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-6ed73709-b4e6-4929-9953-0bedd21c16d9 tempest-VolumesSnapshotTestJSON-595514335 None] Deleting offline snapshot 82fe68f0-9191-41cf-a6a6-c769db715106 of volume f44087bd-ac91-4a62-9efc-c1b285bccb30 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:29:53 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-6ed73709-b4e6-4929-9953-0bedd21c16d9 tempest-VolumesSnapshotTestJSON-595514335 None] snapshot_file for this snap is: volume-f44087bd-ac91-4a62-9efc-c1b285bccb30.82fe68f0-9191-41cf-a6a6-c769db715106 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:29:53 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[39abe998-9b15-4f9c-a52c-e180d754310a]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:29:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6ed73709-b4e6-4929-9953-0bedd21c16d9 tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30.82fe68f0-9191-41cf-a6a6-c769db715106 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:53 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_jp84xp5xdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87007) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 14:29:53 devstack cinder-volume[87007]: INFO cinder.image.image_utils [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Image download 20.69 MB at 20.69 MB/s Sep 03 14:29:53 devstack sudo[101634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30.82fe68f0-9191-41cf-a6a6-c769db715106 Sep 03 14:29:53 devstack sudo[101634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:53 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2fc2a1-918b-4109-9574-a2ecff729ec8]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:29:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_jp84xp5xdevstack@QuobyteHD {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:54 devstack sudo[101650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_jp84xp5xdevstack@QuobyteHD Sep 03 14:29:54 devstack sudo[101650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:54 devstack sudo[101634]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6ed73709-b4e6-4929-9953-0bedd21c16d9 tempest-VolumesSnapshotTestJSON-595514335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30.82fe68f0-9191-41cf-a6a6-c769db715106" returned: 0 in 0.789s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:54 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-6ed73709-b4e6-4929-9953-0bedd21c16d9 tempest-VolumesSnapshotTestJSON-595514335 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f44087bd-ac91-4a62-9efc-c1b285bccb30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:29:54 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[de64b6f7-d70e-4c5a-aa33-26a0ef93b0b7]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:29:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6ed73709-b4e6-4929-9953-0bedd21c16d9 tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:54 devstack sudo[101650]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_jp84xp5xdevstack@QuobyteHD" returned: 0 in 0.695s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:54 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Temporary image 49981579-d0a4-4b4a-9bc6-bd809c76cea9 is fetched for user b12dc60960114a4c90eefc4a785d7a38. {{(pid=87007) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 14:29:54 devstack sudo[101669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30 Sep 03 14:29:54 devstack sudo[101669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:54 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[820687b8-6504-4f73-bb38-c7ae2dc37f17]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:29:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_jp84xp5xdevstack@QuobyteHD {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:54 devstack sudo[101671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_jp84xp5xdevstack@QuobyteHD Sep 03 14:29:54 devstack sudo[101671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:54 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac09f815-4d63-477a-b2b5-6895ddc6465d tempest-VolumesDeleteCascade-358781585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:29:54 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ac09f815-4d63-477a-b2b5-6895ddc6465d tempest-VolumesDeleteCascade-358781585 None] Flow 'volume_create_manager' (f76e36a8-5173-4088-9b91-8e8b1ea08186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:29:54 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ac09f815-4d63-477a-b2b5-6895ddc6465d tempest-VolumesDeleteCascade-358781585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1da94cf6-39b5-4963-ab2e-e033e796a42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:55 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ac09f815-4d63-477a-b2b5-6895ddc6465d tempest-VolumesDeleteCascade-358781585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1da94cf6-39b5-4963-ab2e-e033e796a42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-896058806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa563246-5126-4c89-9078-d98a86123440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff30747820c84aba9490f6158c714c77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:29:55Z,use_quota=True,user_id='ecdf44dff4694c7e87c4854051aca632',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:55 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ac09f815-4d63-477a-b2b5-6895ddc6465d tempest-VolumesDeleteCascade-358781585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cf97b69-1322-4000-93c7-51cbabc70ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:55 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ac09f815-4d63-477a-b2b5-6895ddc6465d tempest-VolumesDeleteCascade-358781585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cf97b69-1322-4000-93c7-51cbabc70ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:55 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ac09f815-4d63-477a-b2b5-6895ddc6465d tempest-VolumesDeleteCascade-358781585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d98a091-6111-429c-9911-b7f4b439dc96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:55 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ac09f815-4d63-477a-b2b5-6895ddc6465d tempest-VolumesDeleteCascade-358781585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d98a091-6111-429c-9911-b7f4b439dc96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa563246-5126-4c89-9078-d98a86123440', 'volume_name': 'volume-fa563246-5126-4c89-9078-d98a86123440', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:55 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ac09f815-4d63-477a-b2b5-6895ddc6465d tempest-VolumesDeleteCascade-358781585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5e9dc88-37e3-488b-9cae-463717acd616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:55 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ac09f815-4d63-477a-b2b5-6895ddc6465d tempest-VolumesDeleteCascade-358781585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5e9dc88-37e3-488b-9cae-463717acd616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:55 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ac09f815-4d63-477a-b2b5-6895ddc6465d tempest-VolumesDeleteCascade-358781585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (460a8910-6c68-4c04-a352-4fbf53e845ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:55 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-ac09f815-4d63-477a-b2b5-6895ddc6465d tempest-VolumesDeleteCascade-358781585 None] Volume fa563246-5126-4c89-9078-d98a86123440: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa563246-5126-4c89-9078-d98a86123440', 'volume_size': 1} Sep 03 14:29:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ac09f815-4d63-477a-b2b5-6895ddc6465d tempest-VolumesDeleteCascade-358781585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ac09f815-4d63-477a-b2b5-6895ddc6465d tempest-VolumesDeleteCascade-358781585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:55 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ac09f815-4d63-477a-b2b5-6895ddc6465d tempest-VolumesDeleteCascade-358781585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-896058806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa563246-5126-4c89-9078-d98a86123440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff30747820c84aba9490f6158c714c77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:29:55Z,use_quota=True,user_id='ecdf44dff4694c7e87c4854051aca632',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:29:55 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-ac09f815-4d63-477a-b2b5-6895ddc6465d tempest-VolumesDeleteCascade-358781585 None] Creating volume fa563246-5126-4c89-9078-d98a86123440 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:29:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ac09f815-4d63-477a-b2b5-6895ddc6465d tempest-VolumesDeleteCascade-358781585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ac09f815-4d63-477a-b2b5-6895ddc6465d tempest-VolumesDeleteCascade-358781585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:55 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ac09f815-4d63-477a-b2b5-6895ddc6465d tempest-VolumesDeleteCascade-358781585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:29:55 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ac09f815-4d63-477a-b2b5-6895ddc6465d tempest-VolumesDeleteCascade-358781585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:29:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ac09f815-4d63-477a-b2b5-6895ddc6465d tempest-VolumesDeleteCascade-358781585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:29:55 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ac09f815-4d63-477a-b2b5-6895ddc6465d tempest-VolumesDeleteCascade-358781585 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:29:55 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-ac09f815-4d63-477a-b2b5-6895ddc6465d tempest-VolumesDeleteCascade-358781585 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:29:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ac09f815-4d63-477a-b2b5-6895ddc6465d tempest-VolumesDeleteCascade-358781585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:55 devstack sudo[101677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440 1073741824 Sep 03 14:29:55 devstack sudo[101677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:55 devstack sudo[101671]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_jp84xp5xdevstack@QuobyteHD" returned: 0 in 0.522s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:55 devstack sudo[101669]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6ed73709-b4e6-4929-9953-0bedd21c16d9 tempest-VolumesSnapshotTestJSON-595514335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30" returned: 0 in 0.866s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6ed73709-b4e6-4929-9953-0bedd21c16d9 tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30.82fe68f0-9191-41cf-a6a6-c769db715106 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:55 devstack sudo[101686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30.82fe68f0-9191-41cf-a6a6-c769db715106 Sep 03 14:29:55 devstack sudo[101686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:55 devstack sudo[101677]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ac09f815-4d63-477a-b2b5-6895ddc6465d tempest-VolumesDeleteCascade-358781585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440 1073741824" returned: 0 in 0.673s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ac09f815-4d63-477a-b2b5-6895ddc6465d tempest-VolumesDeleteCascade-358781585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:55 devstack sudo[101695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440 Sep 03 14:29:55 devstack sudo[101695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:55 devstack sudo[101686]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6ed73709-b4e6-4929-9953-0bedd21c16d9 tempest-VolumesSnapshotTestJSON-595514335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30.82fe68f0-9191-41cf-a6a6-c769db715106" returned: 0 in 0.530s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6ed73709-b4e6-4929-9953-0bedd21c16d9 tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30.82fe68f0-9191-41cf-a6a6-c769db715106 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:55 devstack sudo[101697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30.82fe68f0-9191-41cf-a6a6-c769db715106 Sep 03 14:29:55 devstack sudo[101697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:56 devstack sudo[101695]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ac09f815-4d63-477a-b2b5-6895ddc6465d tempest-VolumesDeleteCascade-358781585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440" returned: 0 in 0.269s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:56 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ac09f815-4d63-477a-b2b5-6895ddc6465d tempest-VolumesDeleteCascade-358781585 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:29:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ac09f815-4d63-477a-b2b5-6895ddc6465d tempest-VolumesDeleteCascade-358781585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:29:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.870s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:56 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1174532351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caa999be-2a7a-479f-8045-4136d04f3108,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fdbced0b6bfb442a8fb0d5a0226b4a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:29:52Z,use_quota=True,user_id='b12dc60960114a4c90eefc4a785d7a38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:29:56 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Creating volume caa999be-2a7a-479f-8045-4136d04f3108 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:29:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:56 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:29:56 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:29:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:29:56 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:29:56 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:29:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-caa999be-2a7a-479f-8045-4136d04f3108 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:56 devstack sudo[101700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-caa999be-2a7a-479f-8045-4136d04f3108 1073741824 Sep 03 14:29:56 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ac09f815-4d63-477a-b2b5-6895ddc6465d tempest-VolumesDeleteCascade-358781585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (460a8910-6c68-4c04-a352-4fbf53e845ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa563246-5126-4c89-9078-d98a86123440', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:56 devstack sudo[101700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:56 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ac09f815-4d63-477a-b2b5-6895ddc6465d tempest-VolumesDeleteCascade-358781585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b49add36-3d50-42b0-94e0-58215cd906e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:29:56 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-ac09f815-4d63-477a-b2b5-6895ddc6465d tempest-VolumesDeleteCascade-358781585 None] Volume volume-fa563246-5126-4c89-9078-d98a86123440 (fa563246-5126-4c89-9078-d98a86123440): created successfully Sep 03 14:29:56 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ac09f815-4d63-477a-b2b5-6895ddc6465d tempest-VolumesDeleteCascade-358781585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b49add36-3d50-42b0-94e0-58215cd906e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:29:56 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ac09f815-4d63-477a-b2b5-6895ddc6465d tempest-VolumesDeleteCascade-358781585 None] Flow 'volume_create_manager' (f76e36a8-5173-4088-9b91-8e8b1ea08186) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:29:56 devstack sudo[101697]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6ed73709-b4e6-4929-9953-0bedd21c16d9 tempest-VolumesSnapshotTestJSON-595514335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30.82fe68f0-9191-41cf-a6a6-c769db715106" returned: 0 in 0.281s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:56 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-ac09f815-4d63-477a-b2b5-6895ddc6465d tempest-VolumesDeleteCascade-358781585 None] Created volume successfully. Sep 03 14:29:56 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-6ed73709-b4e6-4929-9953-0bedd21c16d9 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "cinder-quobyte-82fe68f0-9191-41cf-a6a6-c769db715106" released by "_delete_snapshot" :: held 2.657s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:29:56 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-6ed73709-b4e6-4929-9953-0bedd21c16d9 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "cinder-quobyte-f44087bd-ac91-4a62-9efc-c1b285bccb30" released by "delete_snapshot" :: held 2.725s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:29:56 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-6ed73709-b4e6-4929-9953-0bedd21c16d9 tempest-VolumesSnapshotTestJSON-595514335 None] Created reservations ['12eb5c5b-0312-4d06-a294-549773310953', '26acd4c1-f340-4121-9ac6-69185f45330f', 'cd79bc63-a4a4-4021-a47e-e14dfabd9ef6', '2ec22dbc-4d79-4bdb-a9e6-918f188d4dcd'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:29:56 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-6ed73709-b4e6-4929-9953-0bedd21c16d9 tempest-VolumesSnapshotTestJSON-595514335 None] Delete snapshot completed successfully. Sep 03 14:29:56 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-6ed73709-b4e6-4929-9953-0bedd21c16d9 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "cinder-82fe68f0-9191-41cf-a6a6-c769db715106-delete_snapshot" released by "delete_snapshot" :: held 2.928s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:29:56 devstack sudo[101700]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-caa999be-2a7a-479f-8045-4136d04f3108 1073741824" returned: 0 in 0.499s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-caa999be-2a7a-479f-8045-4136d04f3108 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:56 devstack sudo[101708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-caa999be-2a7a-479f-8045-4136d04f3108 Sep 03 14:29:56 devstack sudo[101708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:56 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-eeed1eba-2c3f-4628-a355-9e9c53072ce8 tempest-VolumesSnapshotTestJSON-595514335 None] Acquiring lock "cinder-f44087bd-ac91-4a62-9efc-c1b285bccb30-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:29:56 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-eeed1eba-2c3f-4628-a355-9e9c53072ce8 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "cinder-f44087bd-ac91-4a62-9efc-c1b285bccb30-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:29:57 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-eeed1eba-2c3f-4628-a355-9e9c53072ce8 tempest-VolumesSnapshotTestJSON-595514335 None] Acquiring lock "cinder-quobyte-f44087bd-ac91-4a62-9efc-c1b285bccb30" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:29:57 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-eeed1eba-2c3f-4628-a355-9e9c53072ce8 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "cinder-quobyte-f44087bd-ac91-4a62-9efc-c1b285bccb30" acquired by "delete_volume" :: waited 0.032s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:29:57 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d54ed6b-d829-466a-8637-bc8c83a5ca65]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:29:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eeed1eba-2c3f-4628-a355-9e9c53072ce8 tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:57 devstack sudo[101708]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-caa999be-2a7a-479f-8045-4136d04f3108" returned: 0 in 0.534s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:57 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:29:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:29:57 devstack cinder-volume[87007]: DEBUG cinder.volume.volume_utils [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Attempting download of 49981579-d0a4-4b4a-9bc6-bd809c76cea9 ((None, [{'url': 'file:///opt/stack/data/glance/images/49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'metadata': {}}])) to volume caa999be-2a7a-479f-8045-4136d04f3108. {{(pid=87007) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 14:29:57 devstack sudo[101711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30 Sep 03 14:29:57 devstack sudo[101711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:57 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c619394-b6e1-4900-a32b-cbb69d19a29e]: (4, 'raw') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:29:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4deb62dd-fcc2-4498-82ac-cc05bf6bd3c5 tempest-VolumesDeleteCascade-358781585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4deb62dd-fcc2-4498-82ac-cc05bf6bd3c5 tempest-VolumesDeleteCascade-358781585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_49981579-d0a4-4b4a-9bc6-bd809c76cea9_loqt980l {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:57 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-4deb62dd-fcc2-4498-82ac-cc05bf6bd3c5 tempest-VolumesDeleteCascade-358781585 None] Creating offline snapshot aa4b6e5d-ab7e-4571-ac14-ce42feeceb76 of volume fa563246-5126-4c89-9078-d98a86123440 {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:29:57 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac8a5bd-80cb-4a27-8c5d-1579d17013f5]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:29:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4deb62dd-fcc2-4498-82ac-cc05bf6bd3c5 tempest-VolumesDeleteCascade-358781585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:57 devstack sudo[101713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_49981579-d0a4-4b4a-9bc6-bd809c76cea9_loqt980l Sep 03 14:29:57 devstack sudo[101713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:57 devstack sudo[101711]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eeed1eba-2c3f-4628-a355-9e9c53072ce8 tempest-VolumesSnapshotTestJSON-595514335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30" returned: 0 in 0.592s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eeed1eba-2c3f-4628-a355-9e9c53072ce8 tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:57 devstack sudo[101719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30 Sep 03 14:29:57 devstack sudo[101719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:57 devstack sudo[101714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440 Sep 03 14:29:57 devstack sudo[101714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:58 devstack sudo[101713]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_49981579-d0a4-4b4a-9bc6-bd809c76cea9_loqt980l" returned: 0 in 0.646s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49981579-d0a4-4b4a-9bc6-bd809c76cea9_loqt980l {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:58 devstack sudo[101719]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eeed1eba-2c3f-4628-a355-9e9c53072ce8 tempest-VolumesSnapshotTestJSON-595514335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f44087bd-ac91-4a62-9efc-c1b285bccb30" returned: 0 in 0.423s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:58 devstack sudo[101714]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4deb62dd-fcc2-4498-82ac-cc05bf6bd3c5 tempest-VolumesDeleteCascade-358781585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440" returned: 0 in 0.625s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4deb62dd-fcc2-4498-82ac-cc05bf6bd3c5 tempest-VolumesDeleteCascade-358781585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.aa4b6e5d-ab7e-4571-ac14-ce42feeceb76 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:58 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-eeed1eba-2c3f-4628-a355-9e9c53072ce8 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "cinder-quobyte-f44087bd-ac91-4a62-9efc-c1b285bccb30" released by "delete_volume" :: held 1.189s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:29:58 devstack sudo[101729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.aa4b6e5d-ab7e-4571-ac14-ce42feeceb76 1G Sep 03 14:29:58 devstack sudo[101729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:58 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-eeed1eba-2c3f-4628-a355-9e9c53072ce8 tempest-VolumesSnapshotTestJSON-595514335 None] Created reservations ['d86ee691-72d6-4845-872e-e346d68d396d', '176becb3-f880-4f1a-abe4-6a92a6fcef7a', '87bb2cc0-8a82-4814-a789-daeca44ab9a3', 'd8bed3ee-8a7d-4425-881b-2c0477eb6172'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:29:58 devstack sudo[101728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49981579-d0a4-4b4a-9bc6-bd809c76cea9_loqt980l Sep 03 14:29:58 devstack sudo[101728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-eeed1eba-2c3f-4628-a355-9e9c53072ce8 tempest-VolumesSnapshotTestJSON-595514335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:29:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-eeed1eba-2c3f-4628-a355-9e9c53072ce8 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:29:58 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-eeed1eba-2c3f-4628-a355-9e9c53072ce8 tempest-VolumesSnapshotTestJSON-595514335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:29:58 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-eeed1eba-2c3f-4628-a355-9e9c53072ce8 tempest-VolumesSnapshotTestJSON-595514335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:29:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-eeed1eba-2c3f-4628-a355-9e9c53072ce8 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:29:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eeed1eba-2c3f-4628-a355-9e9c53072ce8 tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:58 devstack sudo[101732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:29:58 devstack sudo[101732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:58 devstack sudo[101728]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49981579-d0a4-4b4a-9bc6-bd809c76cea9_loqt980l" returned: 1 in 0.537s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49981579-d0a4-4b4a-9bc6-bd809c76cea9_loqt980l' failed. Not Retrying. {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 14:29:58 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[000e4f60-3161-422e-b02b-f31dbd93b11a]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:29:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_jp84xp5xdevstack@QuobyteHD {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:58 devstack sudo[101732]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eeed1eba-2c3f-4628-a355-9e9c53072ce8 tempest-VolumesSnapshotTestJSON-595514335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.392s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:58 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-eeed1eba-2c3f-4628-a355-9e9c53072ce8 tempest-VolumesSnapshotTestJSON-595514335 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:29:58 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-eeed1eba-2c3f-4628-a355-9e9c53072ce8 tempest-VolumesSnapshotTestJSON-595514335 None] Deleted volume successfully. Sep 03 14:29:58 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-eeed1eba-2c3f-4628-a355-9e9c53072ce8 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "cinder-f44087bd-ac91-4a62-9efc-c1b285bccb30-delete_volume" released by "delete_volume" :: held 1.973s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:29:58 devstack sudo[101739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_jp84xp5xdevstack@QuobyteHD Sep 03 14:29:58 devstack sudo[101739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:58 devstack sudo[101729]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4deb62dd-fcc2-4498-82ac-cc05bf6bd3c5 tempest-VolumesDeleteCascade-358781585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.aa4b6e5d-ab7e-4571-ac14-ce42feeceb76 1G" returned: 0 in 0.716s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4deb62dd-fcc2-4498-82ac-cc05bf6bd3c5 tempest-VolumesDeleteCascade-358781585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa563246-5126-4c89-9078-d98a86123440 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.aa4b6e5d-ab7e-4571-ac14-ce42feeceb76 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:58 devstack sudo[101742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa563246-5126-4c89-9078-d98a86123440 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.aa4b6e5d-ab7e-4571-ac14-ce42feeceb76 Sep 03 14:29:58 devstack sudo[101742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:59 devstack sudo[101739]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_jp84xp5xdevstack@QuobyteHD" returned: 0 in 0.598s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:59 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] 49981579-d0a4-4b4a-9bc6-bd809c76cea9 was qcow2, converting to qcow2 {{(pid=87007) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 14:29:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_jp84xp5xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-caa999be-2a7a-479f-8045-4136d04f3108 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:59 devstack sudo[101752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_jp84xp5xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-caa999be-2a7a-479f-8045-4136d04f3108 Sep 03 14:29:59 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:59 devstack sudo[101742]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:59 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-141896a9-9632-4621-9107-4b263f110228 tempest-VolumesSnapshotTestJSON-595514335 None] Acquiring lock "cinder-c08c0373-6788-473f-adc8-c5dfabb001a2-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:29:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4deb62dd-fcc2-4498-82ac-cc05bf6bd3c5 tempest-VolumesDeleteCascade-358781585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa563246-5126-4c89-9078-d98a86123440 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.aa4b6e5d-ab7e-4571-ac14-ce42feeceb76" returned: 0 in 0.469s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:59 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-4deb62dd-fcc2-4498-82ac-cc05bf6bd3c5 tempest-VolumesDeleteCascade-358781585 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.aa4b6e5d-ab7e-4571-ac14-ce42feeceb76 is being set with open permissions: ugo+rw Sep 03 14:29:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4deb62dd-fcc2-4498-82ac-cc05bf6bd3c5 tempest-VolumesDeleteCascade-358781585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.aa4b6e5d-ab7e-4571-ac14-ce42feeceb76 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:59 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-141896a9-9632-4621-9107-4b263f110228 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "cinder-c08c0373-6788-473f-adc8-c5dfabb001a2-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:29:59 devstack sudo[101754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.aa4b6e5d-ab7e-4571-ac14-ce42feeceb76 Sep 03 14:29:59 devstack sudo[101754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:59 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-141896a9-9632-4621-9107-4b263f110228 tempest-VolumesSnapshotTestJSON-595514335 None] Acquiring lock "cinder-quobyte-c08c0373-6788-473f-adc8-c5dfabb001a2" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:29:59 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-141896a9-9632-4621-9107-4b263f110228 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "cinder-quobyte-c08c0373-6788-473f-adc8-c5dfabb001a2" acquired by "delete_volume" :: waited 0.041s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:29:59 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32840b8-d971-4e51-bd6e-2c7b7454f2d1]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:29:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-141896a9-9632-4621-9107-4b263f110228 tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c08c0373-6788-473f-adc8-c5dfabb001a2 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:59 devstack sudo[101754]: pam_unix(sudo:session): session closed for user root Sep 03 14:29:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4deb62dd-fcc2-4498-82ac-cc05bf6bd3c5 tempest-VolumesDeleteCascade-358781585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.aa4b6e5d-ab7e-4571-ac14-ce42feeceb76" returned: 0 in 0.471s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:29:59 devstack sudo[101756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c08c0373-6788-473f-adc8-c5dfabb001a2 Sep 03 14:29:59 devstack sudo[101756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:29:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4deb62dd-fcc2-4498-82ac-cc05bf6bd3c5 tempest-VolumesDeleteCascade-358781585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:29:59 devstack sudo[101764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.info Sep 03 14:29:59 devstack sudo[101764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:00 devstack sudo[101764]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4deb62dd-fcc2-4498-82ac-cc05bf6bd3c5 tempest-VolumesDeleteCascade-358781585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.info" returned: 0 in 0.439s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:00 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-4deb62dd-fcc2-4498-82ac-cc05bf6bd3c5 tempest-VolumesDeleteCascade-358781585 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.info is being set with open permissions: ugo+rw Sep 03 14:30:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4deb62dd-fcc2-4498-82ac-cc05bf6bd3c5 tempest-VolumesDeleteCascade-358781585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:00 devstack sudo[101756]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-141896a9-9632-4621-9107-4b263f110228 tempest-VolumesSnapshotTestJSON-595514335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c08c0373-6788-473f-adc8-c5dfabb001a2" returned: 0 in 0.742s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-141896a9-9632-4621-9107-4b263f110228 tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c08c0373-6788-473f-adc8-c5dfabb001a2 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:00 devstack sudo[101770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.info Sep 03 14:30:00 devstack sudo[101770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:00 devstack sudo[101772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c08c0373-6788-473f-adc8-c5dfabb001a2 Sep 03 14:30:00 devstack sudo[101772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:00 devstack sudo[101772]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-141896a9-9632-4621-9107-4b263f110228 tempest-VolumesSnapshotTestJSON-595514335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c08c0373-6788-473f-adc8-c5dfabb001a2" returned: 0 in 0.398s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:00 devstack sudo[101770]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4deb62dd-fcc2-4498-82ac-cc05bf6bd3c5 tempest-VolumesDeleteCascade-358781585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.info" returned: 0 in 0.468s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4deb62dd-fcc2-4498-82ac-cc05bf6bd3c5 tempest-VolumesDeleteCascade-358781585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.390s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:30:00 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-141896a9-9632-4621-9107-4b263f110228 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "cinder-quobyte-c08c0373-6788-473f-adc8-c5dfabb001a2" released by "delete_volume" :: held 1.282s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:30:00 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-4deb62dd-fcc2-4498-82ac-cc05bf6bd3c5 tempest-VolumesDeleteCascade-358781585 None] Create snapshot completed successfully Sep 03 14:30:00 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-141896a9-9632-4621-9107-4b263f110228 tempest-VolumesSnapshotTestJSON-595514335 None] Created reservations ['a3f35bfb-d0fa-45b4-8d79-3faec1cc2415', '14679b47-6bf8-43c0-b0bf-88f88f2e4374', 'a0298178-dd5d-41c0-8a03-80bc3458c5d6', '52b046d1-626f-4487-b5fb-e2e6f5285581'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:30:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-141896a9-9632-4621-9107-4b263f110228 tempest-VolumesSnapshotTestJSON-595514335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:30:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-141896a9-9632-4621-9107-4b263f110228 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:30:01 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-141896a9-9632-4621-9107-4b263f110228 tempest-VolumesSnapshotTestJSON-595514335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:30:01 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-141896a9-9632-4621-9107-4b263f110228 tempest-VolumesSnapshotTestJSON-595514335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:30:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-141896a9-9632-4621-9107-4b263f110228 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:30:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-141896a9-9632-4621-9107-4b263f110228 tempest-VolumesSnapshotTestJSON-595514335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:01 devstack sudo[101776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:30:01 devstack sudo[101776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:01 devstack sudo[101776]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-141896a9-9632-4621-9107-4b263f110228 tempest-VolumesSnapshotTestJSON-595514335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.346s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:01 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-141896a9-9632-4621-9107-4b263f110228 tempest-VolumesSnapshotTestJSON-595514335 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:30:01 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-141896a9-9632-4621-9107-4b263f110228 tempest-VolumesSnapshotTestJSON-595514335 None] Deleted volume successfully. Sep 03 14:30:01 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-141896a9-9632-4621-9107-4b263f110228 tempest-VolumesSnapshotTestJSON-595514335 None] Lock "cinder-c08c0373-6788-473f-adc8-c5dfabb001a2-delete_volume" released by "delete_volume" :: held 2.069s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:30:01 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_jp84xp5xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-caa999be-2a7a-479f-8045-4136d04f3108" returned: 0 in 2.618s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:01 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_49981579-d0a4-4b4a-9bc6-bd809c76cea9_jp84xp5xdevstack@QuobyteHD, size 112.00 MB, duration 2.62 sec, destination /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-caa999be-2a7a-479f-8045-4136d04f3108 {{(pid=87007) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 14:30:01 devstack cinder-volume[87007]: INFO cinder.image.image_utils [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Converted 112.00 MB image at 42.74 MB/s Sep 03 14:30:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-caa999be-2a7a-479f-8045-4136d04f3108 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:01 devstack sudo[101780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-caa999be-2a7a-479f-8045-4136d04f3108 1G Sep 03 14:30:01 devstack sudo[101780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-48e8eeec-e75a-4d9f-8180-a4c1601d8f7d tempest-VolumesDeleteCascade-358781585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:30:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-48e8eeec-e75a-4d9f-8180-a4c1601d8f7d tempest-VolumesDeleteCascade-358781585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:30:02 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-48e8eeec-e75a-4d9f-8180-a4c1601d8f7d tempest-VolumesDeleteCascade-358781585 None] Creating offline snapshot 6182a942-860c-46ed-a80c-aa5c64905430 of volume fa563246-5126-4c89-9078-d98a86123440 {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:30:02 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f04f5b6-6fc4-4cc2-8a5b-2979451eb0ea]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:30:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-48e8eeec-e75a-4d9f-8180-a4c1601d8f7d tempest-VolumesDeleteCascade-358781585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.aa4b6e5d-ab7e-4571-ac14-ce42feeceb76 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:02 devstack sudo[101785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.aa4b6e5d-ab7e-4571-ac14-ce42feeceb76 Sep 03 14:30:02 devstack sudo[101785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:02 devstack sudo[101780]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-caa999be-2a7a-479f-8045-4136d04f3108 1G" returned: 0 in 0.615s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:02 devstack cinder-volume[87007]: DEBUG cinder.volume.volume_utils [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Downloaded image 49981579-d0a4-4b4a-9bc6-bd809c76cea9 ((None, [{'url': 'file:///opt/stack/data/glance/images/49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'metadata': {}}])) to volume caa999be-2a7a-479f-8045-4136d04f3108 successfully. {{(pid=87007) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 14:30:02 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Temporary image 49981579-d0a4-4b4a-9bc6-bd809c76cea9 for user b12dc60960114a4c90eefc4a785d7a38 is deleted. {{(pid=87007) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 14:30:02 devstack cinder-volume[87007]: DEBUG cinder.volume.volume_utils [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Marking volume caa999be-2a7a-479f-8045-4136d04f3108 as bootable. {{(pid=87007) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 14:30:02 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Copying metadata from image 49981579-d0a4-4b4a-9bc6-bd809c76cea9 to caa999be-2a7a-479f-8045-4136d04f3108. {{(pid=87007) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 14:30:02 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Creating volume glance metadata for volume caa999be-2a7a-479f-8045-4136d04f3108 backed by image 49981579-d0a4-4b4a-9bc6-bd809c76cea9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87007) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 14:30:02 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1af0c7a6-615f-4453-803e-3723eb963041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caa999be-2a7a-479f-8045-4136d04f3108', 'volume_size': 1, 'image_id': '49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd4e87261137045028f09a9da96d0acd8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '49981579-d0a4-4b4a-9bc6-bd809c76cea9', 'created_at': datetime.datetime(2026, 9, 3, 12, 12, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 12, 12, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/49981579-d0a4-4b4a-9bc6-bd809c76cea9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:02 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (170bce52-7df5-4c13-8597-2bbc1dd1bb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:02 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Volume volume-caa999be-2a7a-479f-8045-4136d04f3108 (caa999be-2a7a-479f-8045-4136d04f3108): created successfully Sep 03 14:30:02 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (170bce52-7df5-4c13-8597-2bbc1dd1bb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:02 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Flow 'volume_create_manager' (9d97ee58-65b1-4e78-aecf-e04acd4329b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:30:02 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-b75fc18e-e0e8-42be-aa28-a7a49568e301 tempest-VolumesGetTest-994288544 None] Created volume successfully. Sep 03 14:30:02 devstack sudo[101785]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-48e8eeec-e75a-4d9f-8180-a4c1601d8f7d tempest-VolumesDeleteCascade-358781585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.aa4b6e5d-ab7e-4571-ac14-ce42feeceb76" returned: 0 in 0.558s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:02 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-48e8eeec-e75a-4d9f-8180-a4c1601d8f7d tempest-VolumesDeleteCascade-358781585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa563246-5126-4c89-9078-d98a86123440(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:30:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-48e8eeec-e75a-4d9f-8180-a4c1601d8f7d tempest-VolumesDeleteCascade-358781585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.aa4b6e5d-ab7e-4571-ac14-ce42feeceb76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.6182a942-860c-46ed-a80c-aa5c64905430 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:02 devstack sudo[101793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.aa4b6e5d-ab7e-4571-ac14-ce42feeceb76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.6182a942-860c-46ed-a80c-aa5c64905430 1G Sep 03 14:30:02 devstack sudo[101793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:03 devstack sudo[101793]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-48e8eeec-e75a-4d9f-8180-a4c1601d8f7d tempest-VolumesDeleteCascade-358781585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.aa4b6e5d-ab7e-4571-ac14-ce42feeceb76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.6182a942-860c-46ed-a80c-aa5c64905430 1G" returned: 0 in 0.636s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-48e8eeec-e75a-4d9f-8180-a4c1601d8f7d tempest-VolumesDeleteCascade-358781585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa563246-5126-4c89-9078-d98a86123440.aa4b6e5d-ab7e-4571-ac14-ce42feeceb76 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.6182a942-860c-46ed-a80c-aa5c64905430 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:03 devstack sudo[101799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa563246-5126-4c89-9078-d98a86123440.aa4b6e5d-ab7e-4571-ac14-ce42feeceb76 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.6182a942-860c-46ed-a80c-aa5c64905430 Sep 03 14:30:03 devstack sudo[101799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:03 devstack sudo[101799]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-48e8eeec-e75a-4d9f-8180-a4c1601d8f7d tempest-VolumesDeleteCascade-358781585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa563246-5126-4c89-9078-d98a86123440.aa4b6e5d-ab7e-4571-ac14-ce42feeceb76 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.6182a942-860c-46ed-a80c-aa5c64905430" returned: 0 in 0.433s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:03 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-48e8eeec-e75a-4d9f-8180-a4c1601d8f7d tempest-VolumesDeleteCascade-358781585 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.6182a942-860c-46ed-a80c-aa5c64905430 is being set with open permissions: ugo+rw Sep 03 14:30:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-48e8eeec-e75a-4d9f-8180-a4c1601d8f7d tempest-VolumesDeleteCascade-358781585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.6182a942-860c-46ed-a80c-aa5c64905430 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:04 devstack sudo[101804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.6182a942-860c-46ed-a80c-aa5c64905430 Sep 03 14:30:04 devstack sudo[101804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:04 devstack sudo[101804]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-48e8eeec-e75a-4d9f-8180-a4c1601d8f7d tempest-VolumesDeleteCascade-358781585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.6182a942-860c-46ed-a80c-aa5c64905430" returned: 0 in 0.295s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-48e8eeec-e75a-4d9f-8180-a4c1601d8f7d tempest-VolumesDeleteCascade-358781585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.129s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:30:04 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-48e8eeec-e75a-4d9f-8180-a4c1601d8f7d tempest-VolumesDeleteCascade-358781585 None] Create snapshot completed successfully Sep 03 14:30:04 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-362b4056-dd53-40d6-abd0-a7c937c11396 tempest-VolumesGetTest-994288544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:30:04 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-362b4056-dd53-40d6-abd0-a7c937c11396 tempest-VolumesGetTest-994288544 None] Flow 'volume_create_manager' (dbe318e2-c62d-40eb-a5e0-4a4994deb6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:30:04 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-362b4056-dd53-40d6-abd0-a7c937c11396 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adf13269-11f5-42ef-9e18-3b4906c88789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:04 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-362b4056-dd53-40d6-abd0-a7c937c11396 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adf13269-11f5-42ef-9e18-3b4906c88789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:30:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1586809826',display_name='tempest-VolumesGetTest-Volume-966676838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fac2461c-9549-43a9-9abc-5c0a533cfcc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdbced0b6bfb442a8fb0d5a0226b4a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:30:04Z,use_quota=True,user_id='b12dc60960114a4c90eefc4a785d7a38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:04 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-362b4056-dd53-40d6-abd0-a7c937c11396 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88286a6a-ff06-40c5-a842-5ca2eca06187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:04 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-362b4056-dd53-40d6-abd0-a7c937c11396 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88286a6a-ff06-40c5-a842-5ca2eca06187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:04 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-362b4056-dd53-40d6-abd0-a7c937c11396 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (933fa807-a672-4fd0-8eed-36e73902d86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:04 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-362b4056-dd53-40d6-abd0-a7c937c11396 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (933fa807-a672-4fd0-8eed-36e73902d86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fac2461c-9549-43a9-9abc-5c0a533cfcc6', 'volume_name': 'volume-fac2461c-9549-43a9-9abc-5c0a533cfcc6', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:04 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-362b4056-dd53-40d6-abd0-a7c937c11396 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67a10f48-74fd-4a37-b5be-579c9fce79db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:04 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-362b4056-dd53-40d6-abd0-a7c937c11396 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67a10f48-74fd-4a37-b5be-579c9fce79db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:04 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-362b4056-dd53-40d6-abd0-a7c937c11396 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad69e2f2-7bff-4d0a-a9ea-e7cbd47f2fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:04 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-362b4056-dd53-40d6-abd0-a7c937c11396 tempest-VolumesGetTest-994288544 None] Volume fac2461c-9549-43a9-9abc-5c0a533cfcc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fac2461c-9549-43a9-9abc-5c0a533cfcc6', 'volume_size': 1} Sep 03 14:30:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-362b4056-dd53-40d6-abd0-a7c937c11396 tempest-VolumesGetTest-994288544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:30:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-362b4056-dd53-40d6-abd0-a7c937c11396 tempest-VolumesGetTest-994288544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:30:04 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-362b4056-dd53-40d6-abd0-a7c937c11396 tempest-VolumesGetTest-994288544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:30:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1586809826',display_name='tempest-VolumesGetTest-Volume-966676838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fac2461c-9549-43a9-9abc-5c0a533cfcc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdbced0b6bfb442a8fb0d5a0226b4a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:30:04Z,use_quota=True,user_id='b12dc60960114a4c90eefc4a785d7a38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:30:04 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-362b4056-dd53-40d6-abd0-a7c937c11396 tempest-VolumesGetTest-994288544 None] Creating volume fac2461c-9549-43a9-9abc-5c0a533cfcc6 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:30:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-362b4056-dd53-40d6-abd0-a7c937c11396 tempest-VolumesGetTest-994288544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:30:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-362b4056-dd53-40d6-abd0-a7c937c11396 tempest-VolumesGetTest-994288544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:30:04 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-362b4056-dd53-40d6-abd0-a7c937c11396 tempest-VolumesGetTest-994288544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:30:04 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-362b4056-dd53-40d6-abd0-a7c937c11396 tempest-VolumesGetTest-994288544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:30:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-362b4056-dd53-40d6-abd0-a7c937c11396 tempest-VolumesGetTest-994288544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:30:04 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-362b4056-dd53-40d6-abd0-a7c937c11396 tempest-VolumesGetTest-994288544 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:30:04 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-362b4056-dd53-40d6-abd0-a7c937c11396 tempest-VolumesGetTest-994288544 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:30:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-362b4056-dd53-40d6-abd0-a7c937c11396 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fac2461c-9549-43a9-9abc-5c0a533cfcc6 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:04 devstack sudo[101808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fac2461c-9549-43a9-9abc-5c0a533cfcc6 1073741824 Sep 03 14:30:04 devstack sudo[101808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:04 devstack sudo[101808]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-362b4056-dd53-40d6-abd0-a7c937c11396 tempest-VolumesGetTest-994288544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fac2461c-9549-43a9-9abc-5c0a533cfcc6 1073741824" returned: 0 in 0.435s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-362b4056-dd53-40d6-abd0-a7c937c11396 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fac2461c-9549-43a9-9abc-5c0a533cfcc6 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:05 devstack sudo[101814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fac2461c-9549-43a9-9abc-5c0a533cfcc6 Sep 03 14:30:05 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:05 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-362b4056-dd53-40d6-abd0-a7c937c11396 tempest-VolumesGetTest-994288544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fac2461c-9549-43a9-9abc-5c0a533cfcc6" returned: 0 in 0.297s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:05 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-362b4056-dd53-40d6-abd0-a7c937c11396 tempest-VolumesGetTest-994288544 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:30:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-362b4056-dd53-40d6-abd0-a7c937c11396 tempest-VolumesGetTest-994288544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:30:05 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-362b4056-dd53-40d6-abd0-a7c937c11396 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad69e2f2-7bff-4d0a-a9ea-e7cbd47f2fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fac2461c-9549-43a9-9abc-5c0a533cfcc6', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:05 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-362b4056-dd53-40d6-abd0-a7c937c11396 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45bd73d5-73d8-4e08-a093-ee1a15bfdfc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:05 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-362b4056-dd53-40d6-abd0-a7c937c11396 tempest-VolumesGetTest-994288544 None] Volume volume-fac2461c-9549-43a9-9abc-5c0a533cfcc6 (fac2461c-9549-43a9-9abc-5c0a533cfcc6): created successfully Sep 03 14:30:05 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-362b4056-dd53-40d6-abd0-a7c937c11396 tempest-VolumesGetTest-994288544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45bd73d5-73d8-4e08-a093-ee1a15bfdfc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:05 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-362b4056-dd53-40d6-abd0-a7c937c11396 tempest-VolumesGetTest-994288544 None] Flow 'volume_create_manager' (dbe318e2-c62d-40eb-a5e0-4a4994deb6e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:30:05 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-362b4056-dd53-40d6-abd0-a7c937c11396 tempest-VolumesGetTest-994288544 None] Created volume successfully. Sep 03 14:30:05 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Acquiring lock "cinder-fa563246-5126-4c89-9078-d98a86123440-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:30:05 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Lock "cinder-fa563246-5126-4c89-9078-d98a86123440-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:30:05 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Performing cascade delete. {{(pid=87007) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 03 14:30:05 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Acquiring lock "cinder-6182a942-860c-46ed-a80c-aa5c64905430-delete_snapshot" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:30:05 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Lock "cinder-6182a942-860c-46ed-a80c-aa5c64905430-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:30:05 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Acquiring lock "cinder-quobyte-fa563246-5126-4c89-9078-d98a86123440" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:30:05 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Lock "cinder-quobyte-fa563246-5126-4c89-9078-d98a86123440" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:30:05 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Acquiring lock "cinder-quobyte-6182a942-860c-46ed-a80c-aa5c64905430" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:30:05 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Lock "cinder-quobyte-6182a942-860c-46ed-a80c-aa5c64905430" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:30:05 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Deleting offline snapshot 6182a942-860c-46ed-a80c-aa5c64905430 of volume fa563246-5126-4c89-9078-d98a86123440 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:30:05 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] snapshot_file for this snap is: volume-fa563246-5126-4c89-9078-d98a86123440.6182a942-860c-46ed-a80c-aa5c64905430 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:30:05 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[22da3fab-bf85-4e94-b376-48ab48f709d4]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:30:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.6182a942-860c-46ed-a80c-aa5c64905430 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:05 devstack sudo[101817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.6182a942-860c-46ed-a80c-aa5c64905430 Sep 03 14:30:05 devstack sudo[101817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:06 devstack sudo[101817]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.6182a942-860c-46ed-a80c-aa5c64905430" returned: 0 in 0.374s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:06 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa563246-5126-4c89-9078-d98a86123440(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:30:06 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb9e783-771d-4c1a-a7fd-a6e3ca936d52]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:30:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.aa4b6e5d-ab7e-4571-ac14-ce42feeceb76 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:06 devstack sudo[101823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.aa4b6e5d-ab7e-4571-ac14-ce42feeceb76 Sep 03 14:30:06 devstack sudo[101823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:06 devstack sudo[101823]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.aa4b6e5d-ab7e-4571-ac14-ce42feeceb76" returned: 0 in 0.426s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:06 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa563246-5126-4c89-9078-d98a86123440(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:30:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.6182a942-860c-46ed-a80c-aa5c64905430 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:06 devstack sudo[101830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.6182a942-860c-46ed-a80c-aa5c64905430 Sep 03 14:30:06 devstack sudo[101830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:06 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a0b0d4a2-961b-4df3-b007-f6cedad7b3be tempest-VolumesGetTest-994288544 None] Acquiring lock "cinder-fac2461c-9549-43a9-9abc-5c0a533cfcc6-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:30:06 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a0b0d4a2-961b-4df3-b007-f6cedad7b3be tempest-VolumesGetTest-994288544 None] Lock "cinder-fac2461c-9549-43a9-9abc-5c0a533cfcc6-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:30:06 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a0b0d4a2-961b-4df3-b007-f6cedad7b3be tempest-VolumesGetTest-994288544 None] Acquiring lock "cinder-quobyte-fac2461c-9549-43a9-9abc-5c0a533cfcc6" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:30:06 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a0b0d4a2-961b-4df3-b007-f6cedad7b3be tempest-VolumesGetTest-994288544 None] Lock "cinder-quobyte-fac2461c-9549-43a9-9abc-5c0a533cfcc6" acquired by "delete_volume" :: waited 0.049s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:30:06 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9ce867-29af-45e9-8f71-c749ccea846e]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:30:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a0b0d4a2-961b-4df3-b007-f6cedad7b3be tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fac2461c-9549-43a9-9abc-5c0a533cfcc6 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:07 devstack sudo[101832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fac2461c-9549-43a9-9abc-5c0a533cfcc6 Sep 03 14:30:07 devstack sudo[101832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:07 devstack sudo[101830]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.6182a942-860c-46ed-a80c-aa5c64905430" returned: 0 in 0.895s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.6182a942-860c-46ed-a80c-aa5c64905430 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:07 devstack sudo[101875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.6182a942-860c-46ed-a80c-aa5c64905430 Sep 03 14:30:07 devstack sudo[101875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:07 devstack sudo[101832]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a0b0d4a2-961b-4df3-b007-f6cedad7b3be tempest-VolumesGetTest-994288544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fac2461c-9549-43a9-9abc-5c0a533cfcc6" returned: 0 in 0.681s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a0b0d4a2-961b-4df3-b007-f6cedad7b3be tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fac2461c-9549-43a9-9abc-5c0a533cfcc6 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:07 devstack sudo[101880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fac2461c-9549-43a9-9abc-5c0a533cfcc6 Sep 03 14:30:07 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:07 devstack sudo[101875]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.6182a942-860c-46ed-a80c-aa5c64905430" returned: 0 in 0.464s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:07 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Lock "cinder-quobyte-6182a942-860c-46ed-a80c-aa5c64905430" released by "_delete_snapshot" :: held 2.294s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:30:07 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Lock "cinder-quobyte-fa563246-5126-4c89-9078-d98a86123440" released by "delete_snapshot" :: held 2.323s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:30:08 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Created reservations ['c5a2636f-ba75-4be6-a609-c9e791097978', '9cb320d7-480f-4945-b453-8a70a9248b10', '6ef8b5ba-ac0d-4e00-9f0b-e1dcb2b9fabd', 'a0a6d378-f51e-4c8a-beb9-7abd7da3c7e7'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:30:08 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a0b0d4a2-961b-4df3-b007-f6cedad7b3be tempest-VolumesGetTest-994288544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fac2461c-9549-43a9-9abc-5c0a533cfcc6" returned: 0 in 0.568s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:08 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a0b0d4a2-961b-4df3-b007-f6cedad7b3be tempest-VolumesGetTest-994288544 None] Lock "cinder-quobyte-fac2461c-9549-43a9-9abc-5c0a533cfcc6" released by "delete_volume" :: held 1.309s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:30:08 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Delete snapshot completed successfully. Sep 03 14:30:08 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Lock "cinder-6182a942-860c-46ed-a80c-aa5c64905430-delete_snapshot" released by "delete_snapshot" :: held 2.651s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:30:08 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Acquiring lock "cinder-aa4b6e5d-ab7e-4571-ac14-ce42feeceb76-delete_snapshot" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:30:08 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-a0b0d4a2-961b-4df3-b007-f6cedad7b3be tempest-VolumesGetTest-994288544 None] Created reservations ['e2e69ec4-8801-44c5-9824-dcaf6f3ebf3c', '0816bade-7244-4bba-b08b-dc45dfb84716', 'c2d0512f-3d42-4058-b6fa-870d7f0d446a', '37094f33-24b8-4986-84f7-d6a5b7d51297'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:30:08 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Lock "cinder-aa4b6e5d-ab7e-4571-ac14-ce42feeceb76-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:30:08 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Acquiring lock "cinder-quobyte-fa563246-5126-4c89-9078-d98a86123440" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:30:08 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Lock "cinder-quobyte-fa563246-5126-4c89-9078-d98a86123440" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:30:08 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Acquiring lock "cinder-quobyte-aa4b6e5d-ab7e-4571-ac14-ce42feeceb76" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:30:08 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Lock "cinder-quobyte-aa4b6e5d-ab7e-4571-ac14-ce42feeceb76" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:30:08 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Deleting offline snapshot aa4b6e5d-ab7e-4571-ac14-ce42feeceb76 of volume fa563246-5126-4c89-9078-d98a86123440 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:30:08 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] snapshot_file for this snap is: volume-fa563246-5126-4c89-9078-d98a86123440.aa4b6e5d-ab7e-4571-ac14-ce42feeceb76 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:30:08 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf0db10-a42f-4792-a8f2-7720058ed1ff]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:30:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.aa4b6e5d-ab7e-4571-ac14-ce42feeceb76 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a0b0d4a2-961b-4df3-b007-f6cedad7b3be tempest-VolumesGetTest-994288544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:30:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a0b0d4a2-961b-4df3-b007-f6cedad7b3be tempest-VolumesGetTest-994288544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:30:08 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a0b0d4a2-961b-4df3-b007-f6cedad7b3be tempest-VolumesGetTest-994288544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:30:08 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a0b0d4a2-961b-4df3-b007-f6cedad7b3be tempest-VolumesGetTest-994288544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:30:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a0b0d4a2-961b-4df3-b007-f6cedad7b3be tempest-VolumesGetTest-994288544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:30:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a0b0d4a2-961b-4df3-b007-f6cedad7b3be tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:08 devstack sudo[101889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:30:08 devstack sudo[101889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:08 devstack sudo[101888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.aa4b6e5d-ab7e-4571-ac14-ce42feeceb76 Sep 03 14:30:08 devstack sudo[101888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:08 devstack sudo[101889]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a0b0d4a2-961b-4df3-b007-f6cedad7b3be tempest-VolumesGetTest-994288544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.278s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:08 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-a0b0d4a2-961b-4df3-b007-f6cedad7b3be tempest-VolumesGetTest-994288544 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:30:08 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-a0b0d4a2-961b-4df3-b007-f6cedad7b3be tempest-VolumesGetTest-994288544 None] Deleted volume successfully. Sep 03 14:30:08 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a0b0d4a2-961b-4df3-b007-f6cedad7b3be tempest-VolumesGetTest-994288544 None] Lock "cinder-fac2461c-9549-43a9-9abc-5c0a533cfcc6-delete_volume" released by "delete_volume" :: held 2.019s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:30:08 devstack sudo[101888]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.aa4b6e5d-ab7e-4571-ac14-ce42feeceb76" returned: 0 in 0.426s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:08 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa563246-5126-4c89-9078-d98a86123440(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:30:08 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[47093702-524f-4c67-bc2b-807d0e151b56]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:30:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:09 devstack sudo[101896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440 Sep 03 14:30:09 devstack sudo[101896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:09 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-f94bfb52-ea2a-49b5-a481-9bf29c870b02 tempest-VolumesGetTest-994288544 None] Acquiring lock "cinder-caa999be-2a7a-479f-8045-4136d04f3108-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:30:09 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-f94bfb52-ea2a-49b5-a481-9bf29c870b02 tempest-VolumesGetTest-994288544 None] Lock "cinder-caa999be-2a7a-479f-8045-4136d04f3108-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:30:09 devstack sudo[101896]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440" returned: 0 in 0.527s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.aa4b6e5d-ab7e-4571-ac14-ce42feeceb76 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:09 devstack sudo[101901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.aa4b6e5d-ab7e-4571-ac14-ce42feeceb76 Sep 03 14:30:09 devstack sudo[101901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:09 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-f94bfb52-ea2a-49b5-a481-9bf29c870b02 tempest-VolumesGetTest-994288544 None] Acquiring lock "cinder-quobyte-caa999be-2a7a-479f-8045-4136d04f3108" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:30:09 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-f94bfb52-ea2a-49b5-a481-9bf29c870b02 tempest-VolumesGetTest-994288544 None] Lock "cinder-quobyte-caa999be-2a7a-479f-8045-4136d04f3108" acquired by "delete_volume" :: waited 0.036s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:30:09 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f985aeb9-3f76-4f5f-a05c-e8c9d2dd966a]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:30:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f94bfb52-ea2a-49b5-a481-9bf29c870b02 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-caa999be-2a7a-479f-8045-4136d04f3108 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:09 devstack sudo[101903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-caa999be-2a7a-479f-8045-4136d04f3108 Sep 03 14:30:09 devstack sudo[101903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:09 devstack sudo[101901]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.aa4b6e5d-ab7e-4571-ac14-ce42feeceb76" returned: 0 in 0.416s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.aa4b6e5d-ab7e-4571-ac14-ce42feeceb76 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:09 devstack sudo[101908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.aa4b6e5d-ab7e-4571-ac14-ce42feeceb76 Sep 03 14:30:09 devstack sudo[101908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:09 devstack sudo[101903]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f94bfb52-ea2a-49b5-a481-9bf29c870b02 tempest-VolumesGetTest-994288544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-caa999be-2a7a-479f-8045-4136d04f3108" returned: 0 in 0.410s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f94bfb52-ea2a-49b5-a481-9bf29c870b02 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-caa999be-2a7a-479f-8045-4136d04f3108 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:09 devstack sudo[101913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-caa999be-2a7a-479f-8045-4136d04f3108 Sep 03 14:30:09 devstack sudo[101913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:10 devstack sudo[101913]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f94bfb52-ea2a-49b5-a481-9bf29c870b02 tempest-VolumesGetTest-994288544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-caa999be-2a7a-479f-8045-4136d04f3108" returned: 0 in 0.292s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:10 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-f94bfb52-ea2a-49b5-a481-9bf29c870b02 tempest-VolumesGetTest-994288544 None] Lock "cinder-quobyte-caa999be-2a7a-479f-8045-4136d04f3108" released by "delete_volume" :: held 0.748s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:30:10 devstack sudo[101908]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440.aa4b6e5d-ab7e-4571-ac14-ce42feeceb76" returned: 0 in 0.431s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:10 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Lock "cinder-quobyte-aa4b6e5d-ab7e-4571-ac14-ce42feeceb76" released by "_delete_snapshot" :: held 1.910s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:30:10 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Lock "cinder-quobyte-fa563246-5126-4c89-9078-d98a86123440" released by "delete_snapshot" :: held 1.950s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:30:10 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-f94bfb52-ea2a-49b5-a481-9bf29c870b02 tempest-VolumesGetTest-994288544 None] Created reservations ['fe31af10-9e9f-48bc-abcc-c05ae476ba93', '58279a76-01bf-4e8c-ada6-539cbfd069dd', 'af0e242d-055f-49e0-8092-235c26ac7a6a', '55e0ee59-015c-4bb4-b186-98559ba00062'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:30:10 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Created reservations ['af22f8ee-964a-4c7d-987e-5b904f843683', 'e27a241b-6ec4-4511-b2c1-569420bb8e7d', 'b886b87e-e3d7-4146-8944-7de1d8f3bd11', 'e44fc685-1222-4702-809b-fa641ddcba91'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:30:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f94bfb52-ea2a-49b5-a481-9bf29c870b02 tempest-VolumesGetTest-994288544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:30:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f94bfb52-ea2a-49b5-a481-9bf29c870b02 tempest-VolumesGetTest-994288544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:30:10 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f94bfb52-ea2a-49b5-a481-9bf29c870b02 tempest-VolumesGetTest-994288544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:30:10 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f94bfb52-ea2a-49b5-a481-9bf29c870b02 tempest-VolumesGetTest-994288544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:30:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f94bfb52-ea2a-49b5-a481-9bf29c870b02 tempest-VolumesGetTest-994288544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:30:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f94bfb52-ea2a-49b5-a481-9bf29c870b02 tempest-VolumesGetTest-994288544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:10 devstack sudo[101917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:30:10 devstack sudo[101917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:10 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Delete snapshot completed successfully. Sep 03 14:30:10 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Lock "cinder-aa4b6e5d-ab7e-4571-ac14-ce42feeceb76-delete_snapshot" released by "delete_snapshot" :: held 2.199s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:30:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Snapshots deleted, issuing volume delete {{(pid=87007) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 03 14:30:10 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Acquiring lock "cinder-quobyte-fa563246-5126-4c89-9078-d98a86123440" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:30:10 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Lock "cinder-quobyte-fa563246-5126-4c89-9078-d98a86123440" acquired by "delete_volume" :: waited 0.020s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:30:10 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[71520cc7-b436-489d-a104-12cd52de1342]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:30:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:10 devstack sudo[101919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440 Sep 03 14:30:10 devstack sudo[101919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:10 devstack sudo[101917]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f94bfb52-ea2a-49b5-a481-9bf29c870b02 tempest-VolumesGetTest-994288544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.459s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:10 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-f94bfb52-ea2a-49b5-a481-9bf29c870b02 tempest-VolumesGetTest-994288544 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:30:10 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-f94bfb52-ea2a-49b5-a481-9bf29c870b02 tempest-VolumesGetTest-994288544 None] Deleted volume successfully. Sep 03 14:30:10 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-f94bfb52-ea2a-49b5-a481-9bf29c870b02 tempest-VolumesGetTest-994288544 None] Lock "cinder-caa999be-2a7a-479f-8045-4136d04f3108-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:30:11 devstack sudo[101919]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440" returned: 0 in 0.608s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:11 devstack sudo[101929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440 Sep 03 14:30:11 devstack sudo[101929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:11 devstack sudo[101929]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-fa563246-5126-4c89-9078-d98a86123440" returned: 0 in 0.307s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:11 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Lock "cinder-quobyte-fa563246-5126-4c89-9078-d98a86123440" released by "delete_volume" :: held 1.002s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:30:11 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Created reservations ['64c4a2dd-f6bd-404f-a56b-7fe218007a3e', 'e905436b-e877-4021-ba87-02e3a787f9eb', '2a429a27-fa52-4040-96b8-2baa7e103ee1', '34895935-b84f-4985-9831-ab8343ab580c'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:30:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:30:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:30:11 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:30:11 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:30:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:30:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:11 devstack sudo[101934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:30:11 devstack sudo[101934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:12 devstack sudo[101934]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.411s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:12 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:30:12 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Deleted volume successfully. Sep 03 14:30:12 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9a791f30-13f0-4a98-b0ad-8cd13cf581d1 tempest-VolumesDeleteCascade-358781585 None] Lock "cinder-fa563246-5126-4c89-9078-d98a86123440-delete_volume" released by "delete_volume" :: held 6.758s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:30:13 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ee19bc3-ff59-4d3d-b43b-451d1f4b4d69 tempest-VolumesDeleteCascade-358781585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:30:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0ee19bc3-ff59-4d3d-b43b-451d1f4b4d69 tempest-VolumesDeleteCascade-358781585 None] Flow 'volume_create_manager' (910b726c-1f33-4fc5-9ca2-4c7798dc1598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:30:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0ee19bc3-ff59-4d3d-b43b-451d1f4b4d69 tempest-VolumesDeleteCascade-358781585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39ea53b7-df13-47d6-8e5f-b811e9de27da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0ee19bc3-ff59-4d3d-b43b-451d1f4b4d69 tempest-VolumesDeleteCascade-358781585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39ea53b7-df13-47d6-8e5f-b811e9de27da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1211999526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=404624b6-572a-43a0-b4b5-f8ceac320d37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff30747820c84aba9490f6158c714c77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:30:13Z,use_quota=True,user_id='ecdf44dff4694c7e87c4854051aca632',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0ee19bc3-ff59-4d3d-b43b-451d1f4b4d69 tempest-VolumesDeleteCascade-358781585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (335c2584-5de5-4f49-9417-2f6bb3d0d2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0ee19bc3-ff59-4d3d-b43b-451d1f4b4d69 tempest-VolumesDeleteCascade-358781585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (335c2584-5de5-4f49-9417-2f6bb3d0d2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0ee19bc3-ff59-4d3d-b43b-451d1f4b4d69 tempest-VolumesDeleteCascade-358781585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c07ba5f7-7fe8-4991-a19a-81c53cb40980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0ee19bc3-ff59-4d3d-b43b-451d1f4b4d69 tempest-VolumesDeleteCascade-358781585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c07ba5f7-7fe8-4991-a19a-81c53cb40980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '404624b6-572a-43a0-b4b5-f8ceac320d37', 'volume_name': 'volume-404624b6-572a-43a0-b4b5-f8ceac320d37', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0ee19bc3-ff59-4d3d-b43b-451d1f4b4d69 tempest-VolumesDeleteCascade-358781585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (930f4edc-96ed-4d89-86ac-5136c71944a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0ee19bc3-ff59-4d3d-b43b-451d1f4b4d69 tempest-VolumesDeleteCascade-358781585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (930f4edc-96ed-4d89-86ac-5136c71944a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0ee19bc3-ff59-4d3d-b43b-451d1f4b4d69 tempest-VolumesDeleteCascade-358781585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92d2e918-5e64-4698-bb2b-1a914d946ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:13 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-0ee19bc3-ff59-4d3d-b43b-451d1f4b4d69 tempest-VolumesDeleteCascade-358781585 None] Volume 404624b6-572a-43a0-b4b5-f8ceac320d37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-404624b6-572a-43a0-b4b5-f8ceac320d37', 'volume_size': 1} Sep 03 14:30:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-0ee19bc3-ff59-4d3d-b43b-451d1f4b4d69 tempest-VolumesDeleteCascade-358781585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:30:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-0ee19bc3-ff59-4d3d-b43b-451d1f4b4d69 tempest-VolumesDeleteCascade-358781585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:30:13 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-0ee19bc3-ff59-4d3d-b43b-451d1f4b4d69 tempest-VolumesDeleteCascade-358781585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1211999526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=404624b6-572a-43a0-b4b5-f8ceac320d37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff30747820c84aba9490f6158c714c77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:30:13Z,use_quota=True,user_id='ecdf44dff4694c7e87c4854051aca632',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:30:13 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-0ee19bc3-ff59-4d3d-b43b-451d1f4b4d69 tempest-VolumesDeleteCascade-358781585 None] Creating volume 404624b6-572a-43a0-b4b5-f8ceac320d37 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:30:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-0ee19bc3-ff59-4d3d-b43b-451d1f4b4d69 tempest-VolumesDeleteCascade-358781585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:30:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-0ee19bc3-ff59-4d3d-b43b-451d1f4b4d69 tempest-VolumesDeleteCascade-358781585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:30:13 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-0ee19bc3-ff59-4d3d-b43b-451d1f4b4d69 tempest-VolumesDeleteCascade-358781585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:30:13 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-0ee19bc3-ff59-4d3d-b43b-451d1f4b4d69 tempest-VolumesDeleteCascade-358781585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:30:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-0ee19bc3-ff59-4d3d-b43b-451d1f4b4d69 tempest-VolumesDeleteCascade-358781585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:30:13 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-0ee19bc3-ff59-4d3d-b43b-451d1f4b4d69 tempest-VolumesDeleteCascade-358781585 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:30:13 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-0ee19bc3-ff59-4d3d-b43b-451d1f4b4d69 tempest-VolumesDeleteCascade-358781585 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:30:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0ee19bc3-ff59-4d3d-b43b-451d1f4b4d69 tempest-VolumesDeleteCascade-358781585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:13 devstack sudo[101967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37 1073741824 Sep 03 14:30:13 devstack sudo[101967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:13 devstack sudo[101967]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0ee19bc3-ff59-4d3d-b43b-451d1f4b4d69 tempest-VolumesDeleteCascade-358781585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37 1073741824" returned: 0 in 0.470s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:13 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:SELECT=156,cinder:UPDATE=187,cinder:DELETE=19,cinder:INSERT=59 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:30:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0ee19bc3-ff59-4d3d-b43b-451d1f4b4d69 tempest-VolumesDeleteCascade-358781585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:13 devstack sudo[101973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37 Sep 03 14:30:13 devstack sudo[101973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:14 devstack sudo[101973]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0ee19bc3-ff59-4d3d-b43b-451d1f4b4d69 tempest-VolumesDeleteCascade-358781585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37" returned: 0 in 0.320s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-0ee19bc3-ff59-4d3d-b43b-451d1f4b4d69 tempest-VolumesDeleteCascade-358781585 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:30:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-0ee19bc3-ff59-4d3d-b43b-451d1f4b4d69 tempest-VolumesDeleteCascade-358781585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:30:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0ee19bc3-ff59-4d3d-b43b-451d1f4b4d69 tempest-VolumesDeleteCascade-358781585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92d2e918-5e64-4698-bb2b-1a914d946ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-404624b6-572a-43a0-b4b5-f8ceac320d37', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0ee19bc3-ff59-4d3d-b43b-451d1f4b4d69 tempest-VolumesDeleteCascade-358781585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9aaa0e8-1c91-4d13-ad6b-514076018f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:14 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-0ee19bc3-ff59-4d3d-b43b-451d1f4b4d69 tempest-VolumesDeleteCascade-358781585 None] Volume volume-404624b6-572a-43a0-b4b5-f8ceac320d37 (404624b6-572a-43a0-b4b5-f8ceac320d37): created successfully Sep 03 14:30:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0ee19bc3-ff59-4d3d-b43b-451d1f4b4d69 tempest-VolumesDeleteCascade-358781585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9aaa0e8-1c91-4d13-ad6b-514076018f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0ee19bc3-ff59-4d3d-b43b-451d1f4b4d69 tempest-VolumesDeleteCascade-358781585 None] Flow 'volume_create_manager' (910b726c-1f33-4fc5-9ca2-4c7798dc1598) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:30:14 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-0ee19bc3-ff59-4d3d-b43b-451d1f4b4d69 tempest-VolumesDeleteCascade-358781585 None] Created volume successfully. Sep 03 14:30:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-40428d19-f21b-482a-9c7f-23f175db3f4e tempest-VolumesDeleteCascade-358781585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:30:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-40428d19-f21b-482a-9c7f-23f175db3f4e tempest-VolumesDeleteCascade-358781585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:30:15 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-40428d19-f21b-482a-9c7f-23f175db3f4e tempest-VolumesDeleteCascade-358781585 None] Creating offline snapshot 7a734cd0-73c1-4f98-aca4-28e4ae325fbd of volume 404624b6-572a-43a0-b4b5-f8ceac320d37 {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:30:15 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d60be2b-1170-40de-b0f3-e11045ab3867]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:30:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-40428d19-f21b-482a-9c7f-23f175db3f4e tempest-VolumesDeleteCascade-358781585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:15 devstack sudo[101976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37 Sep 03 14:30:15 devstack sudo[101976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:16 devstack sudo[101976]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-40428d19-f21b-482a-9c7f-23f175db3f4e tempest-VolumesDeleteCascade-358781585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37" returned: 0 in 0.399s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-40428d19-f21b-482a-9c7f-23f175db3f4e tempest-VolumesDeleteCascade-358781585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37.7a734cd0-73c1-4f98-aca4-28e4ae325fbd 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:16 devstack sudo[101981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37.7a734cd0-73c1-4f98-aca4-28e4ae325fbd 1G Sep 03 14:30:16 devstack sudo[101981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:16 devstack sudo[101981]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-40428d19-f21b-482a-9c7f-23f175db3f4e tempest-VolumesDeleteCascade-358781585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37.7a734cd0-73c1-4f98-aca4-28e4ae325fbd 1G" returned: 0 in 0.571s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-40428d19-f21b-482a-9c7f-23f175db3f4e tempest-VolumesDeleteCascade-358781585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-404624b6-572a-43a0-b4b5-f8ceac320d37 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37.7a734cd0-73c1-4f98-aca4-28e4ae325fbd {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:16 devstack sudo[101988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-404624b6-572a-43a0-b4b5-f8ceac320d37 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37.7a734cd0-73c1-4f98-aca4-28e4ae325fbd Sep 03 14:30:16 devstack sudo[101988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:17 devstack sudo[101988]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-40428d19-f21b-482a-9c7f-23f175db3f4e tempest-VolumesDeleteCascade-358781585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-404624b6-572a-43a0-b4b5-f8ceac320d37 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37.7a734cd0-73c1-4f98-aca4-28e4ae325fbd" returned: 0 in 0.454s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:17 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-40428d19-f21b-482a-9c7f-23f175db3f4e tempest-VolumesDeleteCascade-358781585 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37.7a734cd0-73c1-4f98-aca4-28e4ae325fbd is being set with open permissions: ugo+rw Sep 03 14:30:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-40428d19-f21b-482a-9c7f-23f175db3f4e tempest-VolumesDeleteCascade-358781585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37.7a734cd0-73c1-4f98-aca4-28e4ae325fbd {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:17 devstack sudo[101993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37.7a734cd0-73c1-4f98-aca4-28e4ae325fbd Sep 03 14:30:17 devstack sudo[101993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:17 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-77dbeeae-e6b7-4208-b792-4c1116c4792d tempest-VolumesSnapshotListTestJSON-265932066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:30:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-77dbeeae-e6b7-4208-b792-4c1116c4792d tempest-VolumesSnapshotListTestJSON-265932066 None] Flow 'volume_create_manager' (ab51c8de-43b0-4add-b1e2-4e7836fa9785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:30:17 devstack sudo[101993]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-77dbeeae-e6b7-4208-b792-4c1116c4792d tempest-VolumesSnapshotListTestJSON-265932066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90a22cdf-3eb8-478e-ad2f-b02c353ef3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-40428d19-f21b-482a-9c7f-23f175db3f4e tempest-VolumesDeleteCascade-358781585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37.7a734cd0-73c1-4f98-aca4-28e4ae325fbd" returned: 0 in 0.325s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-77dbeeae-e6b7-4208-b792-4c1116c4792d tempest-VolumesSnapshotListTestJSON-265932066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90a22cdf-3eb8-478e-ad2f-b02c353ef3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1350335426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9c20784-0d6b-4ca1-8340-55978c379148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfae359d1dd449ed9fdbb779edeecda0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:30:17Z,use_quota=True,user_id='d229a9600ac54556b47e698b7a8a8856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-77dbeeae-e6b7-4208-b792-4c1116c4792d tempest-VolumesSnapshotListTestJSON-265932066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (373b72ac-ab85-4f47-84b5-110ec45ebc7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-77dbeeae-e6b7-4208-b792-4c1116c4792d tempest-VolumesSnapshotListTestJSON-265932066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (373b72ac-ab85-4f47-84b5-110ec45ebc7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-77dbeeae-e6b7-4208-b792-4c1116c4792d tempest-VolumesSnapshotListTestJSON-265932066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff61d201-91a3-4ef9-8aff-beb9450bc182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-77dbeeae-e6b7-4208-b792-4c1116c4792d tempest-VolumesSnapshotListTestJSON-265932066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff61d201-91a3-4ef9-8aff-beb9450bc182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9c20784-0d6b-4ca1-8340-55978c379148', 'volume_name': 'volume-d9c20784-0d6b-4ca1-8340-55978c379148', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-77dbeeae-e6b7-4208-b792-4c1116c4792d tempest-VolumesSnapshotListTestJSON-265932066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de1978a2-6dcd-4190-981c-0b8b8a2ae71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-77dbeeae-e6b7-4208-b792-4c1116c4792d tempest-VolumesSnapshotListTestJSON-265932066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de1978a2-6dcd-4190-981c-0b8b8a2ae71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-77dbeeae-e6b7-4208-b792-4c1116c4792d tempest-VolumesSnapshotListTestJSON-265932066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f796d5f-1cdd-4c06-a25c-02541abce23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:17 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-77dbeeae-e6b7-4208-b792-4c1116c4792d tempest-VolumesSnapshotListTestJSON-265932066 None] Volume d9c20784-0d6b-4ca1-8340-55978c379148: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9c20784-0d6b-4ca1-8340-55978c379148', 'volume_size': 1} Sep 03 14:30:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-77dbeeae-e6b7-4208-b792-4c1116c4792d tempest-VolumesSnapshotListTestJSON-265932066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:30:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-40428d19-f21b-482a-9c7f-23f175db3f4e tempest-VolumesDeleteCascade-358781585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:17 devstack sudo[101996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37.info Sep 03 14:30:17 devstack sudo[101996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:17 devstack sudo[101996]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-40428d19-f21b-482a-9c7f-23f175db3f4e tempest-VolumesDeleteCascade-358781585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37.info" returned: 0 in 0.262s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:17 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-40428d19-f21b-482a-9c7f-23f175db3f4e tempest-VolumesDeleteCascade-358781585 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37.info is being set with open permissions: ugo+rw Sep 03 14:30:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-40428d19-f21b-482a-9c7f-23f175db3f4e tempest-VolumesDeleteCascade-358781585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:17 devstack sudo[101999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37.info Sep 03 14:30:17 devstack sudo[101999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:17 devstack sudo[101999]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-40428d19-f21b-482a-9c7f-23f175db3f4e tempest-VolumesDeleteCascade-358781585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37.info" returned: 0 in 0.250s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-40428d19-f21b-482a-9c7f-23f175db3f4e tempest-VolumesDeleteCascade-358781585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.403s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:30:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-77dbeeae-e6b7-4208-b792-4c1116c4792d tempest-VolumesSnapshotListTestJSON-265932066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.562s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:30:17 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-77dbeeae-e6b7-4208-b792-4c1116c4792d tempest-VolumesSnapshotListTestJSON-265932066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1350335426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9c20784-0d6b-4ca1-8340-55978c379148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfae359d1dd449ed9fdbb779edeecda0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:30:17Z,use_quota=True,user_id='d229a9600ac54556b47e698b7a8a8856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:30:17 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-77dbeeae-e6b7-4208-b792-4c1116c4792d tempest-VolumesSnapshotListTestJSON-265932066 None] Creating volume d9c20784-0d6b-4ca1-8340-55978c379148 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:30:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-77dbeeae-e6b7-4208-b792-4c1116c4792d tempest-VolumesSnapshotListTestJSON-265932066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:30:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-77dbeeae-e6b7-4208-b792-4c1116c4792d tempest-VolumesSnapshotListTestJSON-265932066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:30:17 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-77dbeeae-e6b7-4208-b792-4c1116c4792d tempest-VolumesSnapshotListTestJSON-265932066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:30:17 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-77dbeeae-e6b7-4208-b792-4c1116c4792d tempest-VolumesSnapshotListTestJSON-265932066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:30:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-77dbeeae-e6b7-4208-b792-4c1116c4792d tempest-VolumesSnapshotListTestJSON-265932066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:30:17 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-77dbeeae-e6b7-4208-b792-4c1116c4792d tempest-VolumesSnapshotListTestJSON-265932066 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:30:17 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-77dbeeae-e6b7-4208-b792-4c1116c4792d tempest-VolumesSnapshotListTestJSON-265932066 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:30:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-77dbeeae-e6b7-4208-b792-4c1116c4792d tempest-VolumesSnapshotListTestJSON-265932066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:18 devstack sudo[102002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148 1073741824 Sep 03 14:30:18 devstack sudo[102002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:18 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-40428d19-f21b-482a-9c7f-23f175db3f4e tempest-VolumesDeleteCascade-358781585 None] Create snapshot completed successfully Sep 03 14:30:18 devstack sudo[102002]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-77dbeeae-e6b7-4208-b792-4c1116c4792d tempest-VolumesSnapshotListTestJSON-265932066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148 1073741824" returned: 0 in 0.476s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-77dbeeae-e6b7-4208-b792-4c1116c4792d tempest-VolumesSnapshotListTestJSON-265932066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:18 devstack sudo[102008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148 Sep 03 14:30:18 devstack sudo[102008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:18 devstack sudo[102008]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-77dbeeae-e6b7-4208-b792-4c1116c4792d tempest-VolumesSnapshotListTestJSON-265932066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148" returned: 0 in 0.259s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:18 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-77dbeeae-e6b7-4208-b792-4c1116c4792d tempest-VolumesSnapshotListTestJSON-265932066 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:30:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-77dbeeae-e6b7-4208-b792-4c1116c4792d tempest-VolumesSnapshotListTestJSON-265932066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:30:18 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-77dbeeae-e6b7-4208-b792-4c1116c4792d tempest-VolumesSnapshotListTestJSON-265932066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f796d5f-1cdd-4c06-a25c-02541abce23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9c20784-0d6b-4ca1-8340-55978c379148', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:18 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-77dbeeae-e6b7-4208-b792-4c1116c4792d tempest-VolumesSnapshotListTestJSON-265932066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cfef926-c1d0-4075-9e3e-669c07e2f3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:18 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-77dbeeae-e6b7-4208-b792-4c1116c4792d tempest-VolumesSnapshotListTestJSON-265932066 None] Volume volume-d9c20784-0d6b-4ca1-8340-55978c379148 (d9c20784-0d6b-4ca1-8340-55978c379148): created successfully Sep 03 14:30:18 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-77dbeeae-e6b7-4208-b792-4c1116c4792d tempest-VolumesSnapshotListTestJSON-265932066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cfef926-c1d0-4075-9e3e-669c07e2f3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:18 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-77dbeeae-e6b7-4208-b792-4c1116c4792d tempest-VolumesSnapshotListTestJSON-265932066 None] Flow 'volume_create_manager' (ab51c8de-43b0-4add-b1e2-4e7836fa9785) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:30:18 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-77dbeeae-e6b7-4208-b792-4c1116c4792d tempest-VolumesSnapshotListTestJSON-265932066 None] Created volume successfully. Sep 03 14:30:19 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:30:19 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Flow 'volume_create_manager' (216253a3-6f03-47f4-b3a8-9fa1e1f102cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:30:19 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a89b85d-1d10-45d8-a949-4a204c83d576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:19 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a89b85d-1d10-45d8-a949-4a204c83d576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-909843045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27846bf2-ed46-4147-b92b-5b92058c8257,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff30747820c84aba9490f6158c714c77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7a734cd0-73c1-4f98-aca4-28e4ae325fbd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:30:19Z,use_quota=True,user_id='ecdf44dff4694c7e87c4854051aca632',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:19 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56f5b8a1-f2be-43b8-b940-a27e234cba56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:19 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56f5b8a1-f2be-43b8-b940-a27e234cba56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:19 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3fc2a05-a26a-4938-84b3-f77e26e92349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:19 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3fc2a05-a26a-4938-84b3-f77e26e92349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '27846bf2-ed46-4147-b92b-5b92058c8257', 'volume_name': 'volume-27846bf2-ed46-4147-b92b-5b92058c8257', 'volume_size': 1, 'snapshot_id': '7a734cd0-73c1-4f98-aca4-28e4ae325fbd'}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:19 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d52cc26-1f46-4d6f-ab09-81be31cfd732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:19 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d52cc26-1f46-4d6f-ab09-81be31cfd732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:19 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d18b2056-032b-407c-ab0b-1dc6b03a21b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:19 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Volume 27846bf2-ed46-4147-b92b-5b92058c8257: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-27846bf2-ed46-4147-b92b-5b92058c8257', 'volume_size': 1, 'snapshot_id': '7a734cd0-73c1-4f98-aca4-28e4ae325fbd'} Sep 03 14:30:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:30:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:30:19 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Acquiring lock "cinder-quobyte-7a734cd0-73c1-4f98-aca4-28e4ae325fbd-27846bf2-ed46-4147-b92b-5b92058c8257" by "_create_volume_from_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:30:19 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Lock "cinder-quobyte-7a734cd0-73c1-4f98-aca4-28e4ae325fbd-27846bf2-ed46-4147-b92b-5b92058c8257" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:30:19 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Creating volume 27846bf2-ed46-4147-b92b-5b92058c8257 from snapshot 7a734cd0-73c1-4f98-aca4-28e4ae325fbd {{(pid=87007) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 14:30:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:30:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:30:19 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:30:19 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:30:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:30:19 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:30:19 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Acquiring lock "cinder-quobyte-27846bf2-ed46-4147-b92b-5b92058c8257" by "_copy_volume_from_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:30:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7e8ec539-9803-40e2-83d0-1ecfa2a50ab0 tempest-VolumesSnapshotListTestJSON-265932066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:30:19 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Lock "cinder-quobyte-27846bf2-ed46-4147-b92b-5b92058c8257" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:30:19 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] snapshot: 7a734cd0-73c1-4f98-aca4-28e4ae325fbd, volume: 27846bf2-ed46-4147-b92b-5b92058c8257, {{(pid=87007) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 14:30:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:30:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:30:19 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:30:19 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:30:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:30:19 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e25d3be-7fb3-430b-b162-4b30cfd8eec9]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:30:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37.7a734cd0-73c1-4f98-aca4-28e4ae325fbd {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:19 devstack sudo[102012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37.7a734cd0-73c1-4f98-aca4-28e4ae325fbd Sep 03 14:30:19 devstack sudo[102012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:20 devstack sudo[102012]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37.7a734cd0-73c1-4f98-aca4-28e4ae325fbd" returned: 0 in 0.515s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:20 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-404624b6-572a-43a0-b4b5-f8ceac320d37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:30:20 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9505a14-a506-4f27-b9f9-dcadb4b96e25]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:30:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:20 devstack sudo[102018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37 Sep 03 14:30:20 devstack sudo[102018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:20 devstack sudo[102018]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37" returned: 0 in 0.498s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:20 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37 {{(pid=87007) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 14:30:20 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Creating direct copy from snapshot {{(pid=87007) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 14:30:20 devstack cinder-volume[87007]: DEBUG cinder.utils [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Path /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-27846bf2-ed46-4147-b92b-5b92058c8257 not found in is_blk_device check {{(pid=87007) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 14:30:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-27846bf2-ed46-4147-b92b-5b92058c8257 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:20 devstack sudo[102023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-27846bf2-ed46-4147-b92b-5b92058c8257 Sep 03 14:30:20 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:26 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-27846bf2-ed46-4147-b92b-5b92058c8257" returned: 0 in 5.866s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:26 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Image conversion details: src /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37, size 1024.00 MB, duration 5.87 sec, destination /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-27846bf2-ed46-4147-b92b-5b92058c8257 {{(pid=87007) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 14:30:26 devstack cinder-volume[87007]: INFO cinder.image.image_utils [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Converted 1024.00 MB image at 174.48 MB/s Sep 03 14:30:26 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-27846bf2-ed46-4147-b92b-5b92058c8257 is being set with open permissions: ugo+rw Sep 03 14:30:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-27846bf2-ed46-4147-b92b-5b92058c8257 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:26 devstack sudo[102063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-27846bf2-ed46-4147-b92b-5b92058c8257 Sep 03 14:30:26 devstack sudo[102063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:26 devstack sudo[102063]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-27846bf2-ed46-4147-b92b-5b92058c8257" returned: 0 in 0.304s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:26 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Lock "cinder-quobyte-27846bf2-ed46-4147-b92b-5b92058c8257" released by "_copy_volume_from_snapshot" :: held 7.300s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:30:27 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Lock "cinder-quobyte-7a734cd0-73c1-4f98-aca4-28e4ae325fbd-27846bf2-ed46-4147-b92b-5b92058c8257" released by "_create_volume_from_snapshot" :: held 7.371s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:30:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.400s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:30:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7e8ec539-9803-40e2-83d0-1ecfa2a50ab0 tempest-VolumesSnapshotListTestJSON-265932066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.360s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:30:27 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-7e8ec539-9803-40e2-83d0-1ecfa2a50ab0 tempest-VolumesSnapshotListTestJSON-265932066 None] Creating offline snapshot 2a50507b-e4cd-490c-a035-ee47e695eb09 of volume d9c20784-0d6b-4ca1-8340-55978c379148 {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:30:27 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d18b2056-032b-407c-ab0b-1dc6b03a21b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27846bf2-ed46-4147-b92b-5b92058c8257', 'volume_size': 1, 'snapshot_id': '7a734cd0-73c1-4f98-aca4-28e4ae325fbd'}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:27 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d9078c1-fac2-4cee-8722-1de91e275ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:27 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a8fba8-6c7e-4179-92bb-d06ddc9555e0]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:30:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7e8ec539-9803-40e2-83d0-1ecfa2a50ab0 tempest-VolumesSnapshotListTestJSON-265932066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:27 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Volume volume-27846bf2-ed46-4147-b92b-5b92058c8257 (27846bf2-ed46-4147-b92b-5b92058c8257): created successfully Sep 03 14:30:27 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d9078c1-fac2-4cee-8722-1de91e275ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:27 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Flow 'volume_create_manager' (216253a3-6f03-47f4-b3a8-9fa1e1f102cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:30:27 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-922f072b-4130-4640-810d-1042feaf443d tempest-VolumesDeleteCascade-358781585 None] Created volume successfully. Sep 03 14:30:27 devstack sudo[102066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148 Sep 03 14:30:27 devstack sudo[102066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:27 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-5df928c5-fc81-4379-a436-4eb152021786 tempest-VolumesDeleteCascade-358781585 None] Acquiring lock "cinder-404624b6-572a-43a0-b4b5-f8ceac320d37-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:30:27 devstack sudo[102066]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7e8ec539-9803-40e2-83d0-1ecfa2a50ab0 tempest-VolumesSnapshotListTestJSON-265932066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148" returned: 0 in 0.649s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7e8ec539-9803-40e2-83d0-1ecfa2a50ab0 tempest-VolumesSnapshotListTestJSON-265932066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.2a50507b-e4cd-490c-a035-ee47e695eb09 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:27 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-5df928c5-fc81-4379-a436-4eb152021786 tempest-VolumesDeleteCascade-358781585 None] Lock "cinder-404624b6-572a-43a0-b4b5-f8ceac320d37-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:30:27 devstack sudo[102088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.2a50507b-e4cd-490c-a035-ee47e695eb09 1G Sep 03 14:30:27 devstack sudo[102088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:27 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5df928c5-fc81-4379-a436-4eb152021786 tempest-VolumesDeleteCascade-358781585 None] Performing cascade delete. {{(pid=87007) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 03 14:30:27 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-5df928c5-fc81-4379-a436-4eb152021786 tempest-VolumesDeleteCascade-358781585 None] Acquiring lock "cinder-7a734cd0-73c1-4f98-aca4-28e4ae325fbd-delete_snapshot" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:30:27 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-5df928c5-fc81-4379-a436-4eb152021786 tempest-VolumesDeleteCascade-358781585 None] Lock "cinder-7a734cd0-73c1-4f98-aca4-28e4ae325fbd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:30:27 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-5df928c5-fc81-4379-a436-4eb152021786 tempest-VolumesDeleteCascade-358781585 None] Acquiring lock "cinder-quobyte-404624b6-572a-43a0-b4b5-f8ceac320d37" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:30:27 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-5df928c5-fc81-4379-a436-4eb152021786 tempest-VolumesDeleteCascade-358781585 None] Lock "cinder-quobyte-404624b6-572a-43a0-b4b5-f8ceac320d37" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:30:27 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-5df928c5-fc81-4379-a436-4eb152021786 tempest-VolumesDeleteCascade-358781585 None] Acquiring lock "cinder-quobyte-7a734cd0-73c1-4f98-aca4-28e4ae325fbd" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:30:27 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-5df928c5-fc81-4379-a436-4eb152021786 tempest-VolumesDeleteCascade-358781585 None] Lock "cinder-quobyte-7a734cd0-73c1-4f98-aca4-28e4ae325fbd" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:30:27 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-5df928c5-fc81-4379-a436-4eb152021786 tempest-VolumesDeleteCascade-358781585 None] Deleting offline snapshot 7a734cd0-73c1-4f98-aca4-28e4ae325fbd of volume 404624b6-572a-43a0-b4b5-f8ceac320d37 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:30:28 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-5df928c5-fc81-4379-a436-4eb152021786 tempest-VolumesDeleteCascade-358781585 None] snapshot_file for this snap is: volume-404624b6-572a-43a0-b4b5-f8ceac320d37.7a734cd0-73c1-4f98-aca4-28e4ae325fbd {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:30:28 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f297bb2-43b3-4f8e-935e-e96ba84079c7]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:30:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5df928c5-fc81-4379-a436-4eb152021786 tempest-VolumesDeleteCascade-358781585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37.7a734cd0-73c1-4f98-aca4-28e4ae325fbd {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:28 devstack sudo[102093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37.7a734cd0-73c1-4f98-aca4-28e4ae325fbd Sep 03 14:30:28 devstack sudo[102093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:28 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-b5a42f16-9749-4c28-98aa-14529c45f230 req-31ccd84c-bca6-48e5-af12-a4c1e1865c84 tempest-TestShelveInstance-1205513418 None] Terminate volume connection completed successfully. Sep 03 14:30:28 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-b5a42f16-9749-4c28-98aa-14529c45f230 req-31ccd84c-bca6-48e5-af12-a4c1e1865c84 tempest-TestShelveInstance-1205513418 None] Deleting attachment c87395ee-c61c-4c87-b04c-5adddf54237e. {{(pid=87007) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 14:30:28 devstack sudo[102088]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7e8ec539-9803-40e2-83d0-1ecfa2a50ab0 tempest-VolumesSnapshotListTestJSON-265932066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.2a50507b-e4cd-490c-a035-ee47e695eb09 1G" returned: 0 in 0.814s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7e8ec539-9803-40e2-83d0-1ecfa2a50ab0 tempest-VolumesSnapshotListTestJSON-265932066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9c20784-0d6b-4ca1-8340-55978c379148 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.2a50507b-e4cd-490c-a035-ee47e695eb09 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:28 devstack sudo[102101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9c20784-0d6b-4ca1-8340-55978c379148 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.2a50507b-e4cd-490c-a035-ee47e695eb09 Sep 03 14:30:28 devstack sudo[102101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:28 devstack sudo[102093]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5df928c5-fc81-4379-a436-4eb152021786 tempest-VolumesDeleteCascade-358781585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37.7a734cd0-73c1-4f98-aca4-28e4ae325fbd" returned: 0 in 0.591s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:28 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-5df928c5-fc81-4379-a436-4eb152021786 tempest-VolumesDeleteCascade-358781585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-404624b6-572a-43a0-b4b5-f8ceac320d37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:30:28 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d42b68b-16b3-4fc4-8e3b-2b15211aba44]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:30:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5df928c5-fc81-4379-a436-4eb152021786 tempest-VolumesDeleteCascade-358781585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:28 devstack sudo[102104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37 Sep 03 14:30:28 devstack sudo[102104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:28 devstack sudo[102101]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7e8ec539-9803-40e2-83d0-1ecfa2a50ab0 tempest-VolumesSnapshotListTestJSON-265932066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9c20784-0d6b-4ca1-8340-55978c379148 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.2a50507b-e4cd-490c-a035-ee47e695eb09" returned: 0 in 0.408s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:28 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-7e8ec539-9803-40e2-83d0-1ecfa2a50ab0 tempest-VolumesSnapshotListTestJSON-265932066 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.2a50507b-e4cd-490c-a035-ee47e695eb09 is being set with open permissions: ugo+rw Sep 03 14:30:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7e8ec539-9803-40e2-83d0-1ecfa2a50ab0 tempest-VolumesSnapshotListTestJSON-265932066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.2a50507b-e4cd-490c-a035-ee47e695eb09 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:28 devstack sudo[102109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.2a50507b-e4cd-490c-a035-ee47e695eb09 Sep 03 14:30:28 devstack sudo[102109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:29 devstack sudo[102109]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7e8ec539-9803-40e2-83d0-1ecfa2a50ab0 tempest-VolumesSnapshotListTestJSON-265932066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.2a50507b-e4cd-490c-a035-ee47e695eb09" returned: 0 in 0.294s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7e8ec539-9803-40e2-83d0-1ecfa2a50ab0 tempest-VolumesSnapshotListTestJSON-265932066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:29 devstack sudo[102104]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5df928c5-fc81-4379-a436-4eb152021786 tempest-VolumesDeleteCascade-358781585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37" returned: 0 in 0.672s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5df928c5-fc81-4379-a436-4eb152021786 tempest-VolumesDeleteCascade-358781585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37.7a734cd0-73c1-4f98-aca4-28e4ae325fbd {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:29 devstack sudo[102116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.info Sep 03 14:30:29 devstack sudo[102116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:29 devstack sudo[102117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37.7a734cd0-73c1-4f98-aca4-28e4ae325fbd Sep 03 14:30:29 devstack sudo[102117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:29 devstack sudo[102116]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7e8ec539-9803-40e2-83d0-1ecfa2a50ab0 tempest-VolumesSnapshotListTestJSON-265932066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.info" returned: 0 in 0.356s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:29 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-7e8ec539-9803-40e2-83d0-1ecfa2a50ab0 tempest-VolumesSnapshotListTestJSON-265932066 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.info is being set with open permissions: ugo+rw Sep 03 14:30:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7e8ec539-9803-40e2-83d0-1ecfa2a50ab0 tempest-VolumesSnapshotListTestJSON-265932066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:29 devstack sudo[102124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.info Sep 03 14:30:29 devstack sudo[102124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:29 devstack sudo[102117]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5df928c5-fc81-4379-a436-4eb152021786 tempest-VolumesDeleteCascade-358781585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37.7a734cd0-73c1-4f98-aca4-28e4ae325fbd" returned: 0 in 0.443s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5df928c5-fc81-4379-a436-4eb152021786 tempest-VolumesDeleteCascade-358781585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37.7a734cd0-73c1-4f98-aca4-28e4ae325fbd {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:29 devstack sudo[102126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37.7a734cd0-73c1-4f98-aca4-28e4ae325fbd Sep 03 14:30:29 devstack sudo[102126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:29 devstack sudo[102124]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7e8ec539-9803-40e2-83d0-1ecfa2a50ab0 tempest-VolumesSnapshotListTestJSON-265932066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.info" returned: 0 in 0.312s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7e8ec539-9803-40e2-83d0-1ecfa2a50ab0 tempest-VolumesSnapshotListTestJSON-265932066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:30:30 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-7e8ec539-9803-40e2-83d0-1ecfa2a50ab0 tempest-VolumesSnapshotListTestJSON-265932066 None] Create snapshot completed successfully Sep 03 14:30:30 devstack sudo[102126]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5df928c5-fc81-4379-a436-4eb152021786 tempest-VolumesDeleteCascade-358781585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37.7a734cd0-73c1-4f98-aca4-28e4ae325fbd" returned: 0 in 0.332s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:30 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-5df928c5-fc81-4379-a436-4eb152021786 tempest-VolumesDeleteCascade-358781585 None] Lock "cinder-quobyte-7a734cd0-73c1-4f98-aca4-28e4ae325fbd" released by "_delete_snapshot" :: held 2.200s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:30:30 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-5df928c5-fc81-4379-a436-4eb152021786 tempest-VolumesDeleteCascade-358781585 None] Lock "cinder-quobyte-404624b6-572a-43a0-b4b5-f8ceac320d37" released by "delete_snapshot" :: held 2.231s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:30:30 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-5df928c5-fc81-4379-a436-4eb152021786 tempest-VolumesDeleteCascade-358781585 None] Created reservations ['9d9af776-c525-4ab2-b8e9-c947ad47f0ea', '189cb5c3-75b7-4b6e-913a-0d811786366c', '4b663b28-2aae-4809-83e1-e5a9bc668b71', '40d65b61-2544-45e6-9963-c41ea45b453e'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:30:30 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-5df928c5-fc81-4379-a436-4eb152021786 tempest-VolumesDeleteCascade-358781585 None] Delete snapshot completed successfully. Sep 03 14:30:30 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-5df928c5-fc81-4379-a436-4eb152021786 tempest-VolumesDeleteCascade-358781585 None] Lock "cinder-7a734cd0-73c1-4f98-aca4-28e4ae325fbd-delete_snapshot" released by "delete_snapshot" :: held 2.448s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:30:30 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5df928c5-fc81-4379-a436-4eb152021786 tempest-VolumesDeleteCascade-358781585 None] Snapshots deleted, issuing volume delete {{(pid=87007) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 03 14:30:30 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-5df928c5-fc81-4379-a436-4eb152021786 tempest-VolumesDeleteCascade-358781585 None] Acquiring lock "cinder-quobyte-404624b6-572a-43a0-b4b5-f8ceac320d37" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:30:30 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-5df928c5-fc81-4379-a436-4eb152021786 tempest-VolumesDeleteCascade-358781585 None] Lock "cinder-quobyte-404624b6-572a-43a0-b4b5-f8ceac320d37" acquired by "delete_volume" :: waited 0.027s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:30:30 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebf0207-d7c3-446f-a67f-b448ad1422bd]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:30:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5df928c5-fc81-4379-a436-4eb152021786 tempest-VolumesDeleteCascade-358781585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:30 devstack sudo[102131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37 Sep 03 14:30:30 devstack sudo[102131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-40870916-ad34-4277-a355-cbdc6dbfff5a tempest-VolumesSnapshotListTestJSON-265932066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:30:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-40870916-ad34-4277-a355-cbdc6dbfff5a tempest-VolumesSnapshotListTestJSON-265932066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:30:30 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-40870916-ad34-4277-a355-cbdc6dbfff5a tempest-VolumesSnapshotListTestJSON-265932066 None] Creating offline snapshot e0cc6d73-8e89-48b2-a260-c01a475df290 of volume d9c20784-0d6b-4ca1-8340-55978c379148 {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:30:30 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[384b588a-242a-41d5-8803-204d851995cd]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:30:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-40870916-ad34-4277-a355-cbdc6dbfff5a tempest-VolumesSnapshotListTestJSON-265932066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.2a50507b-e4cd-490c-a035-ee47e695eb09 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:30 devstack sudo[102135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.2a50507b-e4cd-490c-a035-ee47e695eb09 Sep 03 14:30:30 devstack sudo[102135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:30 devstack sudo[102131]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5df928c5-fc81-4379-a436-4eb152021786 tempest-VolumesDeleteCascade-358781585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37" returned: 0 in 0.534s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5df928c5-fc81-4379-a436-4eb152021786 tempest-VolumesDeleteCascade-358781585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:31 devstack sudo[102141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37 Sep 03 14:30:31 devstack sudo[102141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:31 devstack sudo[102135]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-40870916-ad34-4277-a355-cbdc6dbfff5a tempest-VolumesSnapshotListTestJSON-265932066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.2a50507b-e4cd-490c-a035-ee47e695eb09" returned: 0 in 0.521s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:31 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-40870916-ad34-4277-a355-cbdc6dbfff5a tempest-VolumesSnapshotListTestJSON-265932066 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9c20784-0d6b-4ca1-8340-55978c379148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:30:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-40870916-ad34-4277-a355-cbdc6dbfff5a tempest-VolumesSnapshotListTestJSON-265932066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.2a50507b-e4cd-490c-a035-ee47e695eb09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.e0cc6d73-8e89-48b2-a260-c01a475df290 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:31 devstack sudo[102146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.2a50507b-e4cd-490c-a035-ee47e695eb09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.e0cc6d73-8e89-48b2-a260-c01a475df290 1G Sep 03 14:30:31 devstack sudo[102146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:31 devstack sudo[102141]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5df928c5-fc81-4379-a436-4eb152021786 tempest-VolumesDeleteCascade-358781585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-404624b6-572a-43a0-b4b5-f8ceac320d37" returned: 0 in 0.381s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:31 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-5df928c5-fc81-4379-a436-4eb152021786 tempest-VolumesDeleteCascade-358781585 None] Lock "cinder-quobyte-404624b6-572a-43a0-b4b5-f8ceac320d37" released by "delete_volume" :: held 0.992s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:30:31 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-5df928c5-fc81-4379-a436-4eb152021786 tempest-VolumesDeleteCascade-358781585 None] Created reservations ['5a8be88e-48d5-462d-8ccc-904571948b3a', '0026bbed-86d0-478e-9529-1cab92c15f96', '8a863efc-2b6f-4f22-95b8-acdc60d44aa4', '0141e05d-b61f-4f05-b2e0-bb9781fe546a'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:30:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-5df928c5-fc81-4379-a436-4eb152021786 tempest-VolumesDeleteCascade-358781585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:30:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-5df928c5-fc81-4379-a436-4eb152021786 tempest-VolumesDeleteCascade-358781585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:30:31 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-5df928c5-fc81-4379-a436-4eb152021786 tempest-VolumesDeleteCascade-358781585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:30:31 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-5df928c5-fc81-4379-a436-4eb152021786 tempest-VolumesDeleteCascade-358781585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:30:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-5df928c5-fc81-4379-a436-4eb152021786 tempest-VolumesDeleteCascade-358781585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:30:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5df928c5-fc81-4379-a436-4eb152021786 tempest-VolumesDeleteCascade-358781585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:31 devstack sudo[102154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:30:31 devstack sudo[102154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-cfb5bb89-7521-484b-9976-254424ed7884 req-37c458b2-9075-449f-85bb-5ee139d9bed9 tempest-TestShelveInstance-1205513418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:30:31 devstack sudo[102146]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-40870916-ad34-4277-a355-cbdc6dbfff5a tempest-VolumesSnapshotListTestJSON-265932066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.2a50507b-e4cd-490c-a035-ee47e695eb09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.e0cc6d73-8e89-48b2-a260-c01a475df290 1G" returned: 0 in 0.597s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-40870916-ad34-4277-a355-cbdc6dbfff5a tempest-VolumesSnapshotListTestJSON-265932066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9c20784-0d6b-4ca1-8340-55978c379148.2a50507b-e4cd-490c-a035-ee47e695eb09 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.e0cc6d73-8e89-48b2-a260-c01a475df290 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:31 devstack sudo[102154]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5df928c5-fc81-4379-a436-4eb152021786 tempest-VolumesDeleteCascade-358781585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.291s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:31 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-5df928c5-fc81-4379-a436-4eb152021786 tempest-VolumesDeleteCascade-358781585 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:30:31 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-5df928c5-fc81-4379-a436-4eb152021786 tempest-VolumesDeleteCascade-358781585 None] Deleted volume successfully. Sep 03 14:30:31 devstack sudo[102164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9c20784-0d6b-4ca1-8340-55978c379148.2a50507b-e4cd-490c-a035-ee47e695eb09 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.e0cc6d73-8e89-48b2-a260-c01a475df290 Sep 03 14:30:31 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:31 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-5df928c5-fc81-4379-a436-4eb152021786 tempest-VolumesDeleteCascade-358781585 None] Lock "cinder-404624b6-572a-43a0-b4b5-f8ceac320d37-delete_volume" released by "delete_volume" :: held 4.082s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:30:32 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-40870916-ad34-4277-a355-cbdc6dbfff5a tempest-VolumesSnapshotListTestJSON-265932066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9c20784-0d6b-4ca1-8340-55978c379148.2a50507b-e4cd-490c-a035-ee47e695eb09 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.e0cc6d73-8e89-48b2-a260-c01a475df290" returned: 0 in 0.353s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:32 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-40870916-ad34-4277-a355-cbdc6dbfff5a tempest-VolumesSnapshotListTestJSON-265932066 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.e0cc6d73-8e89-48b2-a260-c01a475df290 is being set with open permissions: ugo+rw Sep 03 14:30:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-40870916-ad34-4277-a355-cbdc6dbfff5a tempest-VolumesSnapshotListTestJSON-265932066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.e0cc6d73-8e89-48b2-a260-c01a475df290 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:32 devstack sudo[102169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.e0cc6d73-8e89-48b2-a260-c01a475df290 Sep 03 14:30:32 devstack sudo[102169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:32 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d1f645d9-13fc-4c04-91a2-da90b0c75280 tempest-VolumesDeleteCascade-358781585 None] Acquiring lock "cinder-27846bf2-ed46-4147-b92b-5b92058c8257-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:30:32 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d1f645d9-13fc-4c04-91a2-da90b0c75280 tempest-VolumesDeleteCascade-358781585 None] Lock "cinder-27846bf2-ed46-4147-b92b-5b92058c8257-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:30:32 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d1f645d9-13fc-4c04-91a2-da90b0c75280 tempest-VolumesDeleteCascade-358781585 None] Acquiring lock "cinder-quobyte-27846bf2-ed46-4147-b92b-5b92058c8257" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:30:32 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d1f645d9-13fc-4c04-91a2-da90b0c75280 tempest-VolumesDeleteCascade-358781585 None] Lock "cinder-quobyte-27846bf2-ed46-4147-b92b-5b92058c8257" acquired by "delete_volume" :: waited 0.017s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:30:32 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5267e7-f1fe-472e-87a7-c6cf1b07bb97]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:30:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d1f645d9-13fc-4c04-91a2-da90b0c75280 tempest-VolumesDeleteCascade-358781585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-27846bf2-ed46-4147-b92b-5b92058c8257 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:32 devstack sudo[102169]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-40870916-ad34-4277-a355-cbdc6dbfff5a tempest-VolumesSnapshotListTestJSON-265932066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.e0cc6d73-8e89-48b2-a260-c01a475df290" returned: 0 in 0.373s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-40870916-ad34-4277-a355-cbdc6dbfff5a tempest-VolumesSnapshotListTestJSON-265932066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.963s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:30:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-cfb5bb89-7521-484b-9976-254424ed7884 req-37c458b2-9075-449f-85bb-5ee139d9bed9 tempest-TestShelveInstance-1205513418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.804s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:30:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-cfb5bb89-7521-484b-9976-254424ed7884 req-37c458b2-9075-449f-85bb-5ee139d9bed9 tempest-TestShelveInstance-1205513418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:30:32 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-40870916-ad34-4277-a355-cbdc6dbfff5a tempest-VolumesSnapshotListTestJSON-265932066 None] Create snapshot completed successfully Sep 03 14:30:32 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-cfb5bb89-7521-484b-9976-254424ed7884 req-37c458b2-9075-449f-85bb-5ee139d9bed9 tempest-TestShelveInstance-1205513418 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713', 'name': 'volume-b4dd7dd9-9573-478f-924d-a6a911b72ce9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '14883db1-3088-443e-a7ae-4bf3cdd86981', 'enforce_multipath': True} {{(pid=87007) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 14:30:32 devstack sudo[102172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-27846bf2-ed46-4147-b92b-5b92058c8257 Sep 03 14:30:32 devstack sudo[102172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:32 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-cfb5bb89-7521-484b-9976-254424ed7884 req-37c458b2-9075-449f-85bb-5ee139d9bed9 tempest-TestShelveInstance-1205513418 None] attachment_update completed successfully. Sep 03 14:30:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-833a54ee-c9c8-4aee-9de4-8ac0cc3819bd tempest-VolumesSnapshotListTestJSON-265932066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:30:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-833a54ee-c9c8-4aee-9de4-8ac0cc3819bd tempest-VolumesSnapshotListTestJSON-265932066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:30:33 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-833a54ee-c9c8-4aee-9de4-8ac0cc3819bd tempest-VolumesSnapshotListTestJSON-265932066 None] Creating offline snapshot 582bf869-b4ed-4ab7-a709-747ab836c941 of volume d9c20784-0d6b-4ca1-8340-55978c379148 {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:30:33 devstack sudo[102172]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:33 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d1f645d9-13fc-4c04-91a2-da90b0c75280 tempest-VolumesDeleteCascade-358781585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-27846bf2-ed46-4147-b92b-5b92058c8257" returned: 0 in 0.560s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:33 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d1f645d9-13fc-4c04-91a2-da90b0c75280 tempest-VolumesDeleteCascade-358781585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-27846bf2-ed46-4147-b92b-5b92058c8257 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:33 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[74825113-49f7-4ca8-9ce1-e4f147927d83]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:30:33 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-833a54ee-c9c8-4aee-9de4-8ac0cc3819bd tempest-VolumesSnapshotListTestJSON-265932066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.e0cc6d73-8e89-48b2-a260-c01a475df290 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:33 devstack sudo[102177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-27846bf2-ed46-4147-b92b-5b92058c8257 Sep 03 14:30:33 devstack sudo[102177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:33 devstack sudo[102178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.e0cc6d73-8e89-48b2-a260-c01a475df290 Sep 03 14:30:33 devstack sudo[102178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:33 devstack sudo[102177]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:33 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d1f645d9-13fc-4c04-91a2-da90b0c75280 tempest-VolumesDeleteCascade-358781585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-27846bf2-ed46-4147-b92b-5b92058c8257" returned: 0 in 0.454s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:33 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d1f645d9-13fc-4c04-91a2-da90b0c75280 tempest-VolumesDeleteCascade-358781585 None] Lock "cinder-quobyte-27846bf2-ed46-4147-b92b-5b92058c8257" released by "delete_volume" :: held 1.072s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:30:33 devstack sudo[102178]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:33 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-833a54ee-c9c8-4aee-9de4-8ac0cc3819bd tempest-VolumesSnapshotListTestJSON-265932066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.e0cc6d73-8e89-48b2-a260-c01a475df290" returned: 0 in 0.508s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:33 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-833a54ee-c9c8-4aee-9de4-8ac0cc3819bd tempest-VolumesSnapshotListTestJSON-265932066 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9c20784-0d6b-4ca1-8340-55978c379148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:30:33 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-833a54ee-c9c8-4aee-9de4-8ac0cc3819bd tempest-VolumesSnapshotListTestJSON-265932066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.e0cc6d73-8e89-48b2-a260-c01a475df290,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.582bf869-b4ed-4ab7-a709-747ab836c941 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:33 devstack sudo[102186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.e0cc6d73-8e89-48b2-a260-c01a475df290,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.582bf869-b4ed-4ab7-a709-747ab836c941 1G Sep 03 14:30:33 devstack sudo[102186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:33 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-d1f645d9-13fc-4c04-91a2-da90b0c75280 tempest-VolumesDeleteCascade-358781585 None] Created reservations ['4b8f0637-302f-4298-9952-a6e6a63bc2ad', '7a1575de-bb0a-4b65-979e-ae9e129140a3', 'e2982457-8fb5-4f81-b7cf-fa034179508a', '76c0e29a-466b-45af-bc99-2e405b31aeb9'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:30:33 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d1f645d9-13fc-4c04-91a2-da90b0c75280 tempest-VolumesDeleteCascade-358781585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:30:33 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d1f645d9-13fc-4c04-91a2-da90b0c75280 tempest-VolumesDeleteCascade-358781585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:30:33 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d1f645d9-13fc-4c04-91a2-da90b0c75280 tempest-VolumesDeleteCascade-358781585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:30:33 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d1f645d9-13fc-4c04-91a2-da90b0c75280 tempest-VolumesDeleteCascade-358781585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:30:33 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d1f645d9-13fc-4c04-91a2-da90b0c75280 tempest-VolumesDeleteCascade-358781585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:30:33 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d1f645d9-13fc-4c04-91a2-da90b0c75280 tempest-VolumesDeleteCascade-358781585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:33 devstack sudo[102188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:30:33 devstack sudo[102188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:34 devstack sudo[102188]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d1f645d9-13fc-4c04-91a2-da90b0c75280 tempest-VolumesDeleteCascade-358781585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.428s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:34 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-d1f645d9-13fc-4c04-91a2-da90b0c75280 tempest-VolumesDeleteCascade-358781585 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:30:34 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-d1f645d9-13fc-4c04-91a2-da90b0c75280 tempest-VolumesDeleteCascade-358781585 None] Deleted volume successfully. Sep 03 14:30:34 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d1f645d9-13fc-4c04-91a2-da90b0c75280 tempest-VolumesDeleteCascade-358781585 None] Lock "cinder-27846bf2-ed46-4147-b92b-5b92058c8257-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:30:34 devstack sudo[102186]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-833a54ee-c9c8-4aee-9de4-8ac0cc3819bd tempest-VolumesSnapshotListTestJSON-265932066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.e0cc6d73-8e89-48b2-a260-c01a475df290,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.582bf869-b4ed-4ab7-a709-747ab836c941 1G" returned: 0 in 0.748s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-833a54ee-c9c8-4aee-9de4-8ac0cc3819bd tempest-VolumesSnapshotListTestJSON-265932066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9c20784-0d6b-4ca1-8340-55978c379148.e0cc6d73-8e89-48b2-a260-c01a475df290 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.582bf869-b4ed-4ab7-a709-747ab836c941 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:34 devstack sudo[102196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9c20784-0d6b-4ca1-8340-55978c379148.e0cc6d73-8e89-48b2-a260-c01a475df290 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.582bf869-b4ed-4ab7-a709-747ab836c941 Sep 03 14:30:34 devstack sudo[102196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:34 devstack sudo[102196]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-833a54ee-c9c8-4aee-9de4-8ac0cc3819bd tempest-VolumesSnapshotListTestJSON-265932066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9c20784-0d6b-4ca1-8340-55978c379148.e0cc6d73-8e89-48b2-a260-c01a475df290 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.582bf869-b4ed-4ab7-a709-747ab836c941" returned: 0 in 0.356s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:34 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-833a54ee-c9c8-4aee-9de4-8ac0cc3819bd tempest-VolumesSnapshotListTestJSON-265932066 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.582bf869-b4ed-4ab7-a709-747ab836c941 is being set with open permissions: ugo+rw Sep 03 14:30:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-833a54ee-c9c8-4aee-9de4-8ac0cc3819bd tempest-VolumesSnapshotListTestJSON-265932066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.582bf869-b4ed-4ab7-a709-747ab836c941 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:34 devstack sudo[102202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.582bf869-b4ed-4ab7-a709-747ab836c941 Sep 03 14:30:34 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:35 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-833a54ee-c9c8-4aee-9de4-8ac0cc3819bd tempest-VolumesSnapshotListTestJSON-265932066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.582bf869-b4ed-4ab7-a709-747ab836c941" returned: 0 in 0.353s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-833a54ee-c9c8-4aee-9de4-8ac0cc3819bd tempest-VolumesSnapshotListTestJSON-265932066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.176s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:30:35 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-833a54ee-c9c8-4aee-9de4-8ac0cc3819bd tempest-VolumesSnapshotListTestJSON-265932066 None] Create snapshot completed successfully Sep 03 14:30:37 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c1528de2-cef9-48b7-b7a8-80cfb386b2c8 tempest-VolumesSnapshotListTestJSON-265932066 None] Acquiring lock "cinder-582bf869-b4ed-4ab7-a709-747ab836c941-delete_snapshot" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:30:37 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c1528de2-cef9-48b7-b7a8-80cfb386b2c8 tempest-VolumesSnapshotListTestJSON-265932066 None] Lock "cinder-582bf869-b4ed-4ab7-a709-747ab836c941-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:30:37 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c1528de2-cef9-48b7-b7a8-80cfb386b2c8 tempest-VolumesSnapshotListTestJSON-265932066 None] Acquiring lock "cinder-quobyte-d9c20784-0d6b-4ca1-8340-55978c379148" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:30:37 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c1528de2-cef9-48b7-b7a8-80cfb386b2c8 tempest-VolumesSnapshotListTestJSON-265932066 None] Lock "cinder-quobyte-d9c20784-0d6b-4ca1-8340-55978c379148" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:30:37 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c1528de2-cef9-48b7-b7a8-80cfb386b2c8 tempest-VolumesSnapshotListTestJSON-265932066 None] Acquiring lock "cinder-quobyte-582bf869-b4ed-4ab7-a709-747ab836c941" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:30:37 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c1528de2-cef9-48b7-b7a8-80cfb386b2c8 tempest-VolumesSnapshotListTestJSON-265932066 None] Lock "cinder-quobyte-582bf869-b4ed-4ab7-a709-747ab836c941" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:30:37 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-c1528de2-cef9-48b7-b7a8-80cfb386b2c8 tempest-VolumesSnapshotListTestJSON-265932066 None] Deleting offline snapshot 582bf869-b4ed-4ab7-a709-747ab836c941 of volume d9c20784-0d6b-4ca1-8340-55978c379148 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:30:37 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-c1528de2-cef9-48b7-b7a8-80cfb386b2c8 tempest-VolumesSnapshotListTestJSON-265932066 None] snapshot_file for this snap is: volume-d9c20784-0d6b-4ca1-8340-55978c379148.582bf869-b4ed-4ab7-a709-747ab836c941 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:30:37 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4b051f-ca05-4090-81be-5ab3eaea7339]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:30:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c1528de2-cef9-48b7-b7a8-80cfb386b2c8 tempest-VolumesSnapshotListTestJSON-265932066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.582bf869-b4ed-4ab7-a709-747ab836c941 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:37 devstack sudo[102271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.582bf869-b4ed-4ab7-a709-747ab836c941 Sep 03 14:30:37 devstack sudo[102271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:38 devstack sudo[102271]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c1528de2-cef9-48b7-b7a8-80cfb386b2c8 tempest-VolumesSnapshotListTestJSON-265932066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.582bf869-b4ed-4ab7-a709-747ab836c941" returned: 0 in 0.759s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:38 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-c1528de2-cef9-48b7-b7a8-80cfb386b2c8 tempest-VolumesSnapshotListTestJSON-265932066 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9c20784-0d6b-4ca1-8340-55978c379148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:30:38 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[64814d89-3e19-4d18-8aac-90b54c1c65f4]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:30:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c1528de2-cef9-48b7-b7a8-80cfb386b2c8 tempest-VolumesSnapshotListTestJSON-265932066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.e0cc6d73-8e89-48b2-a260-c01a475df290 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:38 devstack sudo[102631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.e0cc6d73-8e89-48b2-a260-c01a475df290 Sep 03 14:30:38 devstack sudo[102631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:38 devstack sudo[102631]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c1528de2-cef9-48b7-b7a8-80cfb386b2c8 tempest-VolumesSnapshotListTestJSON-265932066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.e0cc6d73-8e89-48b2-a260-c01a475df290" returned: 0 in 0.723s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:38 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-c1528de2-cef9-48b7-b7a8-80cfb386b2c8 tempest-VolumesSnapshotListTestJSON-265932066 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9c20784-0d6b-4ca1-8340-55978c379148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:30:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c1528de2-cef9-48b7-b7a8-80cfb386b2c8 tempest-VolumesSnapshotListTestJSON-265932066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.582bf869-b4ed-4ab7-a709-747ab836c941 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:39 devstack sudo[102663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.582bf869-b4ed-4ab7-a709-747ab836c941 Sep 03 14:30:39 devstack sudo[102663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:39 devstack sudo[102663]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c1528de2-cef9-48b7-b7a8-80cfb386b2c8 tempest-VolumesSnapshotListTestJSON-265932066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.582bf869-b4ed-4ab7-a709-747ab836c941" returned: 0 in 0.670s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c1528de2-cef9-48b7-b7a8-80cfb386b2c8 tempest-VolumesSnapshotListTestJSON-265932066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.582bf869-b4ed-4ab7-a709-747ab836c941 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:39 devstack sudo[102670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.582bf869-b4ed-4ab7-a709-747ab836c941 Sep 03 14:30:39 devstack sudo[102670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:39 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3b622c7-1223-40fb-af7d-658d481bb2f0 tempest-VolumesMetadataTest-1705709122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:30:39 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b3b622c7-1223-40fb-af7d-658d481bb2f0 tempest-VolumesMetadataTest-1705709122 None] Flow 'volume_create_manager' (8a48cbe3-1b3e-40f3-8824-701338bacb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:30:39 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b3b622c7-1223-40fb-af7d-658d481bb2f0 tempest-VolumesMetadataTest-1705709122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1a1f03e-0fa2-40d7-a619-a96b0d4a777a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b3b622c7-1223-40fb-af7d-658d481bb2f0 tempest-VolumesMetadataTest-1705709122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1a1f03e-0fa2-40d7-a619-a96b0d4a777a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:30:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1591167254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd79e98b-ae08-4880-84d6-1522138c074d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e54c3e56a6384566a1537ab004200c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:30:40Z,use_quota=True,user_id='fa76a243146d4816aecf52c5c4170052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b3b622c7-1223-40fb-af7d-658d481bb2f0 tempest-VolumesMetadataTest-1705709122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5d1bb5b-76b0-4557-b969-d33b8c91172d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b3b622c7-1223-40fb-af7d-658d481bb2f0 tempest-VolumesMetadataTest-1705709122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5d1bb5b-76b0-4557-b969-d33b8c91172d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b3b622c7-1223-40fb-af7d-658d481bb2f0 tempest-VolumesMetadataTest-1705709122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aad5269d-81bf-4584-a465-fa1750ffda66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:40 devstack sudo[102670]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b3b622c7-1223-40fb-af7d-658d481bb2f0 tempest-VolumesMetadataTest-1705709122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aad5269d-81bf-4584-a465-fa1750ffda66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd79e98b-ae08-4880-84d6-1522138c074d', 'volume_name': 'volume-bd79e98b-ae08-4880-84d6-1522138c074d', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b3b622c7-1223-40fb-af7d-658d481bb2f0 tempest-VolumesMetadataTest-1705709122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb90e3a0-8b95-46a7-8159-9c782d3407ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b3b622c7-1223-40fb-af7d-658d481bb2f0 tempest-VolumesMetadataTest-1705709122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb90e3a0-8b95-46a7-8159-9c782d3407ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b3b622c7-1223-40fb-af7d-658d481bb2f0 tempest-VolumesMetadataTest-1705709122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed13fb74-db7f-492d-84a4-d67706b3224f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:40 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-b3b622c7-1223-40fb-af7d-658d481bb2f0 tempest-VolumesMetadataTest-1705709122 None] Volume bd79e98b-ae08-4880-84d6-1522138c074d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd79e98b-ae08-4880-84d6-1522138c074d', 'volume_size': 1} Sep 03 14:30:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b3b622c7-1223-40fb-af7d-658d481bb2f0 tempest-VolumesMetadataTest-1705709122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:30:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b3b622c7-1223-40fb-af7d-658d481bb2f0 tempest-VolumesMetadataTest-1705709122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:30:40 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b3b622c7-1223-40fb-af7d-658d481bb2f0 tempest-VolumesMetadataTest-1705709122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:30:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1591167254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd79e98b-ae08-4880-84d6-1522138c074d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e54c3e56a6384566a1537ab004200c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:30:40Z,use_quota=True,user_id='fa76a243146d4816aecf52c5c4170052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:30:40 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-b3b622c7-1223-40fb-af7d-658d481bb2f0 tempest-VolumesMetadataTest-1705709122 None] Creating volume bd79e98b-ae08-4880-84d6-1522138c074d {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:30:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b3b622c7-1223-40fb-af7d-658d481bb2f0 tempest-VolumesMetadataTest-1705709122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:30:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b3b622c7-1223-40fb-af7d-658d481bb2f0 tempest-VolumesMetadataTest-1705709122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:30:40 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b3b622c7-1223-40fb-af7d-658d481bb2f0 tempest-VolumesMetadataTest-1705709122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:30:40 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b3b622c7-1223-40fb-af7d-658d481bb2f0 tempest-VolumesMetadataTest-1705709122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:30:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b3b622c7-1223-40fb-af7d-658d481bb2f0 tempest-VolumesMetadataTest-1705709122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:30:40 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b3b622c7-1223-40fb-af7d-658d481bb2f0 tempest-VolumesMetadataTest-1705709122 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:30:40 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-b3b622c7-1223-40fb-af7d-658d481bb2f0 tempest-VolumesMetadataTest-1705709122 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:30:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b3b622c7-1223-40fb-af7d-658d481bb2f0 tempest-VolumesMetadataTest-1705709122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bd79e98b-ae08-4880-84d6-1522138c074d 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c1528de2-cef9-48b7-b7a8-80cfb386b2c8 tempest-VolumesSnapshotListTestJSON-265932066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.582bf869-b4ed-4ab7-a709-747ab836c941" returned: 0 in 0.462s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:40 devstack sudo[102675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bd79e98b-ae08-4880-84d6-1522138c074d 1073741824 Sep 03 14:30:40 devstack sudo[102675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:40 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c1528de2-cef9-48b7-b7a8-80cfb386b2c8 tempest-VolumesSnapshotListTestJSON-265932066 None] Lock "cinder-quobyte-582bf869-b4ed-4ab7-a709-747ab836c941" released by "_delete_snapshot" :: held 2.932s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:30:40 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c1528de2-cef9-48b7-b7a8-80cfb386b2c8 tempest-VolumesSnapshotListTestJSON-265932066 None] Lock "cinder-quobyte-d9c20784-0d6b-4ca1-8340-55978c379148" released by "delete_snapshot" :: held 2.979s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:30:40 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-c1528de2-cef9-48b7-b7a8-80cfb386b2c8 tempest-VolumesSnapshotListTestJSON-265932066 None] Created reservations ['a9882097-086a-4039-8dd5-8852776e1442', '825d160c-6d12-4a0e-bafa-b25ce1745368', '2b4d44dd-a278-479d-bf36-69a3095db610', '6a0ee24c-3267-4374-be42-8c8605032f8c'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:30:40 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-c1528de2-cef9-48b7-b7a8-80cfb386b2c8 tempest-VolumesSnapshotListTestJSON-265932066 None] Delete snapshot completed successfully. Sep 03 14:30:40 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c1528de2-cef9-48b7-b7a8-80cfb386b2c8 tempest-VolumesSnapshotListTestJSON-265932066 None] Lock "cinder-582bf869-b4ed-4ab7-a709-747ab836c941-delete_snapshot" released by "delete_snapshot" :: held 3.319s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:30:40 devstack sudo[102675]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b3b622c7-1223-40fb-af7d-658d481bb2f0 tempest-VolumesMetadataTest-1705709122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bd79e98b-ae08-4880-84d6-1522138c074d 1073741824" returned: 0 in 0.630s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b3b622c7-1223-40fb-af7d-658d481bb2f0 tempest-VolumesMetadataTest-1705709122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bd79e98b-ae08-4880-84d6-1522138c074d {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:40 devstack sudo[102681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bd79e98b-ae08-4880-84d6-1522138c074d Sep 03 14:30:40 devstack sudo[102681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:41 devstack sudo[102681]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b3b622c7-1223-40fb-af7d-658d481bb2f0 tempest-VolumesMetadataTest-1705709122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bd79e98b-ae08-4880-84d6-1522138c074d" returned: 0 in 0.318s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b3b622c7-1223-40fb-af7d-658d481bb2f0 tempest-VolumesMetadataTest-1705709122 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:30:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b3b622c7-1223-40fb-af7d-658d481bb2f0 tempest-VolumesMetadataTest-1705709122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:30:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b3b622c7-1223-40fb-af7d-658d481bb2f0 tempest-VolumesMetadataTest-1705709122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed13fb74-db7f-492d-84a4-d67706b3224f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd79e98b-ae08-4880-84d6-1522138c074d', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b3b622c7-1223-40fb-af7d-658d481bb2f0 tempest-VolumesMetadataTest-1705709122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57a44e6d-d570-4101-984a-49f5549304f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:41 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-b3b622c7-1223-40fb-af7d-658d481bb2f0 tempest-VolumesMetadataTest-1705709122 None] Volume volume-bd79e98b-ae08-4880-84d6-1522138c074d (bd79e98b-ae08-4880-84d6-1522138c074d): created successfully Sep 03 14:30:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b3b622c7-1223-40fb-af7d-658d481bb2f0 tempest-VolumesMetadataTest-1705709122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57a44e6d-d570-4101-984a-49f5549304f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b3b622c7-1223-40fb-af7d-658d481bb2f0 tempest-VolumesMetadataTest-1705709122 None] Flow 'volume_create_manager' (8a48cbe3-1b3e-40f3-8824-701338bacb0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:30:41 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-b3b622c7-1223-40fb-af7d-658d481bb2f0 tempest-VolumesMetadataTest-1705709122 None] Created volume successfully. Sep 03 14:30:41 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-52eb6758-5e3e-4df8-bff2-562469f7a1fd tempest-VolumesSnapshotListTestJSON-265932066 None] Acquiring lock "cinder-e0cc6d73-8e89-48b2-a260-c01a475df290-delete_snapshot" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:30:41 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-52eb6758-5e3e-4df8-bff2-562469f7a1fd tempest-VolumesSnapshotListTestJSON-265932066 None] Lock "cinder-e0cc6d73-8e89-48b2-a260-c01a475df290-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:30:41 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-52eb6758-5e3e-4df8-bff2-562469f7a1fd tempest-VolumesSnapshotListTestJSON-265932066 None] Acquiring lock "cinder-quobyte-d9c20784-0d6b-4ca1-8340-55978c379148" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:30:41 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-52eb6758-5e3e-4df8-bff2-562469f7a1fd tempest-VolumesSnapshotListTestJSON-265932066 None] Lock "cinder-quobyte-d9c20784-0d6b-4ca1-8340-55978c379148" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:30:41 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-52eb6758-5e3e-4df8-bff2-562469f7a1fd tempest-VolumesSnapshotListTestJSON-265932066 None] Acquiring lock "cinder-quobyte-e0cc6d73-8e89-48b2-a260-c01a475df290" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:30:41 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-52eb6758-5e3e-4df8-bff2-562469f7a1fd tempest-VolumesSnapshotListTestJSON-265932066 None] Lock "cinder-quobyte-e0cc6d73-8e89-48b2-a260-c01a475df290" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:30:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-52eb6758-5e3e-4df8-bff2-562469f7a1fd tempest-VolumesSnapshotListTestJSON-265932066 None] Deleting offline snapshot e0cc6d73-8e89-48b2-a260-c01a475df290 of volume d9c20784-0d6b-4ca1-8340-55978c379148 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:30:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-52eb6758-5e3e-4df8-bff2-562469f7a1fd tempest-VolumesSnapshotListTestJSON-265932066 None] snapshot_file for this snap is: volume-d9c20784-0d6b-4ca1-8340-55978c379148.e0cc6d73-8e89-48b2-a260-c01a475df290 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:30:41 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5bcfcc-8c83-4a9e-aaa6-2bca0568035e]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:30:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-52eb6758-5e3e-4df8-bff2-562469f7a1fd tempest-VolumesSnapshotListTestJSON-265932066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.e0cc6d73-8e89-48b2-a260-c01a475df290 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:41 devstack sudo[102685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.e0cc6d73-8e89-48b2-a260-c01a475df290 Sep 03 14:30:41 devstack sudo[102685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:42 devstack sudo[102685]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-52eb6758-5e3e-4df8-bff2-562469f7a1fd tempest-VolumesSnapshotListTestJSON-265932066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.e0cc6d73-8e89-48b2-a260-c01a475df290" returned: 0 in 0.664s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:42 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-52eb6758-5e3e-4df8-bff2-562469f7a1fd tempest-VolumesSnapshotListTestJSON-265932066 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9c20784-0d6b-4ca1-8340-55978c379148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:30:42 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8e3b38-e21c-4531-9baa-b8427bbe6be0]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:30:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-52eb6758-5e3e-4df8-bff2-562469f7a1fd tempest-VolumesSnapshotListTestJSON-265932066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.2a50507b-e4cd-490c-a035-ee47e695eb09 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:42 devstack sudo[102690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.2a50507b-e4cd-490c-a035-ee47e695eb09 Sep 03 14:30:42 devstack sudo[102690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:43 devstack sudo[102690]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:43 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-3daf43aa-d5e7-423a-9904-0afaecffd8c5 tempest-VolumesMetadataTest-1705709122 None] Acquiring lock "cinder-bd79e98b-ae08-4880-84d6-1522138c074d-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:30:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-52eb6758-5e3e-4df8-bff2-562469f7a1fd tempest-VolumesSnapshotListTestJSON-265932066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.2a50507b-e4cd-490c-a035-ee47e695eb09" returned: 0 in 0.608s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:43 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-52eb6758-5e3e-4df8-bff2-562469f7a1fd tempest-VolumesSnapshotListTestJSON-265932066 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9c20784-0d6b-4ca1-8340-55978c379148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:30:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-52eb6758-5e3e-4df8-bff2-562469f7a1fd tempest-VolumesSnapshotListTestJSON-265932066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.e0cc6d73-8e89-48b2-a260-c01a475df290 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:43 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-3daf43aa-d5e7-423a-9904-0afaecffd8c5 tempest-VolumesMetadataTest-1705709122 None] Lock "cinder-bd79e98b-ae08-4880-84d6-1522138c074d-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:30:43 devstack sudo[102695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.e0cc6d73-8e89-48b2-a260-c01a475df290 Sep 03 14:30:43 devstack sudo[102695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:43 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:SELECT=148,cinder:INSERT=51,cinder:UPDATE=155,cinder:DELETE=5 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:30:43 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-3daf43aa-d5e7-423a-9904-0afaecffd8c5 tempest-VolumesMetadataTest-1705709122 None] Acquiring lock "cinder-quobyte-bd79e98b-ae08-4880-84d6-1522138c074d" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:30:43 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-3daf43aa-d5e7-423a-9904-0afaecffd8c5 tempest-VolumesMetadataTest-1705709122 None] Lock "cinder-quobyte-bd79e98b-ae08-4880-84d6-1522138c074d" acquired by "delete_volume" :: waited 0.072s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:30:43 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[253776e9-df75-4137-9720-8f720689219f]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:30:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3daf43aa-d5e7-423a-9904-0afaecffd8c5 tempest-VolumesMetadataTest-1705709122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bd79e98b-ae08-4880-84d6-1522138c074d {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:43 devstack sudo[102697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bd79e98b-ae08-4880-84d6-1522138c074d Sep 03 14:30:43 devstack sudo[102697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:43 devstack sudo[102695]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-52eb6758-5e3e-4df8-bff2-562469f7a1fd tempest-VolumesSnapshotListTestJSON-265932066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.e0cc6d73-8e89-48b2-a260-c01a475df290" returned: 0 in 0.579s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-52eb6758-5e3e-4df8-bff2-562469f7a1fd tempest-VolumesSnapshotListTestJSON-265932066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.e0cc6d73-8e89-48b2-a260-c01a475df290 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:43 devstack sudo[102703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.e0cc6d73-8e89-48b2-a260-c01a475df290 Sep 03 14:30:43 devstack sudo[102703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:43 devstack sudo[102697]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3daf43aa-d5e7-423a-9904-0afaecffd8c5 tempest-VolumesMetadataTest-1705709122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bd79e98b-ae08-4880-84d6-1522138c074d" returned: 0 in 0.495s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3daf43aa-d5e7-423a-9904-0afaecffd8c5 tempest-VolumesMetadataTest-1705709122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bd79e98b-ae08-4880-84d6-1522138c074d {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:43 devstack sudo[102710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bd79e98b-ae08-4880-84d6-1522138c074d Sep 03 14:30:43 devstack sudo[102710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:44 devstack sudo[102703]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-52eb6758-5e3e-4df8-bff2-562469f7a1fd tempest-VolumesSnapshotListTestJSON-265932066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.e0cc6d73-8e89-48b2-a260-c01a475df290" returned: 0 in 0.398s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:44 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-52eb6758-5e3e-4df8-bff2-562469f7a1fd tempest-VolumesSnapshotListTestJSON-265932066 None] Lock "cinder-quobyte-e0cc6d73-8e89-48b2-a260-c01a475df290" released by "_delete_snapshot" :: held 2.432s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:30:44 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-52eb6758-5e3e-4df8-bff2-562469f7a1fd tempest-VolumesSnapshotListTestJSON-265932066 None] Lock "cinder-quobyte-d9c20784-0d6b-4ca1-8340-55978c379148" released by "delete_snapshot" :: held 2.468s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:30:44 devstack sudo[102710]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3daf43aa-d5e7-423a-9904-0afaecffd8c5 tempest-VolumesMetadataTest-1705709122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-bd79e98b-ae08-4880-84d6-1522138c074d" returned: 0 in 0.302s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:44 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-3daf43aa-d5e7-423a-9904-0afaecffd8c5 tempest-VolumesMetadataTest-1705709122 None] Lock "cinder-quobyte-bd79e98b-ae08-4880-84d6-1522138c074d" released by "delete_volume" :: held 0.882s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:30:44 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-3daf43aa-d5e7-423a-9904-0afaecffd8c5 tempest-VolumesMetadataTest-1705709122 None] Created reservations ['d4fd13ab-1edc-456b-8aa0-9917c23cb70d', '29055aa6-2514-4433-800c-b64efa72009f', 'e8f10fc3-01e1-4c31-8ab7-c103a623d00d', '57278aa0-92a8-4763-8bf9-8733eaa086bf'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:30:44 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-52eb6758-5e3e-4df8-bff2-562469f7a1fd tempest-VolumesSnapshotListTestJSON-265932066 None] Created reservations ['46cea10e-b605-4913-9375-f2f1c7d0f600', '116ef608-8931-4f18-9d28-4d5721b979f0', 'b7ca2e6e-3f09-4221-a097-1cf7949671b3', '15008ddc-817a-490d-ae4c-849d4447ec73'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:30:44 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-52eb6758-5e3e-4df8-bff2-562469f7a1fd tempest-VolumesSnapshotListTestJSON-265932066 None] Delete snapshot completed successfully. Sep 03 14:30:44 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-52eb6758-5e3e-4df8-bff2-562469f7a1fd tempest-VolumesSnapshotListTestJSON-265932066 None] Lock "cinder-e0cc6d73-8e89-48b2-a260-c01a475df290-delete_snapshot" released by "delete_snapshot" :: held 2.760s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:30:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-3daf43aa-d5e7-423a-9904-0afaecffd8c5 tempest-VolumesMetadataTest-1705709122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:30:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-3daf43aa-d5e7-423a-9904-0afaecffd8c5 tempest-VolumesMetadataTest-1705709122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:30:44 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-3daf43aa-d5e7-423a-9904-0afaecffd8c5 tempest-VolumesMetadataTest-1705709122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:30:44 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-3daf43aa-d5e7-423a-9904-0afaecffd8c5 tempest-VolumesMetadataTest-1705709122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:30:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-3daf43aa-d5e7-423a-9904-0afaecffd8c5 tempest-VolumesMetadataTest-1705709122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:30:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3daf43aa-d5e7-423a-9904-0afaecffd8c5 tempest-VolumesMetadataTest-1705709122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:44 devstack sudo[102714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:30:44 devstack sudo[102714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:44 devstack sudo[102714]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3daf43aa-d5e7-423a-9904-0afaecffd8c5 tempest-VolumesMetadataTest-1705709122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.281s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:44 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-3daf43aa-d5e7-423a-9904-0afaecffd8c5 tempest-VolumesMetadataTest-1705709122 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:30:44 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-3daf43aa-d5e7-423a-9904-0afaecffd8c5 tempest-VolumesMetadataTest-1705709122 None] Deleted volume successfully. Sep 03 14:30:44 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-3daf43aa-d5e7-423a-9904-0afaecffd8c5 tempest-VolumesMetadataTest-1705709122 None] Lock "cinder-bd79e98b-ae08-4880-84d6-1522138c074d-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:30:44 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2d8aca2f-57d4-4ad4-813c-e635cc4a62f0 tempest-VolumesSnapshotListTestJSON-265932066 None] Acquiring lock "cinder-2a50507b-e4cd-490c-a035-ee47e695eb09-delete_snapshot" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:30:44 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2d8aca2f-57d4-4ad4-813c-e635cc4a62f0 tempest-VolumesSnapshotListTestJSON-265932066 None] Lock "cinder-2a50507b-e4cd-490c-a035-ee47e695eb09-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:30:44 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2d8aca2f-57d4-4ad4-813c-e635cc4a62f0 tempest-VolumesSnapshotListTestJSON-265932066 None] Acquiring lock "cinder-quobyte-d9c20784-0d6b-4ca1-8340-55978c379148" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:30:44 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2d8aca2f-57d4-4ad4-813c-e635cc4a62f0 tempest-VolumesSnapshotListTestJSON-265932066 None] Lock "cinder-quobyte-d9c20784-0d6b-4ca1-8340-55978c379148" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:30:44 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2d8aca2f-57d4-4ad4-813c-e635cc4a62f0 tempest-VolumesSnapshotListTestJSON-265932066 None] Acquiring lock "cinder-quobyte-2a50507b-e4cd-490c-a035-ee47e695eb09" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:30:44 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2d8aca2f-57d4-4ad4-813c-e635cc4a62f0 tempest-VolumesSnapshotListTestJSON-265932066 None] Lock "cinder-quobyte-2a50507b-e4cd-490c-a035-ee47e695eb09" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:30:44 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-2d8aca2f-57d4-4ad4-813c-e635cc4a62f0 tempest-VolumesSnapshotListTestJSON-265932066 None] Deleting offline snapshot 2a50507b-e4cd-490c-a035-ee47e695eb09 of volume d9c20784-0d6b-4ca1-8340-55978c379148 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:30:45 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-2d8aca2f-57d4-4ad4-813c-e635cc4a62f0 tempest-VolumesSnapshotListTestJSON-265932066 None] snapshot_file for this snap is: volume-d9c20784-0d6b-4ca1-8340-55978c379148.2a50507b-e4cd-490c-a035-ee47e695eb09 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:30:45 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[04527ee3-25f9-4aac-8abb-2764d9227a08]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:30:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2d8aca2f-57d4-4ad4-813c-e635cc4a62f0 tempest-VolumesSnapshotListTestJSON-265932066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.2a50507b-e4cd-490c-a035-ee47e695eb09 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:45 devstack sudo[102717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.2a50507b-e4cd-490c-a035-ee47e695eb09 Sep 03 14:30:45 devstack sudo[102717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:45 devstack sudo[102717]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2d8aca2f-57d4-4ad4-813c-e635cc4a62f0 tempest-VolumesSnapshotListTestJSON-265932066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.2a50507b-e4cd-490c-a035-ee47e695eb09" returned: 0 in 0.471s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:45 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-2d8aca2f-57d4-4ad4-813c-e635cc4a62f0 tempest-VolumesSnapshotListTestJSON-265932066 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9c20784-0d6b-4ca1-8340-55978c379148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:30:45 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[97307e71-fc66-408d-bae7-22b33773c60f]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:30:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2d8aca2f-57d4-4ad4-813c-e635cc4a62f0 tempest-VolumesSnapshotListTestJSON-265932066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:45 devstack sudo[102722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148 Sep 03 14:30:45 devstack sudo[102722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:46 devstack sudo[102722]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2d8aca2f-57d4-4ad4-813c-e635cc4a62f0 tempest-VolumesSnapshotListTestJSON-265932066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148" returned: 0 in 0.729s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2d8aca2f-57d4-4ad4-813c-e635cc4a62f0 tempest-VolumesSnapshotListTestJSON-265932066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.2a50507b-e4cd-490c-a035-ee47e695eb09 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:46 devstack sudo[102728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.2a50507b-e4cd-490c-a035-ee47e695eb09 Sep 03 14:30:46 devstack sudo[102728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:46 devstack sudo[102728]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2d8aca2f-57d4-4ad4-813c-e635cc4a62f0 tempest-VolumesSnapshotListTestJSON-265932066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.2a50507b-e4cd-490c-a035-ee47e695eb09" returned: 0 in 0.499s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2d8aca2f-57d4-4ad4-813c-e635cc4a62f0 tempest-VolumesSnapshotListTestJSON-265932066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.2a50507b-e4cd-490c-a035-ee47e695eb09 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:46 devstack sudo[102734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.2a50507b-e4cd-490c-a035-ee47e695eb09 Sep 03 14:30:46 devstack sudo[102734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:47 devstack sudo[102734]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2d8aca2f-57d4-4ad4-813c-e635cc4a62f0 tempest-VolumesSnapshotListTestJSON-265932066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148.2a50507b-e4cd-490c-a035-ee47e695eb09" returned: 0 in 0.380s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:47 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2d8aca2f-57d4-4ad4-813c-e635cc4a62f0 tempest-VolumesSnapshotListTestJSON-265932066 None] Lock "cinder-quobyte-2a50507b-e4cd-490c-a035-ee47e695eb09" released by "_delete_snapshot" :: held 2.253s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:30:47 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2d8aca2f-57d4-4ad4-813c-e635cc4a62f0 tempest-VolumesSnapshotListTestJSON-265932066 None] Lock "cinder-quobyte-d9c20784-0d6b-4ca1-8340-55978c379148" released by "delete_snapshot" :: held 2.285s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:30:47 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-2d8aca2f-57d4-4ad4-813c-e635cc4a62f0 tempest-VolumesSnapshotListTestJSON-265932066 None] Created reservations ['707260d1-f6cc-42cc-9f18-ad7d81fb8551', '9f20eb89-c053-4e50-ae4b-d5655d8ddc39', '507b399d-16ef-4bf6-84b4-d648fd480ac2', 'f26d54ff-ac3f-44a2-ad54-ba67bc56545f'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:30:47 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-2d8aca2f-57d4-4ad4-813c-e635cc4a62f0 tempest-VolumesSnapshotListTestJSON-265932066 None] Delete snapshot completed successfully. Sep 03 14:30:47 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2d8aca2f-57d4-4ad4-813c-e635cc4a62f0 tempest-VolumesSnapshotListTestJSON-265932066 None] Lock "cinder-2a50507b-e4cd-490c-a035-ee47e695eb09-delete_snapshot" released by "delete_snapshot" :: held 2.600s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:30:48 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-89b58a57-0a70-408b-9e00-b151421669e8 tempest-VolumesSnapshotListTestJSON-265932066 None] Acquiring lock "cinder-d9c20784-0d6b-4ca1-8340-55978c379148-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:30:48 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-89b58a57-0a70-408b-9e00-b151421669e8 tempest-VolumesSnapshotListTestJSON-265932066 None] Lock "cinder-d9c20784-0d6b-4ca1-8340-55978c379148-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:30:48 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-89b58a57-0a70-408b-9e00-b151421669e8 tempest-VolumesSnapshotListTestJSON-265932066 None] Acquiring lock "cinder-quobyte-d9c20784-0d6b-4ca1-8340-55978c379148" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:30:48 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-89b58a57-0a70-408b-9e00-b151421669e8 tempest-VolumesSnapshotListTestJSON-265932066 None] Lock "cinder-quobyte-d9c20784-0d6b-4ca1-8340-55978c379148" acquired by "delete_volume" :: waited 0.018s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:30:48 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6702c20a-d071-4925-bc8f-34a4dea17c3c]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:30:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-89b58a57-0a70-408b-9e00-b151421669e8 tempest-VolumesSnapshotListTestJSON-265932066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:48 devstack sudo[102737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148 Sep 03 14:30:48 devstack sudo[102737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:49 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-da497a4c-243a-435f-872c-bb168894744c tempest-TestInstancesWithCinderVolumes-1947083261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:30:49 devstack sudo[102737]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-da497a4c-243a-435f-872c-bb168894744c tempest-TestInstancesWithCinderVolumes-1947083261 None] Flow 'volume_create_manager' (c89ecac8-90c5-4ac7-9648-c503d13761a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:30:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-da497a4c-243a-435f-872c-bb168894744c tempest-TestInstancesWithCinderVolumes-1947083261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aee96d89-7348-4bda-878f-b5b6c14a4513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-89b58a57-0a70-408b-9e00-b151421669e8 tempest-VolumesSnapshotListTestJSON-265932066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148" returned: 0 in 0.541s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-89b58a57-0a70-408b-9e00-b151421669e8 tempest-VolumesSnapshotListTestJSON-265932066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-da497a4c-243a-435f-872c-bb168894744c tempest-TestInstancesWithCinderVolumes-1947083261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aee96d89-7348-4bda-878f-b5b6c14a4513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-381267093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87f6be89-cf67-4921-82a6-92506ede6580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa5fb2f914624fa584287fe9e8aa34ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:30:49Z,use_quota=True,user_id='c27b6a1c509c44d5ba0c2064397ed05c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b10735a-bf50-4ce5-a6a3-581503c6ace0),volume_type_id=6b10735a-bf50-4ce5-a6a3-581503c6ace0)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:49 devstack sudo[102743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148 Sep 03 14:30:49 devstack sudo[102743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-da497a4c-243a-435f-872c-bb168894744c tempest-TestInstancesWithCinderVolumes-1947083261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5d8bd5c-da81-4dbf-967d-a57e617efa35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-da497a4c-243a-435f-872c-bb168894744c tempest-TestInstancesWithCinderVolumes-1947083261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5d8bd5c-da81-4dbf-967d-a57e617efa35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-da497a4c-243a-435f-872c-bb168894744c tempest-TestInstancesWithCinderVolumes-1947083261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dd84ff8-1fb0-45b2-9f37-c31e85d78962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-da497a4c-243a-435f-872c-bb168894744c tempest-TestInstancesWithCinderVolumes-1947083261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dd84ff8-1fb0-45b2-9f37-c31e85d78962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87f6be89-cf67-4921-82a6-92506ede6580', 'volume_name': 'volume-87f6be89-cf67-4921-82a6-92506ede6580', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-da497a4c-243a-435f-872c-bb168894744c tempest-TestInstancesWithCinderVolumes-1947083261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4745e6cd-e8c3-495d-a009-68b1b6a4d4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-da497a4c-243a-435f-872c-bb168894744c tempest-TestInstancesWithCinderVolumes-1947083261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4745e6cd-e8c3-495d-a009-68b1b6a4d4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-da497a4c-243a-435f-872c-bb168894744c tempest-TestInstancesWithCinderVolumes-1947083261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bd64d17-8c16-438e-8d4e-4ce77e45ec7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:49 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-da497a4c-243a-435f-872c-bb168894744c tempest-TestInstancesWithCinderVolumes-1947083261 None] Volume 87f6be89-cf67-4921-82a6-92506ede6580: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87f6be89-cf67-4921-82a6-92506ede6580', 'volume_size': 1} Sep 03 14:30:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-da497a4c-243a-435f-872c-bb168894744c tempest-TestInstancesWithCinderVolumes-1947083261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:30:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-da497a4c-243a-435f-872c-bb168894744c tempest-TestInstancesWithCinderVolumes-1947083261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:30:49 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-da497a4c-243a-435f-872c-bb168894744c tempest-TestInstancesWithCinderVolumes-1947083261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-381267093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87f6be89-cf67-4921-82a6-92506ede6580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa5fb2f914624fa584287fe9e8aa34ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:30:49Z,use_quota=True,user_id='c27b6a1c509c44d5ba0c2064397ed05c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b10735a-bf50-4ce5-a6a3-581503c6ace0),volume_type_id=6b10735a-bf50-4ce5-a6a3-581503c6ace0)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:30:49 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-da497a4c-243a-435f-872c-bb168894744c tempest-TestInstancesWithCinderVolumes-1947083261 None] Creating volume 87f6be89-cf67-4921-82a6-92506ede6580 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:30:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-da497a4c-243a-435f-872c-bb168894744c tempest-TestInstancesWithCinderVolumes-1947083261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:30:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-da497a4c-243a-435f-872c-bb168894744c tempest-TestInstancesWithCinderVolumes-1947083261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:30:49 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-da497a4c-243a-435f-872c-bb168894744c tempest-TestInstancesWithCinderVolumes-1947083261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:30:49 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-da497a4c-243a-435f-872c-bb168894744c tempest-TestInstancesWithCinderVolumes-1947083261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:30:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-da497a4c-243a-435f-872c-bb168894744c tempest-TestInstancesWithCinderVolumes-1947083261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:30:49 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-da497a4c-243a-435f-872c-bb168894744c tempest-TestInstancesWithCinderVolumes-1947083261 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:30:49 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-da497a4c-243a-435f-872c-bb168894744c tempest-TestInstancesWithCinderVolumes-1947083261 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:30:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-da497a4c-243a-435f-872c-bb168894744c tempest-TestInstancesWithCinderVolumes-1947083261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-87f6be89-cf67-4921-82a6-92506ede6580 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:49 devstack sudo[102745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-87f6be89-cf67-4921-82a6-92506ede6580 1073741824 Sep 03 14:30:49 devstack sudo[102745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:49 devstack sudo[102743]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-89b58a57-0a70-408b-9e00-b151421669e8 tempest-VolumesSnapshotListTestJSON-265932066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-d9c20784-0d6b-4ca1-8340-55978c379148" returned: 0 in 0.623s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:49 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-89b58a57-0a70-408b-9e00-b151421669e8 tempest-VolumesSnapshotListTestJSON-265932066 None] Lock "cinder-quobyte-d9c20784-0d6b-4ca1-8340-55978c379148" released by "delete_volume" :: held 1.268s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:30:49 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0fbe1bb-cf3e-499a-abe4-02e421e06331 tempest-TestInstancesWithCinderVolumes-1947083261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:30:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c0fbe1bb-cf3e-499a-abe4-02e421e06331 tempest-TestInstancesWithCinderVolumes-1947083261 None] Flow 'volume_create_manager' (5c1bc51c-0afc-45b4-a128-194c29f46ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:30:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c0fbe1bb-cf3e-499a-abe4-02e421e06331 tempest-TestInstancesWithCinderVolumes-1947083261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (887736be-f00b-4fdd-bcad-2141e725e412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c0fbe1bb-cf3e-499a-abe4-02e421e06331 tempest-TestInstancesWithCinderVolumes-1947083261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (887736be-f00b-4fdd-bcad-2141e725e412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1216998460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b7648e3-cb7f-428c-9792-061d8e214562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa5fb2f914624fa584287fe9e8aa34ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:30:50Z,use_quota=True,user_id='c27b6a1c509c44d5ba0c2064397ed05c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a26f125-708b-4f16-91ad-b3db0a37e578),volume_type_id=1a26f125-708b-4f16-91ad-b3db0a37e578)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c0fbe1bb-cf3e-499a-abe4-02e421e06331 tempest-TestInstancesWithCinderVolumes-1947083261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bc5e900-7921-4e63-a8ca-5451e491e208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c0fbe1bb-cf3e-499a-abe4-02e421e06331 tempest-TestInstancesWithCinderVolumes-1947083261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bc5e900-7921-4e63-a8ca-5451e491e208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c0fbe1bb-cf3e-499a-abe4-02e421e06331 tempest-TestInstancesWithCinderVolumes-1947083261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c999abae-40cf-4e62-8ea9-677724d6216f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c0fbe1bb-cf3e-499a-abe4-02e421e06331 tempest-TestInstancesWithCinderVolumes-1947083261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c999abae-40cf-4e62-8ea9-677724d6216f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b7648e3-cb7f-428c-9792-061d8e214562', 'volume_name': 'volume-5b7648e3-cb7f-428c-9792-061d8e214562', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c0fbe1bb-cf3e-499a-abe4-02e421e06331 tempest-TestInstancesWithCinderVolumes-1947083261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0298ed13-ba50-406b-8a16-3b401fa6fb46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c0fbe1bb-cf3e-499a-abe4-02e421e06331 tempest-TestInstancesWithCinderVolumes-1947083261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0298ed13-ba50-406b-8a16-3b401fa6fb46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c0fbe1bb-cf3e-499a-abe4-02e421e06331 tempest-TestInstancesWithCinderVolumes-1947083261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4f6958a-d228-4f12-a064-0e87c964397c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:49 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-c0fbe1bb-cf3e-499a-abe4-02e421e06331 tempest-TestInstancesWithCinderVolumes-1947083261 None] Volume 5b7648e3-cb7f-428c-9792-061d8e214562: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b7648e3-cb7f-428c-9792-061d8e214562', 'volume_size': 1} Sep 03 14:30:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c0fbe1bb-cf3e-499a-abe4-02e421e06331 tempest-TestInstancesWithCinderVolumes-1947083261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:30:49 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-89b58a57-0a70-408b-9e00-b151421669e8 tempest-VolumesSnapshotListTestJSON-265932066 None] Created reservations ['c9612c48-e21b-46fe-992b-6a3251d64943', '29ff24e4-08ee-4a00-9e96-62b3f99d29d7', '8f821c84-970d-4c72-b3b5-1025478fefe3', '32d0cf42-bdd6-409a-9edf-3d93375d3176'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:30:50 devstack sudo[102745]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-da497a4c-243a-435f-872c-bb168894744c tempest-TestInstancesWithCinderVolumes-1947083261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-87f6be89-cf67-4921-82a6-92506ede6580 1073741824" returned: 0 in 0.789s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-89b58a57-0a70-408b-9e00-b151421669e8 tempest-VolumesSnapshotListTestJSON-265932066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:30:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-89b58a57-0a70-408b-9e00-b151421669e8 tempest-VolumesSnapshotListTestJSON-265932066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:30:50 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-89b58a57-0a70-408b-9e00-b151421669e8 tempest-VolumesSnapshotListTestJSON-265932066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:30:50 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-89b58a57-0a70-408b-9e00-b151421669e8 tempest-VolumesSnapshotListTestJSON-265932066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:30:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-89b58a57-0a70-408b-9e00-b151421669e8 tempest-VolumesSnapshotListTestJSON-265932066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:30:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-89b58a57-0a70-408b-9e00-b151421669e8 tempest-VolumesSnapshotListTestJSON-265932066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-da497a4c-243a-435f-872c-bb168894744c tempest-TestInstancesWithCinderVolumes-1947083261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-87f6be89-cf67-4921-82a6-92506ede6580 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:50 devstack sudo[102752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:30:50 devstack sudo[102752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:50 devstack sudo[102753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-87f6be89-cf67-4921-82a6-92506ede6580 Sep 03 14:30:50 devstack sudo[102753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:50 devstack sudo[102752]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-89b58a57-0a70-408b-9e00-b151421669e8 tempest-VolumesSnapshotListTestJSON-265932066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.440s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:50 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-89b58a57-0a70-408b-9e00-b151421669e8 tempest-VolumesSnapshotListTestJSON-265932066 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:30:50 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-89b58a57-0a70-408b-9e00-b151421669e8 tempest-VolumesSnapshotListTestJSON-265932066 None] Deleted volume successfully. Sep 03 14:30:50 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-89b58a57-0a70-408b-9e00-b151421669e8 tempest-VolumesSnapshotListTestJSON-265932066 None] Lock "cinder-d9c20784-0d6b-4ca1-8340-55978c379148-delete_volume" released by "delete_volume" :: held 2.167s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:30:50 devstack sudo[102753]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-da497a4c-243a-435f-872c-bb168894744c tempest-TestInstancesWithCinderVolumes-1947083261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-87f6be89-cf67-4921-82a6-92506ede6580" returned: 0 in 0.524s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:50 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-da497a4c-243a-435f-872c-bb168894744c tempest-TestInstancesWithCinderVolumes-1947083261 None] <== create_volume: return (1417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:30:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-da497a4c-243a-435f-872c-bb168894744c tempest-TestInstancesWithCinderVolumes-1947083261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:30:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c0fbe1bb-cf3e-499a-abe4-02e421e06331 tempest-TestInstancesWithCinderVolumes-1947083261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.730s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:30:50 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-c0fbe1bb-cf3e-499a-abe4-02e421e06331 tempest-TestInstancesWithCinderVolumes-1947083261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1216998460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b7648e3-cb7f-428c-9792-061d8e214562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa5fb2f914624fa584287fe9e8aa34ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:30:50Z,use_quota=True,user_id='c27b6a1c509c44d5ba0c2064397ed05c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a26f125-708b-4f16-91ad-b3db0a37e578),volume_type_id=1a26f125-708b-4f16-91ad-b3db0a37e578)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:30:50 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-c0fbe1bb-cf3e-499a-abe4-02e421e06331 tempest-TestInstancesWithCinderVolumes-1947083261 None] Creating volume 5b7648e3-cb7f-428c-9792-061d8e214562 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:30:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c0fbe1bb-cf3e-499a-abe4-02e421e06331 tempest-TestInstancesWithCinderVolumes-1947083261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:30:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c0fbe1bb-cf3e-499a-abe4-02e421e06331 tempest-TestInstancesWithCinderVolumes-1947083261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:30:50 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-c0fbe1bb-cf3e-499a-abe4-02e421e06331 tempest-TestInstancesWithCinderVolumes-1947083261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:30:50 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-c0fbe1bb-cf3e-499a-abe4-02e421e06331 tempest-TestInstancesWithCinderVolumes-1947083261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:30:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c0fbe1bb-cf3e-499a-abe4-02e421e06331 tempest-TestInstancesWithCinderVolumes-1947083261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:30:50 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-c0fbe1bb-cf3e-499a-abe4-02e421e06331 tempest-TestInstancesWithCinderVolumes-1947083261 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:30:50 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-c0fbe1bb-cf3e-499a-abe4-02e421e06331 tempest-TestInstancesWithCinderVolumes-1947083261 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:30:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c0fbe1bb-cf3e-499a-abe4-02e421e06331 tempest-TestInstancesWithCinderVolumes-1947083261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5b7648e3-cb7f-428c-9792-061d8e214562 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-da497a4c-243a-435f-872c-bb168894744c tempest-TestInstancesWithCinderVolumes-1947083261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bd64d17-8c16-438e-8d4e-4ce77e45ec7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87f6be89-cf67-4921-82a6-92506ede6580', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:50 devstack sudo[102758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5b7648e3-cb7f-428c-9792-061d8e214562 1073741824 Sep 03 14:30:50 devstack sudo[102758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-da497a4c-243a-435f-872c-bb168894744c tempest-TestInstancesWithCinderVolumes-1947083261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3f4ea0c-cd7e-466a-8482-e0dcd500e748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:50 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-da497a4c-243a-435f-872c-bb168894744c tempest-TestInstancesWithCinderVolumes-1947083261 None] Volume volume-87f6be89-cf67-4921-82a6-92506ede6580 (87f6be89-cf67-4921-82a6-92506ede6580): created successfully Sep 03 14:30:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-da497a4c-243a-435f-872c-bb168894744c tempest-TestInstancesWithCinderVolumes-1947083261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3f4ea0c-cd7e-466a-8482-e0dcd500e748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-da497a4c-243a-435f-872c-bb168894744c tempest-TestInstancesWithCinderVolumes-1947083261 None] Flow 'volume_create_manager' (c89ecac8-90c5-4ac7-9648-c503d13761a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:30:50 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-da497a4c-243a-435f-872c-bb168894744c tempest-TestInstancesWithCinderVolumes-1947083261 None] Created volume successfully. Sep 03 14:30:51 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c5cfd7a-af3d-4d93-8187-5e0c035c8c38 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:30:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8c5cfd7a-af3d-4d93-8187-5e0c035c8c38 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Flow 'volume_create_manager' (908e98ed-a309-4b4e-a16c-989a8052e34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:30:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8c5cfd7a-af3d-4d93-8187-5e0c035c8c38 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be8d89eb-6ca3-450a-ad87-385ef717ce9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8c5cfd7a-af3d-4d93-8187-5e0c035c8c38 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be8d89eb-6ca3-450a-ad87-385ef717ce9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1126461397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70b3ddff-7814-4c77-a021-c01e1cec16eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc3b96976b694d1db23c408f217e62dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:30:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:30:51Z,use_quota=True,user_id='89e2e707a22e43298c01057abf21f097',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8c5cfd7a-af3d-4d93-8187-5e0c035c8c38 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1979718b-8f96-4506-9e04-13d91db5c6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8c5cfd7a-af3d-4d93-8187-5e0c035c8c38 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1979718b-8f96-4506-9e04-13d91db5c6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8c5cfd7a-af3d-4d93-8187-5e0c035c8c38 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5607f9f8-99c4-4d67-ae5e-c6ffcb6d39e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8c5cfd7a-af3d-4d93-8187-5e0c035c8c38 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5607f9f8-99c4-4d67-ae5e-c6ffcb6d39e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70b3ddff-7814-4c77-a021-c01e1cec16eb', 'volume_name': 'volume-70b3ddff-7814-4c77-a021-c01e1cec16eb', 'volume_size': 2}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8c5cfd7a-af3d-4d93-8187-5e0c035c8c38 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06068c4a-0b8b-4380-890c-5b3f6735e1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8c5cfd7a-af3d-4d93-8187-5e0c035c8c38 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06068c4a-0b8b-4380-890c-5b3f6735e1ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8c5cfd7a-af3d-4d93-8187-5e0c035c8c38 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f5f23b5-29aa-4743-8d33-b6e3c56efd1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:51 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-8c5cfd7a-af3d-4d93-8187-5e0c035c8c38 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Volume 70b3ddff-7814-4c77-a021-c01e1cec16eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70b3ddff-7814-4c77-a021-c01e1cec16eb', 'volume_size': 2} Sep 03 14:30:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8c5cfd7a-af3d-4d93-8187-5e0c035c8c38 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:30:51 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:30:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Flow 'volume_create_manager' (c622dcaf-bdf7-42aa-af79-c6ad24718ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:30:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14d903b7-3ab8-4da1-b208-ae1f1c22e565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14d903b7-3ab8-4da1-b208-ae1f1c22e565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-554558901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4812ac4-d9e3-41fd-8a67-cc8e8cbf66c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa5fb2f914624fa584287fe9e8aa34ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:30:51Z,use_quota=True,user_id='c27b6a1c509c44d5ba0c2064397ed05c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8500acf6-881c-412e-8830-fb67e86683de),volume_type_id=8500acf6-881c-412e-8830-fb67e86683de)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5ff70b5-0b0f-405d-a338-0d1cbd868412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5ff70b5-0b0f-405d-a338-0d1cbd868412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d7bc99a-7878-4518-b694-f7475309252b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:51 devstack cinder-volume[87007]: DEBUG cinder.image.glance [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Creating Keystone auth plugin from conf {{(pid=87007) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 14:30:51 devstack sudo[102758]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c0fbe1bb-cf3e-499a-abe4-02e421e06331 tempest-TestInstancesWithCinderVolumes-1947083261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5b7648e3-cb7f-428c-9792-061d8e214562 1073741824" returned: 0 in 0.741s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c0fbe1bb-cf3e-499a-abe4-02e421e06331 tempest-TestInstancesWithCinderVolumes-1947083261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5b7648e3-cb7f-428c-9792-061d8e214562 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:51 devstack sudo[102765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5b7648e3-cb7f-428c-9792-061d8e214562 Sep 03 14:30:51 devstack sudo[102765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:51 devstack cinder-volume[87007]: DEBUG oslo_service.periodic_task [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87007) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 14:30:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:30:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:30:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:30:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:30:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:30:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:51 devstack sudo[102767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:30:51 devstack sudo[102767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:51 devstack sudo[102765]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c0fbe1bb-cf3e-499a-abe4-02e421e06331 tempest-TestInstancesWithCinderVolumes-1947083261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5b7648e3-cb7f-428c-9792-061d8e214562" returned: 0 in 0.493s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-c0fbe1bb-cf3e-499a-abe4-02e421e06331 tempest-TestInstancesWithCinderVolumes-1947083261 None] <== create_volume: return (1300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:30:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c0fbe1bb-cf3e-499a-abe4-02e421e06331 tempest-TestInstancesWithCinderVolumes-1947083261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:30:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8c5cfd7a-af3d-4d93-8187-5e0c035c8c38 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.659s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:30:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-8c5cfd7a-af3d-4d93-8187-5e0c035c8c38 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1126461397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70b3ddff-7814-4c77-a021-c01e1cec16eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc3b96976b694d1db23c408f217e62dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:30:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:30:51Z,use_quota=True,user_id='89e2e707a22e43298c01057abf21f097',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:30:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-8c5cfd7a-af3d-4d93-8187-5e0c035c8c38 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Creating volume 70b3ddff-7814-4c77-a021-c01e1cec16eb {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:30:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8c5cfd7a-af3d-4d93-8187-5e0c035c8c38 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:30:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8c5cfd7a-af3d-4d93-8187-5e0c035c8c38 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:30:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-8c5cfd7a-af3d-4d93-8187-5e0c035c8c38 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:30:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-8c5cfd7a-af3d-4d93-8187-5e0c035c8c38 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:30:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8c5cfd7a-af3d-4d93-8187-5e0c035c8c38 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:30:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-8c5cfd7a-af3d-4d93-8187-5e0c035c8c38 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:30:51 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-8c5cfd7a-af3d-4d93-8187-5e0c035c8c38 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:30:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8c5cfd7a-af3d-4d93-8187-5e0c035c8c38 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70b3ddff-7814-4c77-a021-c01e1cec16eb 2147483648 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:52 devstack sudo[102770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70b3ddff-7814-4c77-a021-c01e1cec16eb 2147483648 Sep 03 14:30:52 devstack sudo[102770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d7bc99a-7878-4518-b694-f7475309252b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b4812ac4-d9e3-41fd-8a67-cc8e8cbf66c6', 'volume_name': 'volume-b4812ac4-d9e3-41fd-8a67-cc8e8cbf66c6', 'volume_size': 1, 'image_id': '3688e8da-65e3-4a0b-913f-9542fe1b5e69', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3688e8da-65e3-4a0b-913f-9542fe1b5e69', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--139322126', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'aa5fb2f914624fa584287fe9e8aa34ed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3688e8da-65e3-4a0b-913f-9542fe1b5e69', 'created_at': datetime.datetime(2026, 9, 3, 12, 30, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 12, 30, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3688e8da-65e3-4a0b-913f-9542fe1b5e69/file', 'properties': {}}, 'image_service': }' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51883e93-119b-4422-90f3-58a455ee70b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51883e93-119b-4422-90f3-58a455ee70b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d3fe6c8-ed67-4119-983e-15580df56e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:52 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Volume b4812ac4-d9e3-41fd-8a67-cc8e8cbf66c6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b4812ac4-d9e3-41fd-8a67-cc8e8cbf66c6', 'volume_size': 1, 'image_id': '3688e8da-65e3-4a0b-913f-9542fe1b5e69', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3688e8da-65e3-4a0b-913f-9542fe1b5e69', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--139322126', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'aa5fb2f914624fa584287fe9e8aa34ed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3688e8da-65e3-4a0b-913f-9542fe1b5e69', 'created_at': datetime.datetime(2026, 9, 3, 12, 30, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 12, 30, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3688e8da-65e3-4a0b-913f-9542fe1b5e69/file', 'properties': {}}, 'image_service': } Sep 03 14:30:52 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Trying to clone b4812ac4-d9e3-41fd-8a67-cc8e8cbf66c6 from image 3688e8da-65e3-4a0b-913f-9542fe1b5e69 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3688e8da-65e3-4a0b-913f-9542fe1b5e69', 'metadata': {}}]). {{(pid=87007) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 14:30:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c0fbe1bb-cf3e-499a-abe4-02e421e06331 tempest-TestInstancesWithCinderVolumes-1947083261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4f6958a-d228-4f12-a064-0e87c964397c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b7648e3-cb7f-428c-9792-061d8e214562', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c0fbe1bb-cf3e-499a-abe4-02e421e06331 tempest-TestInstancesWithCinderVolumes-1947083261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bbd1bda-57f2-4086-9ee5-036ebc415446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:52 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-c0fbe1bb-cf3e-499a-abe4-02e421e06331 tempest-TestInstancesWithCinderVolumes-1947083261 None] Volume volume-5b7648e3-cb7f-428c-9792-061d8e214562 (5b7648e3-cb7f-428c-9792-061d8e214562): created successfully Sep 03 14:30:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c0fbe1bb-cf3e-499a-abe4-02e421e06331 tempest-TestInstancesWithCinderVolumes-1947083261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bbd1bda-57f2-4086-9ee5-036ebc415446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c0fbe1bb-cf3e-499a-abe4-02e421e06331 tempest-TestInstancesWithCinderVolumes-1947083261 None] Flow 'volume_create_manager' (5c1bc51c-0afc-45b4-a128-194c29f46ed4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:30:52 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-c0fbe1bb-cf3e-499a-abe4-02e421e06331 tempest-TestInstancesWithCinderVolumes-1947083261 None] Created volume successfully. Sep 03 14:30:52 devstack sudo[102767]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.648s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:52 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:30:52 devstack cinder-volume[87007]: DEBUG oslo_service.periodic_task [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running periodic task VolumeManager._thread_info {{(pid=87007) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 14:30:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] thread count: 28 {{(pid=87007) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 14:30:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] thread info: [<_MainThread(MainThread, started 123689171054720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87007) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 14:30:52 devstack sudo[102770]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8c5cfd7a-af3d-4d93-8187-5e0c035c8c38 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70b3ddff-7814-4c77-a021-c01e1cec16eb 2147483648" returned: 0 in 0.762s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8c5cfd7a-af3d-4d93-8187-5e0c035c8c38 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70b3ddff-7814-4c77-a021-c01e1cec16eb {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:52 devstack sudo[102778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70b3ddff-7814-4c77-a021-c01e1cec16eb Sep 03 14:30:52 devstack sudo[102778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:53 devstack sudo[102778]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8c5cfd7a-af3d-4d93-8187-5e0c035c8c38 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70b3ddff-7814-4c77-a021-c01e1cec16eb" returned: 0 in 0.405s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:53 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-8c5cfd7a-af3d-4d93-8187-5e0c035c8c38 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:30:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8c5cfd7a-af3d-4d93-8187-5e0c035c8c38 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:30:53 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8c5cfd7a-af3d-4d93-8187-5e0c035c8c38 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f5f23b5-29aa-4743-8d33-b6e3c56efd1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70b3ddff-7814-4c77-a021-c01e1cec16eb', 'volume_size': 2}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:53 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8c5cfd7a-af3d-4d93-8187-5e0c035c8c38 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e38a0f0e-e83c-4b86-bd1f-3675b6d60287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:30:53 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-8c5cfd7a-af3d-4d93-8187-5e0c035c8c38 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Volume volume-70b3ddff-7814-4c77-a021-c01e1cec16eb (70b3ddff-7814-4c77-a021-c01e1cec16eb): created successfully Sep 03 14:30:53 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8c5cfd7a-af3d-4d93-8187-5e0c035c8c38 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e38a0f0e-e83c-4b86-bd1f-3675b6d60287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:30:53 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8c5cfd7a-af3d-4d93-8187-5e0c035c8c38 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Flow 'volume_create_manager' (908e98ed-a309-4b4e-a16c-989a8052e34c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:30:53 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-8c5cfd7a-af3d-4d93-8187-5e0c035c8c38 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Created volume successfully. Sep 03 14:30:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-dd4df224-04f9-4878-8347-2c7033f9293b tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:30:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-dd4df224-04f9-4878-8347-2c7033f9293b tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:30:54 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-dd4df224-04f9-4878-8347-2c7033f9293b tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Creating offline snapshot a906b0c0-cdc2-4033-ac1b-553f0643255b of volume 70b3ddff-7814-4c77-a021-c01e1cec16eb {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:30:54 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee4add4-e951-40d2-b165-168451790cdf]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:30:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dd4df224-04f9-4878-8347-2c7033f9293b tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70b3ddff-7814-4c77-a021-c01e1cec16eb {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:54 devstack sudo[102781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70b3ddff-7814-4c77-a021-c01e1cec16eb Sep 03 14:30:54 devstack sudo[102781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:54 devstack sudo[102781]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dd4df224-04f9-4878-8347-2c7033f9293b tempest-VolumesSnapshotNegativeTestJSON-958576762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70b3ddff-7814-4c77-a021-c01e1cec16eb" returned: 0 in 0.464s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dd4df224-04f9-4878-8347-2c7033f9293b tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70b3ddff-7814-4c77-a021-c01e1cec16eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70b3ddff-7814-4c77-a021-c01e1cec16eb.a906b0c0-cdc2-4033-ac1b-553f0643255b 2G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:54 devstack sudo[102786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70b3ddff-7814-4c77-a021-c01e1cec16eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70b3ddff-7814-4c77-a021-c01e1cec16eb.a906b0c0-cdc2-4033-ac1b-553f0643255b 2G Sep 03 14:30:54 devstack sudo[102786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:55 devstack sudo[102786]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dd4df224-04f9-4878-8347-2c7033f9293b tempest-VolumesSnapshotNegativeTestJSON-958576762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70b3ddff-7814-4c77-a021-c01e1cec16eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70b3ddff-7814-4c77-a021-c01e1cec16eb.a906b0c0-cdc2-4033-ac1b-553f0643255b 2G" returned: 0 in 0.610s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dd4df224-04f9-4878-8347-2c7033f9293b tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70b3ddff-7814-4c77-a021-c01e1cec16eb -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70b3ddff-7814-4c77-a021-c01e1cec16eb.a906b0c0-cdc2-4033-ac1b-553f0643255b {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:55 devstack sudo[102802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70b3ddff-7814-4c77-a021-c01e1cec16eb -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70b3ddff-7814-4c77-a021-c01e1cec16eb.a906b0c0-cdc2-4033-ac1b-553f0643255b Sep 03 14:30:55 devstack sudo[102802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:55 devstack sudo[102802]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dd4df224-04f9-4878-8347-2c7033f9293b tempest-VolumesSnapshotNegativeTestJSON-958576762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70b3ddff-7814-4c77-a021-c01e1cec16eb -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70b3ddff-7814-4c77-a021-c01e1cec16eb.a906b0c0-cdc2-4033-ac1b-553f0643255b" returned: 0 in 0.376s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:55 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-dd4df224-04f9-4878-8347-2c7033f9293b tempest-VolumesSnapshotNegativeTestJSON-958576762 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70b3ddff-7814-4c77-a021-c01e1cec16eb.a906b0c0-cdc2-4033-ac1b-553f0643255b is being set with open permissions: ugo+rw Sep 03 14:30:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dd4df224-04f9-4878-8347-2c7033f9293b tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70b3ddff-7814-4c77-a021-c01e1cec16eb.a906b0c0-cdc2-4033-ac1b-553f0643255b {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:55 devstack sudo[102807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70b3ddff-7814-4c77-a021-c01e1cec16eb.a906b0c0-cdc2-4033-ac1b-553f0643255b Sep 03 14:30:55 devstack sudo[102807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:56 devstack sudo[102807]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dd4df224-04f9-4878-8347-2c7033f9293b tempest-VolumesSnapshotNegativeTestJSON-958576762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70b3ddff-7814-4c77-a021-c01e1cec16eb.a906b0c0-cdc2-4033-ac1b-553f0643255b" returned: 0 in 0.311s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dd4df224-04f9-4878-8347-2c7033f9293b tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70b3ddff-7814-4c77-a021-c01e1cec16eb.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:56 devstack sudo[102810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70b3ddff-7814-4c77-a021-c01e1cec16eb.info Sep 03 14:30:56 devstack sudo[102810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:56 devstack sudo[102810]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dd4df224-04f9-4878-8347-2c7033f9293b tempest-VolumesSnapshotNegativeTestJSON-958576762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70b3ddff-7814-4c77-a021-c01e1cec16eb.info" returned: 0 in 0.270s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:56 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-dd4df224-04f9-4878-8347-2c7033f9293b tempest-VolumesSnapshotNegativeTestJSON-958576762 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70b3ddff-7814-4c77-a021-c01e1cec16eb.info is being set with open permissions: ugo+rw Sep 03 14:30:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dd4df224-04f9-4878-8347-2c7033f9293b tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70b3ddff-7814-4c77-a021-c01e1cec16eb.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:56 devstack sudo[102814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70b3ddff-7814-4c77-a021-c01e1cec16eb.info Sep 03 14:30:56 devstack sudo[102814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:56 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3688e8da-65e3-4a0b-913f-9542fe1b5e69_96u6aj6kdevstack@QuobyteHD, size 20.69 MB, duration 4.58 sec {{(pid=87007) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 14:30:56 devstack cinder-volume[87007]: INFO cinder.image.image_utils [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Image download 20.69 MB at 4.52 MB/s Sep 03 14:30:56 devstack sudo[102814]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dd4df224-04f9-4878-8347-2c7033f9293b tempest-VolumesSnapshotNegativeTestJSON-958576762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70b3ddff-7814-4c77-a021-c01e1cec16eb.info" returned: 0 in 0.263s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-dd4df224-04f9-4878-8347-2c7033f9293b tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.416s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:30:56 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d544c619-bfae-4169-b133-95382e972831]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:30:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3688e8da-65e3-4a0b-913f-9542fe1b5e69_96u6aj6kdevstack@QuobyteHD {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:56 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-dd4df224-04f9-4878-8347-2c7033f9293b tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Create snapshot completed successfully Sep 03 14:30:56 devstack sudo[102817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3688e8da-65e3-4a0b-913f-9542fe1b5e69_96u6aj6kdevstack@QuobyteHD Sep 03 14:30:56 devstack sudo[102817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:57 devstack sudo[102817]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3688e8da-65e3-4a0b-913f-9542fe1b5e69_96u6aj6kdevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:57 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Temporary image 3688e8da-65e3-4a0b-913f-9542fe1b5e69 is fetched for user c27b6a1c509c44d5ba0c2064397ed05c. {{(pid=87007) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 14:30:57 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8867d43d-a66c-4ab8-a873-7f2ac7d54e97]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:30:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3688e8da-65e3-4a0b-913f-9542fe1b5e69_96u6aj6kdevstack@QuobyteHD {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:57 devstack sudo[102822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3688e8da-65e3-4a0b-913f-9542fe1b5e69_96u6aj6kdevstack@QuobyteHD Sep 03 14:30:57 devstack sudo[102822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:57 devstack sudo[102822]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3688e8da-65e3-4a0b-913f-9542fe1b5e69_96u6aj6kdevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:30:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:30:57 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-554558901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4812ac4-d9e3-41fd-8a67-cc8e8cbf66c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa5fb2f914624fa584287fe9e8aa34ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:30:51Z,use_quota=True,user_id='c27b6a1c509c44d5ba0c2064397ed05c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8500acf6-881c-412e-8830-fb67e86683de),volume_type_id=8500acf6-881c-412e-8830-fb67e86683de)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:30:57 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Creating volume b4812ac4-d9e3-41fd-8a67-cc8e8cbf66c6 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:30:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:30:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:30:57 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:30:57 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:30:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:30:57 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:30:57 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:30:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b4812ac4-d9e3-41fd-8a67-cc8e8cbf66c6 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:57 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8a6473da-ae5e-4165-9179-42f1c9bfb5fe tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Acquiring lock "cinder-a906b0c0-cdc2-4033-ac1b-553f0643255b-delete_snapshot" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:30:57 devstack sudo[102851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b4812ac4-d9e3-41fd-8a67-cc8e8cbf66c6 1073741824 Sep 03 14:30:57 devstack sudo[102851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:57 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8a6473da-ae5e-4165-9179-42f1c9bfb5fe tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Lock "cinder-a906b0c0-cdc2-4033-ac1b-553f0643255b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:30:57 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8a6473da-ae5e-4165-9179-42f1c9bfb5fe tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Acquiring lock "cinder-quobyte-70b3ddff-7814-4c77-a021-c01e1cec16eb" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:30:57 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8a6473da-ae5e-4165-9179-42f1c9bfb5fe tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Lock "cinder-quobyte-70b3ddff-7814-4c77-a021-c01e1cec16eb" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:30:57 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8a6473da-ae5e-4165-9179-42f1c9bfb5fe tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Acquiring lock "cinder-quobyte-a906b0c0-cdc2-4033-ac1b-553f0643255b" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:30:57 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8a6473da-ae5e-4165-9179-42f1c9bfb5fe tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Lock "cinder-quobyte-a906b0c0-cdc2-4033-ac1b-553f0643255b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:30:57 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-8a6473da-ae5e-4165-9179-42f1c9bfb5fe tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Deleting offline snapshot a906b0c0-cdc2-4033-ac1b-553f0643255b of volume 70b3ddff-7814-4c77-a021-c01e1cec16eb {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:30:57 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-8a6473da-ae5e-4165-9179-42f1c9bfb5fe tempest-VolumesSnapshotNegativeTestJSON-958576762 None] snapshot_file for this snap is: volume-70b3ddff-7814-4c77-a021-c01e1cec16eb.a906b0c0-cdc2-4033-ac1b-553f0643255b {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:30:57 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce83f440-8344-427b-9df3-aba29381f7c6]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:30:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8a6473da-ae5e-4165-9179-42f1c9bfb5fe tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70b3ddff-7814-4c77-a021-c01e1cec16eb.a906b0c0-cdc2-4033-ac1b-553f0643255b {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:57 devstack sudo[102853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70b3ddff-7814-4c77-a021-c01e1cec16eb.a906b0c0-cdc2-4033-ac1b-553f0643255b Sep 03 14:30:57 devstack sudo[102853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:58 devstack sudo[102851]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b4812ac4-d9e3-41fd-8a67-cc8e8cbf66c6 1073741824" returned: 0 in 0.491s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b4812ac4-d9e3-41fd-8a67-cc8e8cbf66c6 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:58 devstack sudo[102853]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8a6473da-ae5e-4165-9179-42f1c9bfb5fe tempest-VolumesSnapshotNegativeTestJSON-958576762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70b3ddff-7814-4c77-a021-c01e1cec16eb.a906b0c0-cdc2-4033-ac1b-553f0643255b" returned: 0 in 0.417s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:58 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-8a6473da-ae5e-4165-9179-42f1c9bfb5fe tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70b3ddff-7814-4c77-a021-c01e1cec16eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:30:58 devstack sudo[102862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b4812ac4-d9e3-41fd-8a67-cc8e8cbf66c6 Sep 03 14:30:58 devstack sudo[102862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:58 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[55988bd7-f1a4-465f-b047-87773f71c76c]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:30:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8a6473da-ae5e-4165-9179-42f1c9bfb5fe tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70b3ddff-7814-4c77-a021-c01e1cec16eb {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:58 devstack sudo[102864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70b3ddff-7814-4c77-a021-c01e1cec16eb Sep 03 14:30:58 devstack sudo[102864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:58 devstack sudo[102862]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b4812ac4-d9e3-41fd-8a67-cc8e8cbf66c6" returned: 0 in 0.297s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:58 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:30:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:30:58 devstack cinder-volume[87007]: DEBUG cinder.volume.volume_utils [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Attempting download of 3688e8da-65e3-4a0b-913f-9542fe1b5e69 ((None, [{'url': 'file:///opt/stack/data/glance/images/3688e8da-65e3-4a0b-913f-9542fe1b5e69', 'metadata': {}}])) to volume b4812ac4-d9e3-41fd-8a67-cc8e8cbf66c6. {{(pid=87007) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 14:30:58 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2aa4dd8-1774-4832-9681-3067072d5b0f]: (4, 'raw') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:30:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3688e8da-65e3-4a0b-913f-9542fe1b5e69_hpx2mc21 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:58 devstack sudo[102864]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8a6473da-ae5e-4165-9179-42f1c9bfb5fe tempest-VolumesSnapshotNegativeTestJSON-958576762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70b3ddff-7814-4c77-a021-c01e1cec16eb" returned: 0 in 0.451s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8a6473da-ae5e-4165-9179-42f1c9bfb5fe tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70b3ddff-7814-4c77-a021-c01e1cec16eb.a906b0c0-cdc2-4033-ac1b-553f0643255b {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:58 devstack sudo[102867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3688e8da-65e3-4a0b-913f-9542fe1b5e69_hpx2mc21 Sep 03 14:30:58 devstack sudo[102867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:58 devstack sudo[102873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70b3ddff-7814-4c77-a021-c01e1cec16eb.a906b0c0-cdc2-4033-ac1b-553f0643255b Sep 03 14:30:58 devstack sudo[102873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:58 devstack sudo[102867]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3688e8da-65e3-4a0b-913f-9542fe1b5e69_hpx2mc21" returned: 0 in 0.373s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3688e8da-65e3-4a0b-913f-9542fe1b5e69_hpx2mc21 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:58 devstack sudo[102873]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:58 devstack sudo[102880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3688e8da-65e3-4a0b-913f-9542fe1b5e69_hpx2mc21 Sep 03 14:30:58 devstack sudo[102880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8a6473da-ae5e-4165-9179-42f1c9bfb5fe tempest-VolumesSnapshotNegativeTestJSON-958576762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70b3ddff-7814-4c77-a021-c01e1cec16eb.a906b0c0-cdc2-4033-ac1b-553f0643255b" returned: 0 in 0.379s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8a6473da-ae5e-4165-9179-42f1c9bfb5fe tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70b3ddff-7814-4c77-a021-c01e1cec16eb.a906b0c0-cdc2-4033-ac1b-553f0643255b {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:58 devstack sudo[102883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70b3ddff-7814-4c77-a021-c01e1cec16eb.a906b0c0-cdc2-4033-ac1b-553f0643255b Sep 03 14:30:58 devstack sudo[102883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:59 devstack sudo[102880]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3688e8da-65e3-4a0b-913f-9542fe1b5e69_hpx2mc21" returned: 1 in 0.407s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3688e8da-65e3-4a0b-913f-9542fe1b5e69_hpx2mc21' failed. Not Retrying. {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 14:30:59 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0857e634-b1aa-4d62-8271-994bda1b0a77]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:30:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3688e8da-65e3-4a0b-913f-9542fe1b5e69_96u6aj6kdevstack@QuobyteHD {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:59 devstack sudo[102883]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8a6473da-ae5e-4165-9179-42f1c9bfb5fe tempest-VolumesSnapshotNegativeTestJSON-958576762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70b3ddff-7814-4c77-a021-c01e1cec16eb.a906b0c0-cdc2-4033-ac1b-553f0643255b" returned: 0 in 0.302s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:59 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8a6473da-ae5e-4165-9179-42f1c9bfb5fe tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Lock "cinder-quobyte-a906b0c0-cdc2-4033-ac1b-553f0643255b" released by "_delete_snapshot" :: held 1.698s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:30:59 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8a6473da-ae5e-4165-9179-42f1c9bfb5fe tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Lock "cinder-quobyte-70b3ddff-7814-4c77-a021-c01e1cec16eb" released by "delete_snapshot" :: held 1.724s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:30:59 devstack sudo[102888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3688e8da-65e3-4a0b-913f-9542fe1b5e69_96u6aj6kdevstack@QuobyteHD Sep 03 14:30:59 devstack sudo[102888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:59 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-8a6473da-ae5e-4165-9179-42f1c9bfb5fe tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Created reservations ['1681ea6c-1900-4cf0-a764-451045c2ff96', '0087604f-2772-4b7d-8205-d6fd744ca8db', 'd67a21e6-18d3-4cf3-8726-5d4decc8d8a5', '3d5a02a8-f5ee-4506-84e4-bd5e0bb5a3b4'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:30:59 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-8a6473da-ae5e-4165-9179-42f1c9bfb5fe tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Delete snapshot completed successfully. Sep 03 14:30:59 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8a6473da-ae5e-4165-9179-42f1c9bfb5fe tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Lock "cinder-a906b0c0-cdc2-4033-ac1b-553f0643255b-delete_snapshot" released by "delete_snapshot" :: held 1.986s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:30:59 devstack sudo[102888]: pam_unix(sudo:session): session closed for user root Sep 03 14:30:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3688e8da-65e3-4a0b-913f-9542fe1b5e69_96u6aj6kdevstack@QuobyteHD" returned: 0 in 0.515s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:30:59 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] 3688e8da-65e3-4a0b-913f-9542fe1b5e69 was qcow2, converting to qcow2 {{(pid=87007) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 14:30:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3688e8da-65e3-4a0b-913f-9542fe1b5e69_96u6aj6kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b4812ac4-d9e3-41fd-8a67-cc8e8cbf66c6 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:30:59 devstack sudo[102893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3688e8da-65e3-4a0b-913f-9542fe1b5e69_96u6aj6kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b4812ac4-d9e3-41fd-8a67-cc8e8cbf66c6 Sep 03 14:30:59 devstack sudo[102893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:30:59 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1d774177-f5d9-4663-a5b9-9340167b89d0 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Acquiring lock "cinder-70b3ddff-7814-4c77-a021-c01e1cec16eb-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:30:59 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1d774177-f5d9-4663-a5b9-9340167b89d0 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Lock "cinder-70b3ddff-7814-4c77-a021-c01e1cec16eb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:30:59 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1d774177-f5d9-4663-a5b9-9340167b89d0 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Acquiring lock "cinder-quobyte-70b3ddff-7814-4c77-a021-c01e1cec16eb" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:30:59 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1d774177-f5d9-4663-a5b9-9340167b89d0 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Lock "cinder-quobyte-70b3ddff-7814-4c77-a021-c01e1cec16eb" acquired by "delete_volume" :: waited 0.020s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:30:59 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8850d5-8d9e-4ab9-989a-bdeb1efa44c8]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:30:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1d774177-f5d9-4663-a5b9-9340167b89d0 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70b3ddff-7814-4c77-a021-c01e1cec16eb {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:31:00 devstack sudo[102895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70b3ddff-7814-4c77-a021-c01e1cec16eb Sep 03 14:31:00 devstack sudo[102895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:31:00 devstack sudo[102895]: pam_unix(sudo:session): session closed for user root Sep 03 14:31:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1d774177-f5d9-4663-a5b9-9340167b89d0 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70b3ddff-7814-4c77-a021-c01e1cec16eb" returned: 0 in 0.434s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:31:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1d774177-f5d9-4663-a5b9-9340167b89d0 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70b3ddff-7814-4c77-a021-c01e1cec16eb {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:31:00 devstack sudo[102905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70b3ddff-7814-4c77-a021-c01e1cec16eb Sep 03 14:31:00 devstack sudo[102905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:31:00 devstack sudo[102905]: pam_unix(sudo:session): session closed for user root Sep 03 14:31:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1d774177-f5d9-4663-a5b9-9340167b89d0 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-70b3ddff-7814-4c77-a021-c01e1cec16eb" returned: 0 in 0.304s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:31:00 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1d774177-f5d9-4663-a5b9-9340167b89d0 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Lock "cinder-quobyte-70b3ddff-7814-4c77-a021-c01e1cec16eb" released by "delete_volume" :: held 0.816s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:31:00 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-1d774177-f5d9-4663-a5b9-9340167b89d0 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Created reservations ['0ec0a718-268d-4899-9233-7300315ee005', '4fd8c68d-6a33-41a3-891c-caa8d48bde60', '536f65ab-da02-4a6b-b8f0-25d8a56458cc', '9a02cee9-66b0-4a0c-81e4-22c3de2630d3'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:31:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1d774177-f5d9-4663-a5b9-9340167b89d0 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:31:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1d774177-f5d9-4663-a5b9-9340167b89d0 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:31:00 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-1d774177-f5d9-4663-a5b9-9340167b89d0 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:31:00 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-1d774177-f5d9-4663-a5b9-9340167b89d0 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:31:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1d774177-f5d9-4663-a5b9-9340167b89d0 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:31:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1d774177-f5d9-4663-a5b9-9340167b89d0 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:31:00 devstack sudo[102908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:31:00 devstack sudo[102908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:31:01 devstack sudo[102908]: pam_unix(sudo:session): session closed for user root Sep 03 14:31:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1d774177-f5d9-4663-a5b9-9340167b89d0 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.365s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:31:01 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-1d774177-f5d9-4663-a5b9-9340167b89d0 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:31:01 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-1d774177-f5d9-4663-a5b9-9340167b89d0 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Deleted volume successfully. Sep 03 14:31:01 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1d774177-f5d9-4663-a5b9-9340167b89d0 tempest-VolumesSnapshotNegativeTestJSON-958576762 None] Lock "cinder-70b3ddff-7814-4c77-a021-c01e1cec16eb-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:31:01 devstack sudo[102893]: pam_unix(sudo:session): session closed for user root Sep 03 14:31:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3688e8da-65e3-4a0b-913f-9542fe1b5e69_96u6aj6kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b4812ac4-d9e3-41fd-8a67-cc8e8cbf66c6" returned: 0 in 2.194s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:31:01 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3688e8da-65e3-4a0b-913f-9542fe1b5e69_96u6aj6kdevstack@QuobyteHD, size 112.00 MB, duration 2.20 sec, destination /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b4812ac4-d9e3-41fd-8a67-cc8e8cbf66c6 {{(pid=87007) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 14:31:01 devstack cinder-volume[87007]: INFO cinder.image.image_utils [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Converted 112.00 MB image at 51.01 MB/s Sep 03 14:31:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b4812ac4-d9e3-41fd-8a67-cc8e8cbf66c6 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:31:01 devstack sudo[102911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b4812ac4-d9e3-41fd-8a67-cc8e8cbf66c6 1G Sep 03 14:31:01 devstack sudo[102911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:31:02 devstack sudo[102911]: pam_unix(sudo:session): session closed for user root Sep 03 14:31:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b4812ac4-d9e3-41fd-8a67-cc8e8cbf66c6 1G" returned: 0 in 0.374s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:31:02 devstack cinder-volume[87007]: DEBUG cinder.volume.volume_utils [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Downloaded image 3688e8da-65e3-4a0b-913f-9542fe1b5e69 ((None, [{'url': 'file:///opt/stack/data/glance/images/3688e8da-65e3-4a0b-913f-9542fe1b5e69', 'metadata': {}}])) to volume b4812ac4-d9e3-41fd-8a67-cc8e8cbf66c6 successfully. {{(pid=87007) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 14:31:02 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Temporary image 3688e8da-65e3-4a0b-913f-9542fe1b5e69 for user c27b6a1c509c44d5ba0c2064397ed05c is deleted. {{(pid=87007) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 14:31:02 devstack cinder-volume[87007]: DEBUG cinder.volume.volume_utils [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Marking volume b4812ac4-d9e3-41fd-8a67-cc8e8cbf66c6 as bootable. {{(pid=87007) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 14:31:02 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Copying metadata from image 3688e8da-65e3-4a0b-913f-9542fe1b5e69 to b4812ac4-d9e3-41fd-8a67-cc8e8cbf66c6. {{(pid=87007) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 14:31:02 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Creating volume glance metadata for volume b4812ac4-d9e3-41fd-8a67-cc8e8cbf66c6 backed by image 3688e8da-65e3-4a0b-913f-9542fe1b5e69 with: {'image_id': '3688e8da-65e3-4a0b-913f-9542fe1b5e69', 'image_name': 'tempest-scenario-img--139322126', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87007) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 14:31:02 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d3fe6c8-ed67-4119-983e-15580df56e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4812ac4-d9e3-41fd-8a67-cc8e8cbf66c6', 'volume_size': 1, 'image_id': '3688e8da-65e3-4a0b-913f-9542fe1b5e69', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3688e8da-65e3-4a0b-913f-9542fe1b5e69', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--139322126', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'aa5fb2f914624fa584287fe9e8aa34ed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3688e8da-65e3-4a0b-913f-9542fe1b5e69', 'created_at': datetime.datetime(2026, 9, 3, 12, 30, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 12, 30, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3688e8da-65e3-4a0b-913f-9542fe1b5e69/file', 'properties': {}}, 'image_service': }' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:31:02 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eee451e5-4cc3-4c63-a925-2a70435b7584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:31:02 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Volume volume-b4812ac4-d9e3-41fd-8a67-cc8e8cbf66c6 (b4812ac4-d9e3-41fd-8a67-cc8e8cbf66c6): created successfully Sep 03 14:31:02 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eee451e5-4cc3-4c63-a925-2a70435b7584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:31:02 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Flow 'volume_create_manager' (c622dcaf-bdf7-42aa-af79-c6ad24718ac5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:31:02 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-098ec010-43ec-47bb-839c-0307dacc9f3b tempest-TestInstancesWithCinderVolumes-1947083261 None] Created volume successfully. Sep 03 14:31:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-9163fdc1-acd7-40dd-aff5-ae2e1b696222 req-47f1f3dc-3cd3-420f-99bf-038bbc5e126b tempest-TestInstancesWithCinderVolumes-1947083261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:31:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-9163fdc1-acd7-40dd-aff5-ae2e1b696222 req-47f1f3dc-3cd3-420f-99bf-038bbc5e126b tempest-TestInstancesWithCinderVolumes-1947083261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:31:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-9163fdc1-acd7-40dd-aff5-ae2e1b696222 req-47f1f3dc-3cd3-420f-99bf-038bbc5e126b tempest-TestInstancesWithCinderVolumes-1947083261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:31:09 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-9163fdc1-acd7-40dd-aff5-ae2e1b696222 req-47f1f3dc-3cd3-420f-99bf-038bbc5e126b tempest-TestInstancesWithCinderVolumes-1947083261 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713', 'name': 'volume-b4812ac4-d9e3-41fd-8a67-cc8e8cbf66c6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f9075f07-5fcc-4054-8124-da30cac8cced', 'enforce_multipath': True} {{(pid=87007) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 14:31:09 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-9163fdc1-acd7-40dd-aff5-ae2e1b696222 req-47f1f3dc-3cd3-420f-99bf-038bbc5e126b tempest-TestInstancesWithCinderVolumes-1947083261 None] attachment_update completed successfully. Sep 03 14:31:22 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:UPDATE=104,cinder:DELETE=12,cinder:SELECT=101,cinder:INSERT=23 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:31:22 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:SELECT=52,cinder:INSERT=21,cinder:UPDATE=61,cinder:DELETE=4 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:31:27 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-a23fb996-7e85-4e17-b153-d037cfca1b6a tempest-TestImageHashVerification-1295909703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:31:27 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a23fb996-7e85-4e17-b153-d037cfca1b6a tempest-TestImageHashVerification-1295909703 None] Flow 'volume_create_manager' (505f70d1-783c-4a08-b216-4fd4dad67d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:31:27 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a23fb996-7e85-4e17-b153-d037cfca1b6a tempest-TestImageHashVerification-1295909703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (493d61c8-8154-4195-954c-a8c40ad6cb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:31:27 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a23fb996-7e85-4e17-b153-d037cfca1b6a tempest-TestImageHashVerification-1295909703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (493d61c8-8154-4195-954c-a8c40ad6cb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1053496151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae160bc0-3df8-44ae-8de3-a0ab78cd549e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e51866e47c94b289c611f9466241401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:31:27Z,use_quota=True,user_id='a8f915a404344e44ace93106a9eaef39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:31:27 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a23fb996-7e85-4e17-b153-d037cfca1b6a tempest-TestImageHashVerification-1295909703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c767f791-84bb-44a6-bc93-0ee26d85d36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:31:27 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a23fb996-7e85-4e17-b153-d037cfca1b6a tempest-TestImageHashVerification-1295909703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c767f791-84bb-44a6-bc93-0ee26d85d36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:31:27 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a23fb996-7e85-4e17-b153-d037cfca1b6a tempest-TestImageHashVerification-1295909703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f785b145-8402-4a46-9e9d-c504cb227461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:31:27 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a23fb996-7e85-4e17-b153-d037cfca1b6a tempest-TestImageHashVerification-1295909703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f785b145-8402-4a46-9e9d-c504cb227461) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae160bc0-3df8-44ae-8de3-a0ab78cd549e', 'volume_name': 'volume-ae160bc0-3df8-44ae-8de3-a0ab78cd549e', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:31:27 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a23fb996-7e85-4e17-b153-d037cfca1b6a tempest-TestImageHashVerification-1295909703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (829b0465-7422-484a-af14-7a9bb0e12a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:31:27 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a23fb996-7e85-4e17-b153-d037cfca1b6a tempest-TestImageHashVerification-1295909703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (829b0465-7422-484a-af14-7a9bb0e12a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:31:27 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a23fb996-7e85-4e17-b153-d037cfca1b6a tempest-TestImageHashVerification-1295909703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4b9a13f-7c61-48d2-8000-528460dc51e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:31:27 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-a23fb996-7e85-4e17-b153-d037cfca1b6a tempest-TestImageHashVerification-1295909703 None] Volume ae160bc0-3df8-44ae-8de3-a0ab78cd549e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae160bc0-3df8-44ae-8de3-a0ab78cd549e', 'volume_size': 1} Sep 03 14:31:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a23fb996-7e85-4e17-b153-d037cfca1b6a tempest-TestImageHashVerification-1295909703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:31:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a23fb996-7e85-4e17-b153-d037cfca1b6a tempest-TestImageHashVerification-1295909703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:31:27 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a23fb996-7e85-4e17-b153-d037cfca1b6a tempest-TestImageHashVerification-1295909703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1053496151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae160bc0-3df8-44ae-8de3-a0ab78cd549e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e51866e47c94b289c611f9466241401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:31:27Z,use_quota=True,user_id='a8f915a404344e44ace93106a9eaef39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:31:27 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-a23fb996-7e85-4e17-b153-d037cfca1b6a tempest-TestImageHashVerification-1295909703 None] Creating volume ae160bc0-3df8-44ae-8de3-a0ab78cd549e {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:31:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a23fb996-7e85-4e17-b153-d037cfca1b6a tempest-TestImageHashVerification-1295909703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:31:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a23fb996-7e85-4e17-b153-d037cfca1b6a tempest-TestImageHashVerification-1295909703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:31:27 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a23fb996-7e85-4e17-b153-d037cfca1b6a tempest-TestImageHashVerification-1295909703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:31:27 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a23fb996-7e85-4e17-b153-d037cfca1b6a tempest-TestImageHashVerification-1295909703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:31:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a23fb996-7e85-4e17-b153-d037cfca1b6a tempest-TestImageHashVerification-1295909703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:31:27 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a23fb996-7e85-4e17-b153-d037cfca1b6a tempest-TestImageHashVerification-1295909703 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:31:27 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-a23fb996-7e85-4e17-b153-d037cfca1b6a tempest-TestImageHashVerification-1295909703 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:31:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a23fb996-7e85-4e17-b153-d037cfca1b6a tempest-TestImageHashVerification-1295909703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ae160bc0-3df8-44ae-8de3-a0ab78cd549e 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:31:27 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-390bba45-fe29-4867-9449-6d57e522e7a0 req-8b146fab-430a-4ec0-8d73-d9534c233719 tempest-TestShelveInstance-1205513418 None] Terminate volume connection completed successfully. Sep 03 14:31:27 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-390bba45-fe29-4867-9449-6d57e522e7a0 req-8b146fab-430a-4ec0-8d73-d9534c233719 tempest-TestShelveInstance-1205513418 None] Deleting attachment 14883db1-3088-443e-a7ae-4bf3cdd86981. {{(pid=87007) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 14:31:27 devstack sudo[103449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ae160bc0-3df8-44ae-8de3-a0ab78cd549e 1073741824 Sep 03 14:31:27 devstack sudo[103449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:31:27 devstack cinder-volume[87007]: DEBUG cinder.coordination [req-390bba45-fe29-4867-9449-6d57e522e7a0 req-900fda21-6a27-4a05-82ba-47e027efa828 tempest-TestShelveInstance-1205513418 None] Acquiring lock "cinder-b4dd7dd9-9573-478f-924d-a6a911b72ce9-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:31:27 devstack cinder-volume[87007]: DEBUG cinder.coordination [req-390bba45-fe29-4867-9449-6d57e522e7a0 req-900fda21-6a27-4a05-82ba-47e027efa828 tempest-TestShelveInstance-1205513418 None] Lock "cinder-b4dd7dd9-9573-478f-924d-a6a911b72ce9-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:31:28 devstack cinder-volume[87007]: DEBUG cinder.coordination [req-390bba45-fe29-4867-9449-6d57e522e7a0 req-900fda21-6a27-4a05-82ba-47e027efa828 tempest-TestShelveInstance-1205513418 None] Acquiring lock "cinder-quobyte-b4dd7dd9-9573-478f-924d-a6a911b72ce9" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:31:28 devstack cinder-volume[87007]: DEBUG cinder.coordination [req-390bba45-fe29-4867-9449-6d57e522e7a0 req-900fda21-6a27-4a05-82ba-47e027efa828 tempest-TestShelveInstance-1205513418 None] Lock "cinder-quobyte-b4dd7dd9-9573-478f-924d-a6a911b72ce9" acquired by "delete_volume" :: waited 0.054s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:31:28 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a66b72-44ec-4f72-b79c-a5911bb5595f]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:31:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-390bba45-fe29-4867-9449-6d57e522e7a0 req-900fda21-6a27-4a05-82ba-47e027efa828 tempest-TestShelveInstance-1205513418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b4dd7dd9-9573-478f-924d-a6a911b72ce9 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:31:28 devstack sudo[103459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b4dd7dd9-9573-478f-924d-a6a911b72ce9 Sep 03 14:31:28 devstack sudo[103459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:31:28 devstack sudo[103449]: pam_unix(sudo:session): session closed for user root Sep 03 14:31:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a23fb996-7e85-4e17-b153-d037cfca1b6a tempest-TestImageHashVerification-1295909703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ae160bc0-3df8-44ae-8de3-a0ab78cd549e 1073741824" returned: 0 in 1.062s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:31:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a23fb996-7e85-4e17-b153-d037cfca1b6a tempest-TestImageHashVerification-1295909703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ae160bc0-3df8-44ae-8de3-a0ab78cd549e {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:31:28 devstack sudo[103462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ae160bc0-3df8-44ae-8de3-a0ab78cd549e Sep 03 14:31:28 devstack sudo[103462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:31:28 devstack sudo[103462]: pam_unix(sudo:session): session closed for user root Sep 03 14:31:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a23fb996-7e85-4e17-b153-d037cfca1b6a tempest-TestImageHashVerification-1295909703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ae160bc0-3df8-44ae-8de3-a0ab78cd549e" returned: 0 in 0.416s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:31:28 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a23fb996-7e85-4e17-b153-d037cfca1b6a tempest-TestImageHashVerification-1295909703 None] <== create_volume: return (1573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:31:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a23fb996-7e85-4e17-b153-d037cfca1b6a tempest-TestImageHashVerification-1295909703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.582s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:31:28 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a23fb996-7e85-4e17-b153-d037cfca1b6a tempest-TestImageHashVerification-1295909703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4b9a13f-7c61-48d2-8000-528460dc51e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae160bc0-3df8-44ae-8de3-a0ab78cd549e', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:31:29 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a23fb996-7e85-4e17-b153-d037cfca1b6a tempest-TestImageHashVerification-1295909703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffe24dbc-95c2-458e-ad2d-8e107c2ded61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:31:29 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-a23fb996-7e85-4e17-b153-d037cfca1b6a tempest-TestImageHashVerification-1295909703 None] Volume volume-ae160bc0-3df8-44ae-8de3-a0ab78cd549e (ae160bc0-3df8-44ae-8de3-a0ab78cd549e): created successfully Sep 03 14:31:29 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a23fb996-7e85-4e17-b153-d037cfca1b6a tempest-TestImageHashVerification-1295909703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffe24dbc-95c2-458e-ad2d-8e107c2ded61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:31:29 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a23fb996-7e85-4e17-b153-d037cfca1b6a tempest-TestImageHashVerification-1295909703 None] Flow 'volume_create_manager' (505f70d1-783c-4a08-b216-4fd4dad67d81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:31:29 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-a23fb996-7e85-4e17-b153-d037cfca1b6a tempest-TestImageHashVerification-1295909703 None] Created volume successfully. Sep 03 14:31:29 devstack sudo[103459]: pam_unix(sudo:session): session closed for user root Sep 03 14:31:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-390bba45-fe29-4867-9449-6d57e522e7a0 req-900fda21-6a27-4a05-82ba-47e027efa828 tempest-TestShelveInstance-1205513418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b4dd7dd9-9573-478f-924d-a6a911b72ce9" returned: 0 in 0.951s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:31:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-390bba45-fe29-4867-9449-6d57e522e7a0 req-900fda21-6a27-4a05-82ba-47e027efa828 tempest-TestShelveInstance-1205513418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b4dd7dd9-9573-478f-924d-a6a911b72ce9 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:31:29 devstack sudo[103470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b4dd7dd9-9573-478f-924d-a6a911b72ce9 Sep 03 14:31:29 devstack sudo[103470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:31:29 devstack sudo[103470]: pam_unix(sudo:session): session closed for user root Sep 03 14:31:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-390bba45-fe29-4867-9449-6d57e522e7a0 req-900fda21-6a27-4a05-82ba-47e027efa828 tempest-TestShelveInstance-1205513418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b4dd7dd9-9573-478f-924d-a6a911b72ce9" returned: 0 in 0.488s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:31:29 devstack cinder-volume[87007]: DEBUG cinder.coordination [req-390bba45-fe29-4867-9449-6d57e522e7a0 req-900fda21-6a27-4a05-82ba-47e027efa828 tempest-TestShelveInstance-1205513418 None] Lock "cinder-quobyte-b4dd7dd9-9573-478f-924d-a6a911b72ce9" released by "delete_volume" :: held 1.533s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:31:29 devstack cinder-volume[87007]: DEBUG cinder.quota [req-390bba45-fe29-4867-9449-6d57e522e7a0 req-900fda21-6a27-4a05-82ba-47e027efa828 tempest-TestShelveInstance-1205513418 None] Created reservations ['137ce371-fa3b-4efa-b751-9c7983cf02f5', 'd816b7c0-c0ef-46ed-a3c5-a8314ec4f77d', '484489ef-2e21-4f4b-b86a-fa72647a7e7c', '7b91488f-1946-4312-b64e-6840b65519ca'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:31:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-390bba45-fe29-4867-9449-6d57e522e7a0 req-900fda21-6a27-4a05-82ba-47e027efa828 tempest-TestShelveInstance-1205513418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:31:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-390bba45-fe29-4867-9449-6d57e522e7a0 req-900fda21-6a27-4a05-82ba-47e027efa828 tempest-TestShelveInstance-1205513418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:31:29 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [req-390bba45-fe29-4867-9449-6d57e522e7a0 req-900fda21-6a27-4a05-82ba-47e027efa828 tempest-TestShelveInstance-1205513418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:31:29 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [req-390bba45-fe29-4867-9449-6d57e522e7a0 req-900fda21-6a27-4a05-82ba-47e027efa828 tempest-TestShelveInstance-1205513418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:31:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-390bba45-fe29-4867-9449-6d57e522e7a0 req-900fda21-6a27-4a05-82ba-47e027efa828 tempest-TestShelveInstance-1205513418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:31:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-390bba45-fe29-4867-9449-6d57e522e7a0 req-900fda21-6a27-4a05-82ba-47e027efa828 tempest-TestShelveInstance-1205513418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:31:29 devstack sudo[103473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:31:29 devstack sudo[103473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:31:30 devstack sudo[103473]: pam_unix(sudo:session): session closed for user root Sep 03 14:31:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [req-390bba45-fe29-4867-9449-6d57e522e7a0 req-900fda21-6a27-4a05-82ba-47e027efa828 tempest-TestShelveInstance-1205513418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.373s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:31:30 devstack cinder-volume[87007]: DEBUG cinder.manager [req-390bba45-fe29-4867-9449-6d57e522e7a0 req-900fda21-6a27-4a05-82ba-47e027efa828 tempest-TestShelveInstance-1205513418 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:31:30 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-390bba45-fe29-4867-9449-6d57e522e7a0 req-900fda21-6a27-4a05-82ba-47e027efa828 tempest-TestShelveInstance-1205513418 None] Deleted volume successfully. Sep 03 14:31:30 devstack cinder-volume[87007]: DEBUG cinder.coordination [req-390bba45-fe29-4867-9449-6d57e522e7a0 req-900fda21-6a27-4a05-82ba-47e027efa828 tempest-TestShelveInstance-1205513418 None] Lock "cinder-b4dd7dd9-9573-478f-924d-a6a911b72ce9-delete_volume" released by "delete_volume" :: held 2.403s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:31:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4b456883-6484-41c3-97ee-5bb5dcbeb34a tempest-TestImageHashVerification-1295909703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:31:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4b456883-6484-41c3-97ee-5bb5dcbeb34a tempest-TestImageHashVerification-1295909703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:31:31 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c92e3f-5369-4956-ab5c-a8fec35ef6e5]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:31:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4b456883-6484-41c3-97ee-5bb5dcbeb34a tempest-TestImageHashVerification-1295909703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ae160bc0-3df8-44ae-8de3-a0ab78cd549e {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:31:31 devstack sudo[103476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ae160bc0-3df8-44ae-8de3-a0ab78cd549e Sep 03 14:31:31 devstack sudo[103476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:31:31 devstack sudo[103476]: pam_unix(sudo:session): session closed for user root Sep 03 14:31:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4b456883-6484-41c3-97ee-5bb5dcbeb34a tempest-TestImageHashVerification-1295909703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ae160bc0-3df8-44ae-8de3-a0ab78cd549e" returned: 0 in 0.448s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:31:31 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[60cfcdea-b8dc-42fa-8675-32558e98abdf]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:31:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4b456883-6484-41c3-97ee-5bb5dcbeb34a tempest-TestImageHashVerification-1295909703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ae160bc0-3df8-44ae-8de3-a0ab78cd549e {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:31:31 devstack sudo[103482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ae160bc0-3df8-44ae-8de3-a0ab78cd549e Sep 03 14:31:31 devstack sudo[103482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:31:32 devstack sudo[103482]: pam_unix(sudo:session): session closed for user root Sep 03 14:31:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4b456883-6484-41c3-97ee-5bb5dcbeb34a tempest-TestImageHashVerification-1295909703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ae160bc0-3df8-44ae-8de3-a0ab78cd549e" returned: 0 in 0.535s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:31:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4b456883-6484-41c3-97ee-5bb5dcbeb34a tempest-TestImageHashVerification-1295909703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ae160bc0-3df8-44ae-8de3-a0ab78cd549e /opt/stack/data/cinder/conversion/ae160bc0-3df8-44ae-8de3-a0ab78cd549e.temp_image.b3b63d8b-26fb-4ffd-8092-7197a766fb7fsd731r6u.img {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:31:32 devstack sudo[103487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ae160bc0-3df8-44ae-8de3-a0ab78cd549e /opt/stack/data/cinder/conversion/ae160bc0-3df8-44ae-8de3-a0ab78cd549e.temp_image.b3b63d8b-26fb-4ffd-8092-7197a766fb7fsd731r6u.img Sep 03 14:31:32 devstack sudo[103487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:31:39 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:SELECT=11,cinder:UPDATE=10,cinder:INSERT=4 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:31:39 devstack sudo[103487]: pam_unix(sudo:session): session closed for user root Sep 03 14:31:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4b456883-6484-41c3-97ee-5bb5dcbeb34a tempest-TestImageHashVerification-1295909703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ae160bc0-3df8-44ae-8de3-a0ab78cd549e /opt/stack/data/cinder/conversion/ae160bc0-3df8-44ae-8de3-a0ab78cd549e.temp_image.b3b63d8b-26fb-4ffd-8092-7197a766fb7fsd731r6u.img" returned: 0 in 7.678s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:31:39 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[50dd13fd-d747-419a-abcc-c8ebf944fffb]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:31:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4b456883-6484-41c3-97ee-5bb5dcbeb34a tempest-TestImageHashVerification-1295909703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ae160bc0-3df8-44ae-8de3-a0ab78cd549e {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:31:39 devstack sudo[103503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ae160bc0-3df8-44ae-8de3-a0ab78cd549e Sep 03 14:31:39 devstack sudo[103503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:31:41 devstack sudo[103503]: pam_unix(sudo:session): session closed for user root Sep 03 14:31:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4b456883-6484-41c3-97ee-5bb5dcbeb34a tempest-TestImageHashVerification-1295909703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ae160bc0-3df8-44ae-8de3-a0ab78cd549e" returned: 0 in 1.231s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:31:41 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:SELECT=6,cinder:UPDATE=12,cinder:INSERT=1,cinder:DELETE=2 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:31:41 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-4b456883-6484-41c3-97ee-5bb5dcbeb34a tempest-TestImageHashVerification-1295909703 None] Image conversion details: src /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ae160bc0-3df8-44ae-8de3-a0ab78cd549e, size 1024.00 MB, duration 7.68 sec, destination /opt/stack/data/cinder/conversion/ae160bc0-3df8-44ae-8de3-a0ab78cd549e.temp_image.b3b63d8b-26fb-4ffd-8092-7197a766fb7fsd731r6u.img {{(pid=87007) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 14:31:41 devstack cinder-volume[87007]: INFO cinder.image.image_utils [None req-4b456883-6484-41c3-97ee-5bb5dcbeb34a tempest-TestImageHashVerification-1295909703 None] Converted 1024.00 MB image at 133.35 MB/s Sep 03 14:31:41 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-4b456883-6484-41c3-97ee-5bb5dcbeb34a tempest-TestImageHashVerification-1295909703 None] b3b63d8b-26fb-4ffd-8092-7197a766fb7f was raw, no need to convert to raw {{(pid=87007) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 03 14:31:51 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:SELECT=2 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:31:51 devstack cinder-volume[87007]: DEBUG oslo_service.periodic_task [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87007) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 14:31:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:31:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:31:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:31:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:31:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:31:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:31:51 devstack sudo[103584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:31:51 devstack sudo[103584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:31:51 devstack sudo[103584]: pam_unix(sudo:session): session closed for user root Sep 03 14:31:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.342s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:31:51 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:31:51 devstack cinder-volume[87007]: DEBUG oslo_service.periodic_task [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running periodic task VolumeManager._thread_info {{(pid=87007) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 14:31:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] thread count: 28 {{(pid=87007) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 14:31:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] thread info: [<_MainThread(MainThread, started 123689171054720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87007) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 14:31:57 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffe52ec0-3ed0-46b6-b1aa-e9d308917dc9 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:31:57 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffe52ec0-3ed0-46b6-b1aa-e9d308917dc9 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Flow 'volume_create_manager' (8cab06b1-dd77-498c-b503-a49495c8555e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:31:57 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffe52ec0-3ed0-46b6-b1aa-e9d308917dc9 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (908b9c90-206c-4808-9b6e-f78fcafb16ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:31:57 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffe52ec0-3ed0-46b6-b1aa-e9d308917dc9 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (908b9c90-206c-4808-9b6e-f78fcafb16ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:31:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1300816458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1941ee8f-d8f7-4bcd-8bf6-8c310d83b3ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b04fd5d45c64135a4aca7a808cfea6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:31:57Z,use_quota=True,user_id='43702c4722e54bf2a674fb5fd1794598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:31:57 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffe52ec0-3ed0-46b6-b1aa-e9d308917dc9 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60693605-562e-481a-ada3-21bf6aa1fe3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:31:57 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffe52ec0-3ed0-46b6-b1aa-e9d308917dc9 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60693605-562e-481a-ada3-21bf6aa1fe3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:31:57 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffe52ec0-3ed0-46b6-b1aa-e9d308917dc9 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4db1ef25-9d4d-48c1-aa25-3e1a51a7b772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:31:57 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffe52ec0-3ed0-46b6-b1aa-e9d308917dc9 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4db1ef25-9d4d-48c1-aa25-3e1a51a7b772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1941ee8f-d8f7-4bcd-8bf6-8c310d83b3ab', 'volume_name': 'volume-1941ee8f-d8f7-4bcd-8bf6-8c310d83b3ab', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:31:57 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffe52ec0-3ed0-46b6-b1aa-e9d308917dc9 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a90e7358-b6cf-493c-acff-4f0673f1d926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:31:57 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffe52ec0-3ed0-46b6-b1aa-e9d308917dc9 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a90e7358-b6cf-493c-acff-4f0673f1d926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:31:57 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffe52ec0-3ed0-46b6-b1aa-e9d308917dc9 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c85654-f94d-4326-805c-f68bb973b45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:31:57 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-ffe52ec0-3ed0-46b6-b1aa-e9d308917dc9 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Volume 1941ee8f-d8f7-4bcd-8bf6-8c310d83b3ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1941ee8f-d8f7-4bcd-8bf6-8c310d83b3ab', 'volume_size': 1} Sep 03 14:31:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffe52ec0-3ed0-46b6-b1aa-e9d308917dc9 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:31:57 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3f9ece8-bb1b-4b57-a7f3-02c434e7b353 tempest-TestMinimumBasicScenario-923270773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:31:57 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a3f9ece8-bb1b-4b57-a7f3-02c434e7b353 tempest-TestMinimumBasicScenario-923270773 None] Flow 'volume_create_manager' (eb68eed9-f49e-4557-9ff7-0026fb8e427a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:31:57 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a3f9ece8-bb1b-4b57-a7f3-02c434e7b353 tempest-TestMinimumBasicScenario-923270773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (183e7dd8-2cc9-475a-aced-a8f5271de2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:31:57 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a3f9ece8-bb1b-4b57-a7f3-02c434e7b353 tempest-TestMinimumBasicScenario-923270773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (183e7dd8-2cc9-475a-aced-a8f5271de2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:31:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-159384586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=badc2d73-24b3-4617-b3bd-7413b9e379c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ea1c5dbea5842509dd856a3bb1de077',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:31:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:31:58Z,use_quota=True,user_id='f1e21f304e1e4ab89f4da25cb93183e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:31:57 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a3f9ece8-bb1b-4b57-a7f3-02c434e7b353 tempest-TestMinimumBasicScenario-923270773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49c3515b-db5f-48d3-b67a-4150e4a55b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:31:57 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a3f9ece8-bb1b-4b57-a7f3-02c434e7b353 tempest-TestMinimumBasicScenario-923270773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49c3515b-db5f-48d3-b67a-4150e4a55b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:31:57 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a3f9ece8-bb1b-4b57-a7f3-02c434e7b353 tempest-TestMinimumBasicScenario-923270773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6fdc20a-f270-49b0-be2b-5b5d77e0d2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:31:57 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a3f9ece8-bb1b-4b57-a7f3-02c434e7b353 tempest-TestMinimumBasicScenario-923270773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6fdc20a-f270-49b0-be2b-5b5d77e0d2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'badc2d73-24b3-4617-b3bd-7413b9e379c5', 'volume_name': 'volume-badc2d73-24b3-4617-b3bd-7413b9e379c5', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:31:57 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a3f9ece8-bb1b-4b57-a7f3-02c434e7b353 tempest-TestMinimumBasicScenario-923270773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fa5a55f-5f4d-4bb5-a881-5b0aa0722c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:31:57 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a3f9ece8-bb1b-4b57-a7f3-02c434e7b353 tempest-TestMinimumBasicScenario-923270773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fa5a55f-5f4d-4bb5-a881-5b0aa0722c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:31:57 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a3f9ece8-bb1b-4b57-a7f3-02c434e7b353 tempest-TestMinimumBasicScenario-923270773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (484d571e-4036-43c0-adfa-53341ccbfb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:31:57 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-a3f9ece8-bb1b-4b57-a7f3-02c434e7b353 tempest-TestMinimumBasicScenario-923270773 None] Volume badc2d73-24b3-4617-b3bd-7413b9e379c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-badc2d73-24b3-4617-b3bd-7413b9e379c5', 'volume_size': 1} Sep 03 14:31:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a3f9ece8-bb1b-4b57-a7f3-02c434e7b353 tempest-TestMinimumBasicScenario-923270773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:32:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-147c7f2c-38fe-4938-9e96-2df47577a443 req-302fef71-fb13-4c2c-b476-0bf824b6bf8f tempest-TestInstancesWithCinderVolumes-1947083261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:32:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4b456883-6484-41c3-97ee-5bb5dcbeb34a tempest-TestImageHashVerification-1295909703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 38.420s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:32:09 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4b456883-6484-41c3-97ee-5bb5dcbeb34a tempest-TestImageHashVerification-1295909703 None] Uploaded volume to glance image-id: b3b63d8b-26fb-4ffd-8092-7197a766fb7f. {{(pid=87007) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 03 14:32:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffe52ec0-3ed0-46b6-b1aa-e9d308917dc9 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.220s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:32:09 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ffe52ec0-3ed0-46b6-b1aa-e9d308917dc9 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:31:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1300816458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1941ee8f-d8f7-4bcd-8bf6-8c310d83b3ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b04fd5d45c64135a4aca7a808cfea6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:31:57Z,use_quota=True,user_id='43702c4722e54bf2a674fb5fd1794598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:32:09 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-ffe52ec0-3ed0-46b6-b1aa-e9d308917dc9 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Creating volume 1941ee8f-d8f7-4bcd-8bf6-8c310d83b3ab {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:32:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffe52ec0-3ed0-46b6-b1aa-e9d308917dc9 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:32:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffe52ec0-3ed0-46b6-b1aa-e9d308917dc9 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:32:09 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ffe52ec0-3ed0-46b6-b1aa-e9d308917dc9 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:32:09 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ffe52ec0-3ed0-46b6-b1aa-e9d308917dc9 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:32:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffe52ec0-3ed0-46b6-b1aa-e9d308917dc9 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:32:09 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ffe52ec0-3ed0-46b6-b1aa-e9d308917dc9 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:32:09 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-ffe52ec0-3ed0-46b6-b1aa-e9d308917dc9 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:32:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffe52ec0-3ed0-46b6-b1aa-e9d308917dc9 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1941ee8f-d8f7-4bcd-8bf6-8c310d83b3ab 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:09 devstack sudo[103736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1941ee8f-d8f7-4bcd-8bf6-8c310d83b3ab 1073741824 Sep 03 14:32:09 devstack sudo[103736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:09 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-4b456883-6484-41c3-97ee-5bb5dcbeb34a tempest-TestImageHashVerification-1295909703 None] Copy volume to image completed successfully. Sep 03 14:32:09 devstack sudo[103736]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffe52ec0-3ed0-46b6-b1aa-e9d308917dc9 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1941ee8f-d8f7-4bcd-8bf6-8c310d83b3ab 1073741824" returned: 0 in 0.416s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffe52ec0-3ed0-46b6-b1aa-e9d308917dc9 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1941ee8f-d8f7-4bcd-8bf6-8c310d83b3ab {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:10 devstack sudo[103741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1941ee8f-d8f7-4bcd-8bf6-8c310d83b3ab Sep 03 14:32:10 devstack sudo[103741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:10 devstack sudo[103741]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffe52ec0-3ed0-46b6-b1aa-e9d308917dc9 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1941ee8f-d8f7-4bcd-8bf6-8c310d83b3ab" returned: 0 in 0.253s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:10 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ffe52ec0-3ed0-46b6-b1aa-e9d308917dc9 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:32:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffe52ec0-3ed0-46b6-b1aa-e9d308917dc9 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:32:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a3f9ece8-bb1b-4b57-a7f3-02c434e7b353 tempest-TestMinimumBasicScenario-923270773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.409s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:32:10 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a3f9ece8-bb1b-4b57-a7f3-02c434e7b353 tempest-TestMinimumBasicScenario-923270773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:31:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-159384586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=badc2d73-24b3-4617-b3bd-7413b9e379c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ea1c5dbea5842509dd856a3bb1de077',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:31:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:31:58Z,use_quota=True,user_id='f1e21f304e1e4ab89f4da25cb93183e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:32:10 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-a3f9ece8-bb1b-4b57-a7f3-02c434e7b353 tempest-TestMinimumBasicScenario-923270773 None] Creating volume badc2d73-24b3-4617-b3bd-7413b9e379c5 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:32:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a3f9ece8-bb1b-4b57-a7f3-02c434e7b353 tempest-TestMinimumBasicScenario-923270773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:32:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a3f9ece8-bb1b-4b57-a7f3-02c434e7b353 tempest-TestMinimumBasicScenario-923270773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:32:10 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a3f9ece8-bb1b-4b57-a7f3-02c434e7b353 tempest-TestMinimumBasicScenario-923270773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:32:10 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a3f9ece8-bb1b-4b57-a7f3-02c434e7b353 tempest-TestMinimumBasicScenario-923270773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:32:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a3f9ece8-bb1b-4b57-a7f3-02c434e7b353 tempest-TestMinimumBasicScenario-923270773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:32:10 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a3f9ece8-bb1b-4b57-a7f3-02c434e7b353 tempest-TestMinimumBasicScenario-923270773 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:32:10 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-a3f9ece8-bb1b-4b57-a7f3-02c434e7b353 tempest-TestMinimumBasicScenario-923270773 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:32:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a3f9ece8-bb1b-4b57-a7f3-02c434e7b353 tempest-TestMinimumBasicScenario-923270773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-badc2d73-24b3-4617-b3bd-7413b9e379c5 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffe52ec0-3ed0-46b6-b1aa-e9d308917dc9 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c85654-f94d-4326-805c-f68bb973b45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1941ee8f-d8f7-4bcd-8bf6-8c310d83b3ab', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffe52ec0-3ed0-46b6-b1aa-e9d308917dc9 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34f037c7-eb60-4d63-8db2-90a6d2b47789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:10 devstack sudo[103744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-badc2d73-24b3-4617-b3bd-7413b9e379c5 1073741824 Sep 03 14:32:10 devstack sudo[103744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:10 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-ffe52ec0-3ed0-46b6-b1aa-e9d308917dc9 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Volume volume-1941ee8f-d8f7-4bcd-8bf6-8c310d83b3ab (1941ee8f-d8f7-4bcd-8bf6-8c310d83b3ab): created successfully Sep 03 14:32:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffe52ec0-3ed0-46b6-b1aa-e9d308917dc9 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34f037c7-eb60-4d63-8db2-90a6d2b47789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffe52ec0-3ed0-46b6-b1aa-e9d308917dc9 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Flow 'volume_create_manager' (8cab06b1-dd77-498c-b503-a49495c8555e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:32:10 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-ffe52ec0-3ed0-46b6-b1aa-e9d308917dc9 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Created volume successfully. Sep 03 14:32:10 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-20bf047b-c121-4852-bd66-c4d45ed62c05 tempest-TestImageHashVerification-1295909703 None] Acquiring lock "cinder-ae160bc0-3df8-44ae-8de3-a0ab78cd549e-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:32:10 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-20bf047b-c121-4852-bd66-c4d45ed62c05 tempest-TestImageHashVerification-1295909703 None] Lock "cinder-ae160bc0-3df8-44ae-8de3-a0ab78cd549e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:32:10 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-20bf047b-c121-4852-bd66-c4d45ed62c05 tempest-TestImageHashVerification-1295909703 None] Acquiring lock "cinder-quobyte-ae160bc0-3df8-44ae-8de3-a0ab78cd549e" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:32:10 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-20bf047b-c121-4852-bd66-c4d45ed62c05 tempest-TestImageHashVerification-1295909703 None] Lock "cinder-quobyte-ae160bc0-3df8-44ae-8de3-a0ab78cd549e" acquired by "delete_volume" :: waited 0.020s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:32:10 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23646d8-2c6f-4c76-b17f-33096a0e25c9]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:32:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-20bf047b-c121-4852-bd66-c4d45ed62c05 tempest-TestImageHashVerification-1295909703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ae160bc0-3df8-44ae-8de3-a0ab78cd549e {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:10 devstack sudo[103744]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a3f9ece8-bb1b-4b57-a7f3-02c434e7b353 tempest-TestMinimumBasicScenario-923270773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-badc2d73-24b3-4617-b3bd-7413b9e379c5 1073741824" returned: 0 in 0.495s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a3f9ece8-bb1b-4b57-a7f3-02c434e7b353 tempest-TestMinimumBasicScenario-923270773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-badc2d73-24b3-4617-b3bd-7413b9e379c5 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:10 devstack sudo[103751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-badc2d73-24b3-4617-b3bd-7413b9e379c5 Sep 03 14:32:10 devstack sudo[103751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:10 devstack sudo[103750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ae160bc0-3df8-44ae-8de3-a0ab78cd549e Sep 03 14:32:10 devstack sudo[103750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:11 devstack sudo[103751]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a3f9ece8-bb1b-4b57-a7f3-02c434e7b353 tempest-TestMinimumBasicScenario-923270773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-badc2d73-24b3-4617-b3bd-7413b9e379c5" returned: 0 in 0.245s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:11 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a3f9ece8-bb1b-4b57-a7f3-02c434e7b353 tempest-TestMinimumBasicScenario-923270773 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:32:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a3f9ece8-bb1b-4b57-a7f3-02c434e7b353 tempest-TestMinimumBasicScenario-923270773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:32:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-147c7f2c-38fe-4938-9e96-2df47577a443 req-302fef71-fb13-4c2c-b476-0bf824b6bf8f tempest-TestInstancesWithCinderVolumes-1947083261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.246s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:32:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-147c7f2c-38fe-4938-9e96-2df47577a443 req-302fef71-fb13-4c2c-b476-0bf824b6bf8f tempest-TestInstancesWithCinderVolumes-1947083261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:32:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a3f9ece8-bb1b-4b57-a7f3-02c434e7b353 tempest-TestMinimumBasicScenario-923270773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (484d571e-4036-43c0-adfa-53341ccbfb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-badc2d73-24b3-4617-b3bd-7413b9e379c5', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a3f9ece8-bb1b-4b57-a7f3-02c434e7b353 tempest-TestMinimumBasicScenario-923270773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c52b8a42-d0c8-4e0a-b398-222d77290c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:11 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-a3f9ece8-bb1b-4b57-a7f3-02c434e7b353 tempest-TestMinimumBasicScenario-923270773 None] Volume volume-badc2d73-24b3-4617-b3bd-7413b9e379c5 (badc2d73-24b3-4617-b3bd-7413b9e379c5): created successfully Sep 03 14:32:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a3f9ece8-bb1b-4b57-a7f3-02c434e7b353 tempest-TestMinimumBasicScenario-923270773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c52b8a42-d0c8-4e0a-b398-222d77290c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:11 devstack sudo[103750]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a3f9ece8-bb1b-4b57-a7f3-02c434e7b353 tempest-TestMinimumBasicScenario-923270773 None] Flow 'volume_create_manager' (eb68eed9-f49e-4557-9ff7-0026fb8e427a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:32:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-20bf047b-c121-4852-bd66-c4d45ed62c05 tempest-TestImageHashVerification-1295909703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ae160bc0-3df8-44ae-8de3-a0ab78cd549e" returned: 0 in 0.390s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-20bf047b-c121-4852-bd66-c4d45ed62c05 tempest-TestImageHashVerification-1295909703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ae160bc0-3df8-44ae-8de3-a0ab78cd549e {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-147c7f2c-38fe-4938-9e96-2df47577a443 req-302fef71-fb13-4c2c-b476-0bf824b6bf8f tempest-TestInstancesWithCinderVolumes-1947083261 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713', 'name': 'volume-87f6be89-cf67-4921-82a6-92506ede6580', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0f0800ec-d917-40f6-8b82-8f2956823803', 'enforce_multipath': True} {{(pid=87007) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 14:32:11 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-a3f9ece8-bb1b-4b57-a7f3-02c434e7b353 tempest-TestMinimumBasicScenario-923270773 None] Created volume successfully. Sep 03 14:32:11 devstack sudo[103760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ae160bc0-3df8-44ae-8de3-a0ab78cd549e Sep 03 14:32:11 devstack sudo[103760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:11 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-147c7f2c-38fe-4938-9e96-2df47577a443 req-302fef71-fb13-4c2c-b476-0bf824b6bf8f tempest-TestInstancesWithCinderVolumes-1947083261 None] attachment_update completed successfully. Sep 03 14:32:11 devstack sudo[103760]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-20bf047b-c121-4852-bd66-c4d45ed62c05 tempest-TestImageHashVerification-1295909703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ae160bc0-3df8-44ae-8de3-a0ab78cd549e" returned: 0 in 0.304s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:11 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-20bf047b-c121-4852-bd66-c4d45ed62c05 tempest-TestImageHashVerification-1295909703 None] Lock "cinder-quobyte-ae160bc0-3df8-44ae-8de3-a0ab78cd549e" released by "delete_volume" :: held 0.738s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:32:11 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-20bf047b-c121-4852-bd66-c4d45ed62c05 tempest-TestImageHashVerification-1295909703 None] Created reservations ['115bb892-5f25-4e81-b0bd-86824dee02b6', 'b131a57a-3efd-4f80-9bf5-1e24ed71d72a', '76b3597e-fc27-437a-8ed7-d69c172caad1', '57215883-d306-4898-becf-5ef46f39cf1c'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:32:11 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-443e45bb-d167-4674-822a-f894442635e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:32:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-443e45bb-d167-4674-822a-f894442635e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Flow 'volume_create_manager' (ca0f390b-d7f5-4393-93ff-63800f1876db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:32:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-443e45bb-d167-4674-822a-f894442635e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5fb000d-45a2-4515-82da-df84fdbb41d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-443e45bb-d167-4674-822a-f894442635e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5fb000d-45a2-4515-82da-df84fdbb41d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-283858102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d7960b0-1c69-491d-a763-6c1897801d62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b04fd5d45c64135a4aca7a808cfea6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:32:12Z,use_quota=True,user_id='43702c4722e54bf2a674fb5fd1794598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-443e45bb-d167-4674-822a-f894442635e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f31c1e2-f267-4f18-b8c1-b4ac14ea86bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-443e45bb-d167-4674-822a-f894442635e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f31c1e2-f267-4f18-b8c1-b4ac14ea86bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-443e45bb-d167-4674-822a-f894442635e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0976c9dd-4f3e-4b80-a933-7e06ec1d503d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-443e45bb-d167-4674-822a-f894442635e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0976c9dd-4f3e-4b80-a933-7e06ec1d503d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d7960b0-1c69-491d-a763-6c1897801d62', 'volume_name': 'volume-6d7960b0-1c69-491d-a763-6c1897801d62', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-443e45bb-d167-4674-822a-f894442635e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2599b37-b6eb-4d13-9f42-c098046ade5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-443e45bb-d167-4674-822a-f894442635e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2599b37-b6eb-4d13-9f42-c098046ade5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-443e45bb-d167-4674-822a-f894442635e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14c4a46e-f4d5-4966-bcc7-6e22f99e8ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:11 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-443e45bb-d167-4674-822a-f894442635e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Volume 6d7960b0-1c69-491d-a763-6c1897801d62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d7960b0-1c69-491d-a763-6c1897801d62', 'volume_size': 1} Sep 03 14:32:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-443e45bb-d167-4674-822a-f894442635e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:32:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-443e45bb-d167-4674-822a-f894442635e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:32:11 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-443e45bb-d167-4674-822a-f894442635e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-283858102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d7960b0-1c69-491d-a763-6c1897801d62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b04fd5d45c64135a4aca7a808cfea6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:32:12Z,use_quota=True,user_id='43702c4722e54bf2a674fb5fd1794598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:32:11 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-443e45bb-d167-4674-822a-f894442635e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Creating volume 6d7960b0-1c69-491d-a763-6c1897801d62 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:32:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-443e45bb-d167-4674-822a-f894442635e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:32:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-443e45bb-d167-4674-822a-f894442635e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:32:11 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-443e45bb-d167-4674-822a-f894442635e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:32:11 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-443e45bb-d167-4674-822a-f894442635e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:32:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-443e45bb-d167-4674-822a-f894442635e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:32:11 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-443e45bb-d167-4674-822a-f894442635e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:32:11 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-443e45bb-d167-4674-822a-f894442635e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:32:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-443e45bb-d167-4674-822a-f894442635e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6d7960b0-1c69-491d-a763-6c1897801d62 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:11 devstack sudo[103765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6d7960b0-1c69-491d-a763-6c1897801d62 1073741824 Sep 03 14:32:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-20bf047b-c121-4852-bd66-c4d45ed62c05 tempest-TestImageHashVerification-1295909703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:32:11 devstack sudo[103765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-20bf047b-c121-4852-bd66-c4d45ed62c05 tempest-TestImageHashVerification-1295909703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:32:11 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-20bf047b-c121-4852-bd66-c4d45ed62c05 tempest-TestImageHashVerification-1295909703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:32:11 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-20bf047b-c121-4852-bd66-c4d45ed62c05 tempest-TestImageHashVerification-1295909703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:32:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-20bf047b-c121-4852-bd66-c4d45ed62c05 tempest-TestImageHashVerification-1295909703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:32:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-20bf047b-c121-4852-bd66-c4d45ed62c05 tempest-TestImageHashVerification-1295909703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:11 devstack sudo[103767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:32:11 devstack sudo[103767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:12 devstack sudo[103767]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-20bf047b-c121-4852-bd66-c4d45ed62c05 tempest-TestImageHashVerification-1295909703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.493s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:12 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-20bf047b-c121-4852-bd66-c4d45ed62c05 tempest-TestImageHashVerification-1295909703 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:32:12 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-20bf047b-c121-4852-bd66-c4d45ed62c05 tempest-TestImageHashVerification-1295909703 None] Deleted volume successfully. Sep 03 14:32:12 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-20bf047b-c121-4852-bd66-c4d45ed62c05 tempest-TestImageHashVerification-1295909703 None] Lock "cinder-ae160bc0-3df8-44ae-8de3-a0ab78cd549e-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:32:12 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2db9681-091d-4e83-a603-5b30a66cc926 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:32:12 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e2db9681-091d-4e83-a603-5b30a66cc926 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Flow 'volume_create_manager' (5fdfa729-1986-4090-bed4-4cbd524b68cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:32:12 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e2db9681-091d-4e83-a603-5b30a66cc926 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d0c6863-d5bd-4fb3-a6c8-51e5c6b05e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:12 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e2db9681-091d-4e83-a603-5b30a66cc926 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d0c6863-d5bd-4fb3-a6c8-51e5c6b05e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1371734965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=028fb3d5-0127-407c-aae8-2c5ad6fc8294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b04fd5d45c64135a4aca7a808cfea6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:32:12Z,use_quota=True,user_id='43702c4722e54bf2a674fb5fd1794598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:12 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e2db9681-091d-4e83-a603-5b30a66cc926 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b57a6df-f268-4f05-96ba-69a31c7136e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:12 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e2db9681-091d-4e83-a603-5b30a66cc926 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b57a6df-f268-4f05-96ba-69a31c7136e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:12 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e2db9681-091d-4e83-a603-5b30a66cc926 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9543200c-14e4-43a3-930e-c14eccc2c712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:12 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e2db9681-091d-4e83-a603-5b30a66cc926 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9543200c-14e4-43a3-930e-c14eccc2c712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '028fb3d5-0127-407c-aae8-2c5ad6fc8294', 'volume_name': 'volume-028fb3d5-0127-407c-aae8-2c5ad6fc8294', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:12 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e2db9681-091d-4e83-a603-5b30a66cc926 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5f7faa5-9ea1-4b5c-9c63-9cd2bd9767b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:12 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e2db9681-091d-4e83-a603-5b30a66cc926 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5f7faa5-9ea1-4b5c-9c63-9cd2bd9767b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:12 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e2db9681-091d-4e83-a603-5b30a66cc926 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e2dbc7c-eea6-4df8-be19-87fefbc7256d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:12 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-e2db9681-091d-4e83-a603-5b30a66cc926 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Volume 028fb3d5-0127-407c-aae8-2c5ad6fc8294: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-028fb3d5-0127-407c-aae8-2c5ad6fc8294', 'volume_size': 1} Sep 03 14:32:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-e2db9681-091d-4e83-a603-5b30a66cc926 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:32:12 devstack sudo[103765]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-443e45bb-d167-4674-822a-f894442635e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6d7960b0-1c69-491d-a763-6c1897801d62 1073741824" returned: 0 in 1.034s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-443e45bb-d167-4674-822a-f894442635e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6d7960b0-1c69-491d-a763-6c1897801d62 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:12 devstack sudo[103783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6d7960b0-1c69-491d-a763-6c1897801d62 Sep 03 14:32:12 devstack sudo[103783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:13 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-870b7cbb-339b-4594-9b08-73064fbcca27 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:32:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-870b7cbb-339b-4594-9b08-73064fbcca27 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Flow 'volume_create_manager' (9a89bfe8-5675-48f9-9b32-8c9d24ffb29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:32:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-870b7cbb-339b-4594-9b08-73064fbcca27 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbba259a-7997-40e4-92e8-b044885ad572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-870b7cbb-339b-4594-9b08-73064fbcca27 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbba259a-7997-40e4-92e8-b044885ad572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1449966804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08fde90e-d8ba-4126-a037-64e310ba4ebb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b04fd5d45c64135a4aca7a808cfea6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:32:13Z,use_quota=True,user_id='43702c4722e54bf2a674fb5fd1794598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-870b7cbb-339b-4594-9b08-73064fbcca27 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1140867c-29bd-436d-b473-5788e5dcf1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-870b7cbb-339b-4594-9b08-73064fbcca27 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1140867c-29bd-436d-b473-5788e5dcf1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-870b7cbb-339b-4594-9b08-73064fbcca27 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae0205be-95ea-4849-8823-a64f65f6f051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-870b7cbb-339b-4594-9b08-73064fbcca27 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae0205be-95ea-4849-8823-a64f65f6f051) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08fde90e-d8ba-4126-a037-64e310ba4ebb', 'volume_name': 'volume-08fde90e-d8ba-4126-a037-64e310ba4ebb', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-870b7cbb-339b-4594-9b08-73064fbcca27 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ee3ad81-6e97-45a0-85d2-515aa05fe3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-870b7cbb-339b-4594-9b08-73064fbcca27 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ee3ad81-6e97-45a0-85d2-515aa05fe3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-870b7cbb-339b-4594-9b08-73064fbcca27 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e01842c8-1a00-48e2-bd26-953cf960f4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:13 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-870b7cbb-339b-4594-9b08-73064fbcca27 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Volume 08fde90e-d8ba-4126-a037-64e310ba4ebb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08fde90e-d8ba-4126-a037-64e310ba4ebb', 'volume_size': 1} Sep 03 14:32:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-870b7cbb-339b-4594-9b08-73064fbcca27 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:32:13 devstack sudo[103783]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-443e45bb-d167-4674-822a-f894442635e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6d7960b0-1c69-491d-a763-6c1897801d62" returned: 0 in 0.500s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:13 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-443e45bb-d167-4674-822a-f894442635e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:32:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-443e45bb-d167-4674-822a-f894442635e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:32:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-e2db9681-091d-4e83-a603-5b30a66cc926 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.715s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:32:13 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-e2db9681-091d-4e83-a603-5b30a66cc926 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1371734965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=028fb3d5-0127-407c-aae8-2c5ad6fc8294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b04fd5d45c64135a4aca7a808cfea6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:32:12Z,use_quota=True,user_id='43702c4722e54bf2a674fb5fd1794598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:32:13 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-e2db9681-091d-4e83-a603-5b30a66cc926 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Creating volume 028fb3d5-0127-407c-aae8-2c5ad6fc8294 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:32:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-e2db9681-091d-4e83-a603-5b30a66cc926 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:32:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-e2db9681-091d-4e83-a603-5b30a66cc926 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:32:13 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-e2db9681-091d-4e83-a603-5b30a66cc926 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:32:13 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-e2db9681-091d-4e83-a603-5b30a66cc926 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:32:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-e2db9681-091d-4e83-a603-5b30a66cc926 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:32:13 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-e2db9681-091d-4e83-a603-5b30a66cc926 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:32:13 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-e2db9681-091d-4e83-a603-5b30a66cc926 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:32:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e2db9681-091d-4e83-a603-5b30a66cc926 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-028fb3d5-0127-407c-aae8-2c5ad6fc8294 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-443e45bb-d167-4674-822a-f894442635e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14c4a46e-f4d5-4966-bcc7-6e22f99e8ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d7960b0-1c69-491d-a763-6c1897801d62', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-443e45bb-d167-4674-822a-f894442635e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff8fd8ec-3e77-4f38-b1c8-ed04fddd538e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:13 devstack sudo[103797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-028fb3d5-0127-407c-aae8-2c5ad6fc8294 1073741824 Sep 03 14:32:13 devstack sudo[103797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:13 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-443e45bb-d167-4674-822a-f894442635e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Volume volume-6d7960b0-1c69-491d-a763-6c1897801d62 (6d7960b0-1c69-491d-a763-6c1897801d62): created successfully Sep 03 14:32:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-443e45bb-d167-4674-822a-f894442635e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff8fd8ec-3e77-4f38-b1c8-ed04fddd538e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-443e45bb-d167-4674-822a-f894442635e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Flow 'volume_create_manager' (ca0f390b-d7f5-4393-93ff-63800f1876db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:32:13 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-443e45bb-d167-4674-822a-f894442635e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Created volume successfully. Sep 03 14:32:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-3c1f7a19-301d-4d85-9296-480038117224 req-8082ec30-714a-4d1f-bda4-499c43a78978 tempest-TestMinimumBasicScenario-923270773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:32:13 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-67ae6dbd-7f05-4f48-9168-e10411dc9f1e tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:32:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-67ae6dbd-7f05-4f48-9168-e10411dc9f1e tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Flow 'volume_create_manager' (cf8265e0-29f4-47f1-98db-13c3705ae4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:32:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-67ae6dbd-7f05-4f48-9168-e10411dc9f1e tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09fb9fca-ce0a-4489-9a3d-2173b13be41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-67ae6dbd-7f05-4f48-9168-e10411dc9f1e tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09fb9fca-ce0a-4489-9a3d-2173b13be41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-164291087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cded960-b49c-4122-9c84-261855def8f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b04fd5d45c64135a4aca7a808cfea6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:32:14Z,use_quota=True,user_id='43702c4722e54bf2a674fb5fd1794598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-67ae6dbd-7f05-4f48-9168-e10411dc9f1e tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2338d838-c47a-45fc-b66d-bf4c7a51f36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-67ae6dbd-7f05-4f48-9168-e10411dc9f1e tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2338d838-c47a-45fc-b66d-bf4c7a51f36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-67ae6dbd-7f05-4f48-9168-e10411dc9f1e tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2488d3b-dea7-48cb-ae6e-3edb4ca109f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-67ae6dbd-7f05-4f48-9168-e10411dc9f1e tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2488d3b-dea7-48cb-ae6e-3edb4ca109f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cded960-b49c-4122-9c84-261855def8f1', 'volume_name': 'volume-9cded960-b49c-4122-9c84-261855def8f1', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-67ae6dbd-7f05-4f48-9168-e10411dc9f1e tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efc67058-8de3-4ee6-a8cd-7ad76463f6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-67ae6dbd-7f05-4f48-9168-e10411dc9f1e tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efc67058-8de3-4ee6-a8cd-7ad76463f6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-67ae6dbd-7f05-4f48-9168-e10411dc9f1e tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3563654c-33b0-4ac5-b333-ee50497d2afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:13 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-67ae6dbd-7f05-4f48-9168-e10411dc9f1e tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Volume 9cded960-b49c-4122-9c84-261855def8f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cded960-b49c-4122-9c84-261855def8f1', 'volume_size': 1} Sep 03 14:32:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-67ae6dbd-7f05-4f48-9168-e10411dc9f1e tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:32:14 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-35d7bef7-b786-4e4d-be4b-e3dbb0a431b8 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:32:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-35d7bef7-b786-4e4d-be4b-e3dbb0a431b8 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Flow 'volume_create_manager' (392b2166-6925-4041-8313-866f5a4e3795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:32:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-35d7bef7-b786-4e4d-be4b-e3dbb0a431b8 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9163ca0-f058-489f-bd12-d5eb6285dc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:14 devstack sudo[103797]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e2db9681-091d-4e83-a603-5b30a66cc926 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-028fb3d5-0127-407c-aae8-2c5ad6fc8294 1073741824" returned: 0 in 0.773s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-35d7bef7-b786-4e4d-be4b-e3dbb0a431b8 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9163ca0-f058-489f-bd12-d5eb6285dc49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-201660965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89e89fa1-5036-4f19-ad80-2a07ec7bc91f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b04fd5d45c64135a4aca7a808cfea6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:32:14Z,use_quota=True,user_id='43702c4722e54bf2a674fb5fd1794598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-35d7bef7-b786-4e4d-be4b-e3dbb0a431b8 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d42efa49-977a-4300-b3fa-ec2e11ef8537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-35d7bef7-b786-4e4d-be4b-e3dbb0a431b8 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d42efa49-977a-4300-b3fa-ec2e11ef8537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-35d7bef7-b786-4e4d-be4b-e3dbb0a431b8 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc84d9f9-790e-4632-859f-5430c943ac55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-35d7bef7-b786-4e4d-be4b-e3dbb0a431b8 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc84d9f9-790e-4632-859f-5430c943ac55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89e89fa1-5036-4f19-ad80-2a07ec7bc91f', 'volume_name': 'volume-89e89fa1-5036-4f19-ad80-2a07ec7bc91f', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-35d7bef7-b786-4e4d-be4b-e3dbb0a431b8 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3504cd0c-1ea6-4fa7-957d-3620315d945d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-35d7bef7-b786-4e4d-be4b-e3dbb0a431b8 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3504cd0c-1ea6-4fa7-957d-3620315d945d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-35d7bef7-b786-4e4d-be4b-e3dbb0a431b8 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8af255a0-ee80-4e9b-b138-b4d4f6c27c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:14 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-35d7bef7-b786-4e4d-be4b-e3dbb0a431b8 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Volume 89e89fa1-5036-4f19-ad80-2a07ec7bc91f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89e89fa1-5036-4f19-ad80-2a07ec7bc91f', 'volume_size': 1} Sep 03 14:32:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-35d7bef7-b786-4e4d-be4b-e3dbb0a431b8 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:32:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e2db9681-091d-4e83-a603-5b30a66cc926 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-028fb3d5-0127-407c-aae8-2c5ad6fc8294 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:14 devstack sudo[103803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-028fb3d5-0127-407c-aae8-2c5ad6fc8294 Sep 03 14:32:14 devstack sudo[103803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:14 devstack sudo[103803]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e2db9681-091d-4e83-a603-5b30a66cc926 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-028fb3d5-0127-407c-aae8-2c5ad6fc8294" returned: 0 in 0.364s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-e2db9681-091d-4e83-a603-5b30a66cc926 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] <== create_volume: return (1289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:32:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-e2db9681-091d-4e83-a603-5b30a66cc926 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.295s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:32:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-870b7cbb-339b-4594-9b08-73064fbcca27 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.472s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:32:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-870b7cbb-339b-4594-9b08-73064fbcca27 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1449966804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08fde90e-d8ba-4126-a037-64e310ba4ebb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b04fd5d45c64135a4aca7a808cfea6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:32:13Z,use_quota=True,user_id='43702c4722e54bf2a674fb5fd1794598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:32:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-870b7cbb-339b-4594-9b08-73064fbcca27 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Creating volume 08fde90e-d8ba-4126-a037-64e310ba4ebb {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:32:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-870b7cbb-339b-4594-9b08-73064fbcca27 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:32:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-870b7cbb-339b-4594-9b08-73064fbcca27 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:32:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-870b7cbb-339b-4594-9b08-73064fbcca27 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:32:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-870b7cbb-339b-4594-9b08-73064fbcca27 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:32:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-870b7cbb-339b-4594-9b08-73064fbcca27 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:32:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-870b7cbb-339b-4594-9b08-73064fbcca27 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:32:14 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-870b7cbb-339b-4594-9b08-73064fbcca27 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:32:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-870b7cbb-339b-4594-9b08-73064fbcca27 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-08fde90e-d8ba-4126-a037-64e310ba4ebb 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:14 devstack sudo[103815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-08fde90e-d8ba-4126-a037-64e310ba4ebb 1073741824 Sep 03 14:32:14 devstack sudo[103815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e2db9681-091d-4e83-a603-5b30a66cc926 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e2dbc7c-eea6-4df8-be19-87fefbc7256d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-028fb3d5-0127-407c-aae8-2c5ad6fc8294', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e2db9681-091d-4e83-a603-5b30a66cc926 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbb701f5-b51e-4a7a-b581-f422f0566b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-105372c4-2eaa-45d6-aff9-13fe086b3763 req-09929776-dbbb-4c2a-8b3b-a6fbf819178a tempest-TestInstancesWithCinderVolumes-1947083261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:32:14 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-e2db9681-091d-4e83-a603-5b30a66cc926 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Volume volume-028fb3d5-0127-407c-aae8-2c5ad6fc8294 (028fb3d5-0127-407c-aae8-2c5ad6fc8294): created successfully Sep 03 14:32:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e2db9681-091d-4e83-a603-5b30a66cc926 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbb701f5-b51e-4a7a-b581-f422f0566b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e2db9681-091d-4e83-a603-5b30a66cc926 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Flow 'volume_create_manager' (5fdfa729-1986-4090-bed4-4cbd524b68cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:32:14 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-e2db9681-091d-4e83-a603-5b30a66cc926 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Created volume successfully. Sep 03 14:32:15 devstack sudo[103815]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-870b7cbb-339b-4594-9b08-73064fbcca27 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-08fde90e-d8ba-4126-a037-64e310ba4ebb 1073741824" returned: 0 in 0.519s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-870b7cbb-339b-4594-9b08-73064fbcca27 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-08fde90e-d8ba-4126-a037-64e310ba4ebb {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:15 devstack sudo[103821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-08fde90e-d8ba-4126-a037-64e310ba4ebb Sep 03 14:32:15 devstack sudo[103821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:15 devstack sudo[103821]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-870b7cbb-339b-4594-9b08-73064fbcca27 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-08fde90e-d8ba-4126-a037-64e310ba4ebb" returned: 0 in 0.267s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:15 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-870b7cbb-339b-4594-9b08-73064fbcca27 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:32:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-870b7cbb-339b-4594-9b08-73064fbcca27 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:32:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-3c1f7a19-301d-4d85-9296-480038117224 req-8082ec30-714a-4d1f-bda4-499c43a78978 tempest-TestMinimumBasicScenario-923270773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.865s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:32:15 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-870b7cbb-339b-4594-9b08-73064fbcca27 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e01842c8-1a00-48e2-bd26-953cf960f4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08fde90e-d8ba-4126-a037-64e310ba4ebb', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:15 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-870b7cbb-339b-4594-9b08-73064fbcca27 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf567160-5a71-4db8-8517-549c7701393a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-3c1f7a19-301d-4d85-9296-480038117224 req-8082ec30-714a-4d1f-bda4-499c43a78978 tempest-TestMinimumBasicScenario-923270773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:32:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-67ae6dbd-7f05-4f48-9168-e10411dc9f1e tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.779s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:32:15 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-67ae6dbd-7f05-4f48-9168-e10411dc9f1e tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-164291087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cded960-b49c-4122-9c84-261855def8f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b04fd5d45c64135a4aca7a808cfea6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:32:14Z,use_quota=True,user_id='43702c4722e54bf2a674fb5fd1794598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:32:15 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-67ae6dbd-7f05-4f48-9168-e10411dc9f1e tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Creating volume 9cded960-b49c-4122-9c84-261855def8f1 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:32:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-67ae6dbd-7f05-4f48-9168-e10411dc9f1e tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:32:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-67ae6dbd-7f05-4f48-9168-e10411dc9f1e tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:32:15 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-67ae6dbd-7f05-4f48-9168-e10411dc9f1e tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:32:15 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-67ae6dbd-7f05-4f48-9168-e10411dc9f1e tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:32:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-67ae6dbd-7f05-4f48-9168-e10411dc9f1e tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:32:15 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-67ae6dbd-7f05-4f48-9168-e10411dc9f1e tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:32:15 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-67ae6dbd-7f05-4f48-9168-e10411dc9f1e tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:32:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-67ae6dbd-7f05-4f48-9168-e10411dc9f1e tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9cded960-b49c-4122-9c84-261855def8f1 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:15 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-870b7cbb-339b-4594-9b08-73064fbcca27 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Volume volume-08fde90e-d8ba-4126-a037-64e310ba4ebb (08fde90e-d8ba-4126-a037-64e310ba4ebb): created successfully Sep 03 14:32:15 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-870b7cbb-339b-4594-9b08-73064fbcca27 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf567160-5a71-4db8-8517-549c7701393a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:15 devstack sudo[103824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9cded960-b49c-4122-9c84-261855def8f1 1073741824 Sep 03 14:32:15 devstack sudo[103824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:15 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-870b7cbb-339b-4594-9b08-73064fbcca27 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Flow 'volume_create_manager' (9a89bfe8-5675-48f9-9b32-8c9d24ffb29c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:32:15 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-870b7cbb-339b-4594-9b08-73064fbcca27 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Created volume successfully. Sep 03 14:32:15 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-3c1f7a19-301d-4d85-9296-480038117224 req-8082ec30-714a-4d1f-bda4-499c43a78978 tempest-TestMinimumBasicScenario-923270773 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713', 'name': 'volume-badc2d73-24b3-4617-b3bd-7413b9e379c5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3ef8462d-af9c-47cd-88e7-229d25d2176f', 'enforce_multipath': True} {{(pid=87007) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 14:32:15 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-3c1f7a19-301d-4d85-9296-480038117224 req-8082ec30-714a-4d1f-bda4-499c43a78978 tempest-TestMinimumBasicScenario-923270773 None] attachment_update completed successfully. Sep 03 14:32:16 devstack sudo[103824]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-67ae6dbd-7f05-4f48-9168-e10411dc9f1e tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9cded960-b49c-4122-9c84-261855def8f1 1073741824" returned: 0 in 0.591s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-67ae6dbd-7f05-4f48-9168-e10411dc9f1e tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9cded960-b49c-4122-9c84-261855def8f1 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:16 devstack sudo[103832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9cded960-b49c-4122-9c84-261855def8f1 Sep 03 14:32:16 devstack sudo[103832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:16 devstack sudo[103832]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-67ae6dbd-7f05-4f48-9168-e10411dc9f1e tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9cded960-b49c-4122-9c84-261855def8f1" returned: 0 in 0.268s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:16 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-67ae6dbd-7f05-4f48-9168-e10411dc9f1e tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:32:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-67ae6dbd-7f05-4f48-9168-e10411dc9f1e tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:32:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-35d7bef7-b786-4e4d-be4b-e3dbb0a431b8 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.238s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:32:16 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-35d7bef7-b786-4e4d-be4b-e3dbb0a431b8 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-201660965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89e89fa1-5036-4f19-ad80-2a07ec7bc91f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b04fd5d45c64135a4aca7a808cfea6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:32:14Z,use_quota=True,user_id='43702c4722e54bf2a674fb5fd1794598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:32:16 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-35d7bef7-b786-4e4d-be4b-e3dbb0a431b8 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Creating volume 89e89fa1-5036-4f19-ad80-2a07ec7bc91f {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:32:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-35d7bef7-b786-4e4d-be4b-e3dbb0a431b8 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:32:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-35d7bef7-b786-4e4d-be4b-e3dbb0a431b8 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:32:16 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-35d7bef7-b786-4e4d-be4b-e3dbb0a431b8 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:32:16 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-35d7bef7-b786-4e4d-be4b-e3dbb0a431b8 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:32:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-35d7bef7-b786-4e4d-be4b-e3dbb0a431b8 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:32:16 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-35d7bef7-b786-4e4d-be4b-e3dbb0a431b8 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:32:16 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-35d7bef7-b786-4e4d-be4b-e3dbb0a431b8 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:32:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-35d7bef7-b786-4e4d-be4b-e3dbb0a431b8 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-89e89fa1-5036-4f19-ad80-2a07ec7bc91f 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:16 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-67ae6dbd-7f05-4f48-9168-e10411dc9f1e tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3563654c-33b0-4ac5-b333-ee50497d2afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cded960-b49c-4122-9c84-261855def8f1', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:16 devstack sudo[103836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-89e89fa1-5036-4f19-ad80-2a07ec7bc91f 1073741824 Sep 03 14:32:16 devstack sudo[103836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:16 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-67ae6dbd-7f05-4f48-9168-e10411dc9f1e tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bca9a7f-128f-41a6-b075-1e28bdcddbe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:16 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-67ae6dbd-7f05-4f48-9168-e10411dc9f1e tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Volume volume-9cded960-b49c-4122-9c84-261855def8f1 (9cded960-b49c-4122-9c84-261855def8f1): created successfully Sep 03 14:32:16 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-67ae6dbd-7f05-4f48-9168-e10411dc9f1e tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bca9a7f-128f-41a6-b075-1e28bdcddbe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:16 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-67ae6dbd-7f05-4f48-9168-e10411dc9f1e tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Flow 'volume_create_manager' (cf8265e0-29f4-47f1-98db-13c3705ae4e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:32:16 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-67ae6dbd-7f05-4f48-9168-e10411dc9f1e tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Created volume successfully. Sep 03 14:32:16 devstack sudo[103836]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-35d7bef7-b786-4e4d-be4b-e3dbb0a431b8 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-89e89fa1-5036-4f19-ad80-2a07ec7bc91f 1073741824" returned: 0 in 0.460s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-35d7bef7-b786-4e4d-be4b-e3dbb0a431b8 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-89e89fa1-5036-4f19-ad80-2a07ec7bc91f {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:17 devstack sudo[103841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-89e89fa1-5036-4f19-ad80-2a07ec7bc91f Sep 03 14:32:17 devstack sudo[103841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:17 devstack sudo[103841]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-35d7bef7-b786-4e4d-be4b-e3dbb0a431b8 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-89e89fa1-5036-4f19-ad80-2a07ec7bc91f" returned: 0 in 0.292s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:17 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-35d7bef7-b786-4e4d-be4b-e3dbb0a431b8 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:32:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-35d7bef7-b786-4e4d-be4b-e3dbb0a431b8 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:32:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-105372c4-2eaa-45d6-aff9-13fe086b3763 req-09929776-dbbb-4c2a-8b3b-a6fbf819178a tempest-TestInstancesWithCinderVolumes-1947083261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.547s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:32:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-35d7bef7-b786-4e4d-be4b-e3dbb0a431b8 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8af255a0-ee80-4e9b-b138-b4d4f6c27c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89e89fa1-5036-4f19-ad80-2a07ec7bc91f', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-35d7bef7-b786-4e4d-be4b-e3dbb0a431b8 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51e811d5-24c3-4a93-aa9d-0e47c612036a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-105372c4-2eaa-45d6-aff9-13fe086b3763 req-09929776-dbbb-4c2a-8b3b-a6fbf819178a tempest-TestInstancesWithCinderVolumes-1947083261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:32:17 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-35d7bef7-b786-4e4d-be4b-e3dbb0a431b8 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Volume volume-89e89fa1-5036-4f19-ad80-2a07ec7bc91f (89e89fa1-5036-4f19-ad80-2a07ec7bc91f): created successfully Sep 03 14:32:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-35d7bef7-b786-4e4d-be4b-e3dbb0a431b8 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51e811d5-24c3-4a93-aa9d-0e47c612036a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-35d7bef7-b786-4e4d-be4b-e3dbb0a431b8 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Flow 'volume_create_manager' (392b2166-6925-4041-8313-866f5a4e3795) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:32:17 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-35d7bef7-b786-4e4d-be4b-e3dbb0a431b8 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Created volume successfully. Sep 03 14:32:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-105372c4-2eaa-45d6-aff9-13fe086b3763 req-09929776-dbbb-4c2a-8b3b-a6fbf819178a tempest-TestInstancesWithCinderVolumes-1947083261 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713', 'name': 'volume-5b7648e3-cb7f-428c-9792-061d8e214562', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4ef39d2f-873d-45c8-a70f-598f35a849ae', 'enforce_multipath': True} {{(pid=87007) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 14:32:17 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-105372c4-2eaa-45d6-aff9-13fe086b3763 req-09929776-dbbb-4c2a-8b3b-a6fbf819178a tempest-TestInstancesWithCinderVolumes-1947083261 None] attachment_update completed successfully. Sep 03 14:32:18 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8c4e21ed-8636-40e1-a19b-6690470e138f tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Acquiring lock "cinder-89e89fa1-5036-4f19-ad80-2a07ec7bc91f-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:32:18 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8c4e21ed-8636-40e1-a19b-6690470e138f tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "cinder-89e89fa1-5036-4f19-ad80-2a07ec7bc91f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:32:18 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8c4e21ed-8636-40e1-a19b-6690470e138f tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Acquiring lock "cinder-quobyte-89e89fa1-5036-4f19-ad80-2a07ec7bc91f" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:32:18 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8c4e21ed-8636-40e1-a19b-6690470e138f tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "cinder-quobyte-89e89fa1-5036-4f19-ad80-2a07ec7bc91f" acquired by "delete_volume" :: waited 0.017s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:32:18 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[51317c6e-b516-45e5-abe9-5ae92890c3c3]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:32:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8c4e21ed-8636-40e1-a19b-6690470e138f tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-89e89fa1-5036-4f19-ad80-2a07ec7bc91f {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:18 devstack sudo[103855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-89e89fa1-5036-4f19-ad80-2a07ec7bc91f Sep 03 14:32:18 devstack sudo[103855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:19 devstack sudo[103855]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8c4e21ed-8636-40e1-a19b-6690470e138f tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-89e89fa1-5036-4f19-ad80-2a07ec7bc91f" returned: 0 in 0.474s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8c4e21ed-8636-40e1-a19b-6690470e138f tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-89e89fa1-5036-4f19-ad80-2a07ec7bc91f {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:19 devstack sudo[103860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-89e89fa1-5036-4f19-ad80-2a07ec7bc91f Sep 03 14:32:19 devstack sudo[103860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:19 devstack sudo[103860]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8c4e21ed-8636-40e1-a19b-6690470e138f tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-89e89fa1-5036-4f19-ad80-2a07ec7bc91f" returned: 0 in 0.367s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:19 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8c4e21ed-8636-40e1-a19b-6690470e138f tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "cinder-quobyte-89e89fa1-5036-4f19-ad80-2a07ec7bc91f" released by "delete_volume" :: held 0.915s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:32:19 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-8c4e21ed-8636-40e1-a19b-6690470e138f tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Created reservations ['b8f7a172-4ec5-44ea-b6a3-f6d336b901ac', '9b8c2548-d49a-41e0-8696-7c9d7c5ddac8', '54de8c76-2865-4fef-8c64-356659311850', '1e41e7b0-26a3-4326-a584-fab138796127'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:32:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8c4e21ed-8636-40e1-a19b-6690470e138f tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:32:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8c4e21ed-8636-40e1-a19b-6690470e138f tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:32:19 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-8c4e21ed-8636-40e1-a19b-6690470e138f tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:32:19 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-8c4e21ed-8636-40e1-a19b-6690470e138f tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:32:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8c4e21ed-8636-40e1-a19b-6690470e138f tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:32:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8c4e21ed-8636-40e1-a19b-6690470e138f tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:19 devstack sudo[103864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:32:19 devstack sudo[103864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:19 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2f2185f0-8cf2-4290-9a4a-162cb34b23e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Acquiring lock "cinder-9cded960-b49c-4122-9c84-261855def8f1-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:32:19 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2f2185f0-8cf2-4290-9a4a-162cb34b23e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "cinder-9cded960-b49c-4122-9c84-261855def8f1-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:32:19 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2f2185f0-8cf2-4290-9a4a-162cb34b23e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Acquiring lock "cinder-quobyte-9cded960-b49c-4122-9c84-261855def8f1" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:32:19 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2f2185f0-8cf2-4290-9a4a-162cb34b23e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "cinder-quobyte-9cded960-b49c-4122-9c84-261855def8f1" acquired by "delete_volume" :: waited 0.017s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:32:19 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[43851a19-c42e-42ee-85d9-be1c05e7271c]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:32:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2f2185f0-8cf2-4290-9a4a-162cb34b23e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9cded960-b49c-4122-9c84-261855def8f1 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:20 devstack sudo[103866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9cded960-b49c-4122-9c84-261855def8f1 Sep 03 14:32:20 devstack sudo[103866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:20 devstack sudo[103864]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8c4e21ed-8636-40e1-a19b-6690470e138f tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.433s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:20 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-8c4e21ed-8636-40e1-a19b-6690470e138f tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:32:20 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-8c4e21ed-8636-40e1-a19b-6690470e138f tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Deleted volume successfully. Sep 03 14:32:20 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8c4e21ed-8636-40e1-a19b-6690470e138f tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "cinder-89e89fa1-5036-4f19-ad80-2a07ec7bc91f-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:32:20 devstack sudo[103866]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2f2185f0-8cf2-4290-9a4a-162cb34b23e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9cded960-b49c-4122-9c84-261855def8f1" returned: 0 in 0.488s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2f2185f0-8cf2-4290-9a4a-162cb34b23e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9cded960-b49c-4122-9c84-261855def8f1 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:20 devstack sudo[103873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9cded960-b49c-4122-9c84-261855def8f1 Sep 03 14:32:20 devstack sudo[103873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:20 devstack sudo[103873]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2f2185f0-8cf2-4290-9a4a-162cb34b23e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9cded960-b49c-4122-9c84-261855def8f1" returned: 0 in 0.327s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:20 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2f2185f0-8cf2-4290-9a4a-162cb34b23e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "cinder-quobyte-9cded960-b49c-4122-9c84-261855def8f1" released by "delete_volume" :: held 0.877s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:32:20 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-2f2185f0-8cf2-4290-9a4a-162cb34b23e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Created reservations ['861e2e92-2d18-4b0a-8934-485cd00c10de', 'e2bc835b-6aea-41a3-81b5-50da1e583b5c', '61185d3e-082d-40fc-9112-0628f53a6fde', 'ee04dacf-5652-4b66-a11c-24bfda9b4ef9'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:32:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2f2185f0-8cf2-4290-9a4a-162cb34b23e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:32:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2f2185f0-8cf2-4290-9a4a-162cb34b23e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:32:21 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2f2185f0-8cf2-4290-9a4a-162cb34b23e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:32:21 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2f2185f0-8cf2-4290-9a4a-162cb34b23e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:32:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2f2185f0-8cf2-4290-9a4a-162cb34b23e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:32:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2f2185f0-8cf2-4290-9a4a-162cb34b23e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:21 devstack sudo[103878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:32:21 devstack sudo[103878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:21 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-fc4b111d-6e4c-49fe-bd91-b00f921f3d21 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Acquiring lock "cinder-08fde90e-d8ba-4126-a037-64e310ba4ebb-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:32:21 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-fc4b111d-6e4c-49fe-bd91-b00f921f3d21 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "cinder-08fde90e-d8ba-4126-a037-64e310ba4ebb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:32:21 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-fc4b111d-6e4c-49fe-bd91-b00f921f3d21 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Acquiring lock "cinder-quobyte-08fde90e-d8ba-4126-a037-64e310ba4ebb" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:32:21 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-fc4b111d-6e4c-49fe-bd91-b00f921f3d21 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "cinder-quobyte-08fde90e-d8ba-4126-a037-64e310ba4ebb" acquired by "delete_volume" :: waited 0.025s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:32:21 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[466e7445-094e-4b9c-b2ba-87f863842b7b]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:32:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fc4b111d-6e4c-49fe-bd91-b00f921f3d21 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-08fde90e-d8ba-4126-a037-64e310ba4ebb {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:21 devstack sudo[103882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-08fde90e-d8ba-4126-a037-64e310ba4ebb Sep 03 14:32:21 devstack sudo[103882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:21 devstack sudo[103878]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2f2185f0-8cf2-4290-9a4a-162cb34b23e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.431s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:21 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-2f2185f0-8cf2-4290-9a4a-162cb34b23e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:32:21 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-2f2185f0-8cf2-4290-9a4a-162cb34b23e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Deleted volume successfully. Sep 03 14:32:21 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2f2185f0-8cf2-4290-9a4a-162cb34b23e1 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "cinder-9cded960-b49c-4122-9c84-261855def8f1-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:32:21 devstack sudo[103882]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fc4b111d-6e4c-49fe-bd91-b00f921f3d21 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-08fde90e-d8ba-4126-a037-64e310ba4ebb" returned: 0 in 0.478s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fc4b111d-6e4c-49fe-bd91-b00f921f3d21 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-08fde90e-d8ba-4126-a037-64e310ba4ebb {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:21 devstack sudo[103903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-08fde90e-d8ba-4126-a037-64e310ba4ebb Sep 03 14:32:21 devstack sudo[103903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:22 devstack sudo[103903]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fc4b111d-6e4c-49fe-bd91-b00f921f3d21 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-08fde90e-d8ba-4126-a037-64e310ba4ebb" returned: 0 in 0.364s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-fc4b111d-6e4c-49fe-bd91-b00f921f3d21 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "cinder-quobyte-08fde90e-d8ba-4126-a037-64e310ba4ebb" released by "delete_volume" :: held 0.919s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:32:22 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-fc4b111d-6e4c-49fe-bd91-b00f921f3d21 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Created reservations ['8aea489c-a05d-4a17-b627-85a4daf3ff3e', 'fc29131d-f814-4867-bb47-640a071c1103', 'f096a17d-56ab-4ea2-b891-d4a426ccfdee', 'bf24d229-b448-4902-b7ef-b1c53e0603c7'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:32:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-fc4b111d-6e4c-49fe-bd91-b00f921f3d21 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:32:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-fc4b111d-6e4c-49fe-bd91-b00f921f3d21 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:32:22 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-fc4b111d-6e4c-49fe-bd91-b00f921f3d21 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:32:22 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-fc4b111d-6e4c-49fe-bd91-b00f921f3d21 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:32:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-fc4b111d-6e4c-49fe-bd91-b00f921f3d21 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:32:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fc4b111d-6e4c-49fe-bd91-b00f921f3d21 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:22 devstack sudo[103919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:32:22 devstack sudo[103919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7d6a13e0-f29e-4edf-b489-cdd5814711da tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Acquiring lock "cinder-028fb3d5-0127-407c-aae8-2c5ad6fc8294-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:32:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7d6a13e0-f29e-4edf-b489-cdd5814711da tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "cinder-028fb3d5-0127-407c-aae8-2c5ad6fc8294-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:32:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7d6a13e0-f29e-4edf-b489-cdd5814711da tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Acquiring lock "cinder-quobyte-028fb3d5-0127-407c-aae8-2c5ad6fc8294" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:32:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7d6a13e0-f29e-4edf-b489-cdd5814711da tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "cinder-quobyte-028fb3d5-0127-407c-aae8-2c5ad6fc8294" acquired by "delete_volume" :: waited 0.024s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:32:22 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a270c9a5-1a87-4d00-9feb-1ce089dec92d]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:32:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7d6a13e0-f29e-4edf-b489-cdd5814711da tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-028fb3d5-0127-407c-aae8-2c5ad6fc8294 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:22 devstack sudo[103919]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fc4b111d-6e4c-49fe-bd91-b00f921f3d21 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.327s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:22 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-fc4b111d-6e4c-49fe-bd91-b00f921f3d21 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:32:22 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-fc4b111d-6e4c-49fe-bd91-b00f921f3d21 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Deleted volume successfully. Sep 03 14:32:22 devstack sudo[103923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-028fb3d5-0127-407c-aae8-2c5ad6fc8294 Sep 03 14:32:22 devstack sudo[103923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-fc4b111d-6e4c-49fe-bd91-b00f921f3d21 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "cinder-08fde90e-d8ba-4126-a037-64e310ba4ebb-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:32:23 devstack sudo[103923]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7d6a13e0-f29e-4edf-b489-cdd5814711da tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-028fb3d5-0127-407c-aae8-2c5ad6fc8294" returned: 0 in 0.662s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7d6a13e0-f29e-4edf-b489-cdd5814711da tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-028fb3d5-0127-407c-aae8-2c5ad6fc8294 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:23 devstack sudo[103929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-028fb3d5-0127-407c-aae8-2c5ad6fc8294 Sep 03 14:32:23 devstack sudo[103929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:23 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-3ec4a87e-673b-458f-a4f9-90a66a6b5d59 req-6fda8694-6067-45e6-a8d2-d45e76568a2b tempest-TestInstancesWithCinderVolumes-1947083261 None] Terminate volume connection completed successfully. Sep 03 14:32:23 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-3ec4a87e-673b-458f-a4f9-90a66a6b5d59 req-6fda8694-6067-45e6-a8d2-d45e76568a2b tempest-TestInstancesWithCinderVolumes-1947083261 None] Deleting attachment 0f0800ec-d917-40f6-8b82-8f2956823803. {{(pid=87007) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 14:32:23 devstack sudo[103929]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7d6a13e0-f29e-4edf-b489-cdd5814711da tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-028fb3d5-0127-407c-aae8-2c5ad6fc8294" returned: 0 in 0.352s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:23 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7d6a13e0-f29e-4edf-b489-cdd5814711da tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "cinder-quobyte-028fb3d5-0127-407c-aae8-2c5ad6fc8294" released by "delete_volume" :: held 1.070s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:32:23 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-7d6a13e0-f29e-4edf-b489-cdd5814711da tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Created reservations ['d123cc76-82cd-4b30-a7a2-90479a94bc51', 'a2442785-ede7-4f17-8d65-0d621f9f2e15', '904530ad-ca2d-47c2-897d-105231415c1f', '79141383-4dda-409d-9987-1b95761484b3'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:32:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7d6a13e0-f29e-4edf-b489-cdd5814711da tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:32:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7d6a13e0-f29e-4edf-b489-cdd5814711da tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:32:23 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-7d6a13e0-f29e-4edf-b489-cdd5814711da tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:32:23 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-7d6a13e0-f29e-4edf-b489-cdd5814711da tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:32:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7d6a13e0-f29e-4edf-b489-cdd5814711da tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:32:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7d6a13e0-f29e-4edf-b489-cdd5814711da tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:23 devstack sudo[103934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:32:23 devstack sudo[103934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:24 devstack sudo[103934]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7d6a13e0-f29e-4edf-b489-cdd5814711da tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.281s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:24 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-7d6a13e0-f29e-4edf-b489-cdd5814711da tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:32:24 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-7d6a13e0-f29e-4edf-b489-cdd5814711da tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Deleted volume successfully. Sep 03 14:32:24 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7d6a13e0-f29e-4edf-b489-cdd5814711da tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "cinder-028fb3d5-0127-407c-aae8-2c5ad6fc8294-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:32:24 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-5c46c848-832b-46d3-be19-483bb9bb57b8 tempest-TestInstancesWithCinderVolumes-1947083261 None] Acquiring lock "cinder-87f6be89-cf67-4921-82a6-92506ede6580-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:32:24 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-5c46c848-832b-46d3-be19-483bb9bb57b8 tempest-TestInstancesWithCinderVolumes-1947083261 None] Lock "cinder-87f6be89-cf67-4921-82a6-92506ede6580-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:32:24 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-5c46c848-832b-46d3-be19-483bb9bb57b8 tempest-TestInstancesWithCinderVolumes-1947083261 None] Acquiring lock "cinder-quobyte-87f6be89-cf67-4921-82a6-92506ede6580" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:32:24 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-5c46c848-832b-46d3-be19-483bb9bb57b8 tempest-TestInstancesWithCinderVolumes-1947083261 None] Lock "cinder-quobyte-87f6be89-cf67-4921-82a6-92506ede6580" acquired by "delete_volume" :: waited 0.027s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:32:24 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a1e4d5-fb25-4a5a-ac88-3021fda2ff46]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:32:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5c46c848-832b-46d3-be19-483bb9bb57b8 tempest-TestInstancesWithCinderVolumes-1947083261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-87f6be89-cf67-4921-82a6-92506ede6580 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:24 devstack sudo[103942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-87f6be89-cf67-4921-82a6-92506ede6580 Sep 03 14:32:24 devstack sudo[103942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:24 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-017899f0-b06e-43c4-a427-2726c18f20d0 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Acquiring lock "cinder-6d7960b0-1c69-491d-a763-6c1897801d62-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:32:24 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-017899f0-b06e-43c4-a427-2726c18f20d0 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "cinder-6d7960b0-1c69-491d-a763-6c1897801d62-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:32:24 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-017899f0-b06e-43c4-a427-2726c18f20d0 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Acquiring lock "cinder-quobyte-6d7960b0-1c69-491d-a763-6c1897801d62" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:32:24 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-017899f0-b06e-43c4-a427-2726c18f20d0 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "cinder-quobyte-6d7960b0-1c69-491d-a763-6c1897801d62" acquired by "delete_volume" :: waited 0.038s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:32:24 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6359339c-e13f-41f4-8e47-76184fb89a8e]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:32:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-017899f0-b06e-43c4-a427-2726c18f20d0 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6d7960b0-1c69-491d-a763-6c1897801d62 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:25 devstack sudo[103942]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5c46c848-832b-46d3-be19-483bb9bb57b8 tempest-TestInstancesWithCinderVolumes-1947083261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-87f6be89-cf67-4921-82a6-92506ede6580" returned: 0 in 0.571s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5c46c848-832b-46d3-be19-483bb9bb57b8 tempest-TestInstancesWithCinderVolumes-1947083261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-87f6be89-cf67-4921-82a6-92506ede6580 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:25 devstack sudo[103954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-87f6be89-cf67-4921-82a6-92506ede6580 Sep 03 14:32:25 devstack sudo[103954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:25 devstack sudo[103950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6d7960b0-1c69-491d-a763-6c1897801d62 Sep 03 14:32:25 devstack sudo[103950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:25 devstack sudo[103954]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5c46c848-832b-46d3-be19-483bb9bb57b8 tempest-TestInstancesWithCinderVolumes-1947083261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-87f6be89-cf67-4921-82a6-92506ede6580" returned: 0 in 0.458s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:25 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-5c46c848-832b-46d3-be19-483bb9bb57b8 tempest-TestInstancesWithCinderVolumes-1947083261 None] Lock "cinder-quobyte-87f6be89-cf67-4921-82a6-92506ede6580" released by "delete_volume" :: held 1.107s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:32:25 devstack sudo[103950]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-017899f0-b06e-43c4-a427-2726c18f20d0 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6d7960b0-1c69-491d-a763-6c1897801d62" returned: 0 in 0.594s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-017899f0-b06e-43c4-a427-2726c18f20d0 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6d7960b0-1c69-491d-a763-6c1897801d62 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:25 devstack cinder-volume[87007]: WARNING cinder.quota [None req-5c46c848-832b-46d3-be19-483bb9bb57b8 tempest-TestInstancesWithCinderVolumes-1947083261 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1075500264-1096608085 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1075500264-1096608085, it is now deprecated. Please use the default quota class for default quota. Sep 03 14:32:25 devstack cinder-volume[87007]: WARNING cinder.quota [None req-5c46c848-832b-46d3-be19-483bb9bb57b8 tempest-TestInstancesWithCinderVolumes-1947083261 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1075500264-1096608085 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1075500264-1096608085, it is now deprecated. Please use the default quota class for default quota. Sep 03 14:32:25 devstack sudo[103961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6d7960b0-1c69-491d-a763-6c1897801d62 Sep 03 14:32:25 devstack sudo[103961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:25 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-5c46c848-832b-46d3-be19-483bb9bb57b8 tempest-TestInstancesWithCinderVolumes-1947083261 None] Created reservations ['b22b364f-cc8b-4196-9ce8-eac2660a84d7', '2598109e-8fb5-4a98-a672-6668f7beae4a', '2e5f9ed0-c9ae-4201-a073-e4d74415b602', '60e6bcc5-dba1-43b3-8658-0088b50594af'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:32:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-5c46c848-832b-46d3-be19-483bb9bb57b8 tempest-TestInstancesWithCinderVolumes-1947083261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:32:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-5c46c848-832b-46d3-be19-483bb9bb57b8 tempest-TestInstancesWithCinderVolumes-1947083261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:32:25 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-5c46c848-832b-46d3-be19-483bb9bb57b8 tempest-TestInstancesWithCinderVolumes-1947083261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:32:25 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-5c46c848-832b-46d3-be19-483bb9bb57b8 tempest-TestInstancesWithCinderVolumes-1947083261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:32:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-5c46c848-832b-46d3-be19-483bb9bb57b8 tempest-TestInstancesWithCinderVolumes-1947083261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:32:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5c46c848-832b-46d3-be19-483bb9bb57b8 tempest-TestInstancesWithCinderVolumes-1947083261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:25 devstack sudo[103963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:32:25 devstack sudo[103963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:25 devstack sudo[103961]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-017899f0-b06e-43c4-a427-2726c18f20d0 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6d7960b0-1c69-491d-a763-6c1897801d62" returned: 0 in 0.374s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:25 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-017899f0-b06e-43c4-a427-2726c18f20d0 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "cinder-quobyte-6d7960b0-1c69-491d-a763-6c1897801d62" released by "delete_volume" :: held 1.020s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:32:26 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-017899f0-b06e-43c4-a427-2726c18f20d0 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Created reservations ['ab1da091-507b-49d2-b5c1-3ecce666da4e', '23cdd98b-8d2d-4eb6-b35a-6eab94c98566', '1d3bb4f5-75f1-483f-8187-5956d0e671c1', '62600f34-521d-4be4-a137-18524ccce0c4'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:32:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-017899f0-b06e-43c4-a427-2726c18f20d0 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:32:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-017899f0-b06e-43c4-a427-2726c18f20d0 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:32:26 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-017899f0-b06e-43c4-a427-2726c18f20d0 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:32:26 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-017899f0-b06e-43c4-a427-2726c18f20d0 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:32:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-017899f0-b06e-43c4-a427-2726c18f20d0 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:32:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-017899f0-b06e-43c4-a427-2726c18f20d0 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:26 devstack sudo[103966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:32:26 devstack sudo[103966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:26 devstack sudo[103963]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5c46c848-832b-46d3-be19-483bb9bb57b8 tempest-TestInstancesWithCinderVolumes-1947083261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.535s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:26 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-5c46c848-832b-46d3-be19-483bb9bb57b8 tempest-TestInstancesWithCinderVolumes-1947083261 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:32:26 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-5c46c848-832b-46d3-be19-483bb9bb57b8 tempest-TestInstancesWithCinderVolumes-1947083261 None] Deleted volume successfully. Sep 03 14:32:26 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-5c46c848-832b-46d3-be19-483bb9bb57b8 tempest-TestInstancesWithCinderVolumes-1947083261 None] Lock "cinder-87f6be89-cf67-4921-82a6-92506ede6580-delete_volume" released by "delete_volume" :: held 1.996s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:32:26 devstack sudo[103966]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-017899f0-b06e-43c4-a427-2726c18f20d0 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.329s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:26 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-017899f0-b06e-43c4-a427-2726c18f20d0 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:32:26 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-017899f0-b06e-43c4-a427-2726c18f20d0 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Deleted volume successfully. Sep 03 14:32:26 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-017899f0-b06e-43c4-a427-2726c18f20d0 tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "cinder-6d7960b0-1c69-491d-a763-6c1897801d62-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:32:27 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ffeb4f37-ed61-426b-8e70-2db027dd1dce tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Acquiring lock "cinder-1941ee8f-d8f7-4bcd-8bf6-8c310d83b3ab-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:32:27 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ffeb4f37-ed61-426b-8e70-2db027dd1dce tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "cinder-1941ee8f-d8f7-4bcd-8bf6-8c310d83b3ab-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:32:27 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ffeb4f37-ed61-426b-8e70-2db027dd1dce tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Acquiring lock "cinder-quobyte-1941ee8f-d8f7-4bcd-8bf6-8c310d83b3ab" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:32:27 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ffeb4f37-ed61-426b-8e70-2db027dd1dce tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "cinder-quobyte-1941ee8f-d8f7-4bcd-8bf6-8c310d83b3ab" acquired by "delete_volume" :: waited 0.027s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:32:27 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d3838e-f933-4992-8ae1-347ab3cb739e]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:32:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffeb4f37-ed61-426b-8e70-2db027dd1dce tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1941ee8f-d8f7-4bcd-8bf6-8c310d83b3ab {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:27 devstack sudo[103979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1941ee8f-d8f7-4bcd-8bf6-8c310d83b3ab Sep 03 14:32:27 devstack sudo[103979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffeb4f37-ed61-426b-8e70-2db027dd1dce tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1941ee8f-d8f7-4bcd-8bf6-8c310d83b3ab" returned: 0 in 0.532s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffeb4f37-ed61-426b-8e70-2db027dd1dce tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1941ee8f-d8f7-4bcd-8bf6-8c310d83b3ab {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:27 devstack sudo[103979]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:28 devstack sudo[103996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1941ee8f-d8f7-4bcd-8bf6-8c310d83b3ab Sep 03 14:32:28 devstack sudo[103996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:28 devstack sudo[103996]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffeb4f37-ed61-426b-8e70-2db027dd1dce tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1941ee8f-d8f7-4bcd-8bf6-8c310d83b3ab" returned: 0 in 0.401s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:28 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ffeb4f37-ed61-426b-8e70-2db027dd1dce tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "cinder-quobyte-1941ee8f-d8f7-4bcd-8bf6-8c310d83b3ab" released by "delete_volume" :: held 1.021s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:32:28 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-ffeb4f37-ed61-426b-8e70-2db027dd1dce tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Created reservations ['bb7f52a2-dbde-4e1d-9684-7928f1e976a9', 'e8361031-63cd-42b0-b70f-494926f70adc', '305f580f-f25d-437c-85fb-d1c79cf4e906', 'f6ea0c2a-faf4-4e8d-948e-ef0e68666d40'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:32:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffeb4f37-ed61-426b-8e70-2db027dd1dce tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:32:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffeb4f37-ed61-426b-8e70-2db027dd1dce tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:32:28 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ffeb4f37-ed61-426b-8e70-2db027dd1dce tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:32:28 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ffeb4f37-ed61-426b-8e70-2db027dd1dce tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:32:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffeb4f37-ed61-426b-8e70-2db027dd1dce tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:32:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffeb4f37-ed61-426b-8e70-2db027dd1dce tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:28 devstack sudo[104003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:32:28 devstack sudo[104003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:28 devstack sudo[104003]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffeb4f37-ed61-426b-8e70-2db027dd1dce tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.345s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:28 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-ffeb4f37-ed61-426b-8e70-2db027dd1dce tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:32:28 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-ffeb4f37-ed61-426b-8e70-2db027dd1dce tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Deleted volume successfully. Sep 03 14:32:28 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ffeb4f37-ed61-426b-8e70-2db027dd1dce tempest-CreateVolumesFromSourceVolumeTest-1675445474 None] Lock "cinder-1941ee8f-d8f7-4bcd-8bf6-8c310d83b3ab-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:32:29 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-4f9a1c91-6794-4d54-8867-1dd9662be5e6 req-c523d282-a8fa-4dad-9a49-1d2189d90ffb tempest-TestInstancesWithCinderVolumes-1947083261 None] Terminate volume connection completed successfully. Sep 03 14:32:29 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-4f9a1c91-6794-4d54-8867-1dd9662be5e6 req-c523d282-a8fa-4dad-9a49-1d2189d90ffb tempest-TestInstancesWithCinderVolumes-1947083261 None] Deleting attachment 4ef39d2f-873d-45c8-a70f-598f35a849ae. {{(pid=87007) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 14:32:29 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-bd9c15a3-98af-4855-9f49-53d276741e01 tempest-TestInstancesWithCinderVolumes-1947083261 None] Acquiring lock "cinder-5b7648e3-cb7f-428c-9792-061d8e214562-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:32:29 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-bd9c15a3-98af-4855-9f49-53d276741e01 tempest-TestInstancesWithCinderVolumes-1947083261 None] Lock "cinder-5b7648e3-cb7f-428c-9792-061d8e214562-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:32:29 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-bd9c15a3-98af-4855-9f49-53d276741e01 tempest-TestInstancesWithCinderVolumes-1947083261 None] Acquiring lock "cinder-quobyte-5b7648e3-cb7f-428c-9792-061d8e214562" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:32:29 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-bd9c15a3-98af-4855-9f49-53d276741e01 tempest-TestInstancesWithCinderVolumes-1947083261 None] Lock "cinder-quobyte-5b7648e3-cb7f-428c-9792-061d8e214562" acquired by "delete_volume" :: waited 0.022s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:32:30 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[695ddc2e-c364-4edc-9716-850e1ab21c71]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:32:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bd9c15a3-98af-4855-9f49-53d276741e01 tempest-TestInstancesWithCinderVolumes-1947083261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5b7648e3-cb7f-428c-9792-061d8e214562 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:30 devstack sudo[104008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5b7648e3-cb7f-428c-9792-061d8e214562 Sep 03 14:32:30 devstack sudo[104008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:30 devstack sudo[104008]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bd9c15a3-98af-4855-9f49-53d276741e01 tempest-TestInstancesWithCinderVolumes-1947083261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5b7648e3-cb7f-428c-9792-061d8e214562" returned: 0 in 0.471s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bd9c15a3-98af-4855-9f49-53d276741e01 tempest-TestInstancesWithCinderVolumes-1947083261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5b7648e3-cb7f-428c-9792-061d8e214562 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:30 devstack sudo[104013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5b7648e3-cb7f-428c-9792-061d8e214562 Sep 03 14:32:30 devstack sudo[104013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:30 devstack sudo[104013]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bd9c15a3-98af-4855-9f49-53d276741e01 tempest-TestInstancesWithCinderVolumes-1947083261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5b7648e3-cb7f-428c-9792-061d8e214562" returned: 0 in 0.302s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:30 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-bd9c15a3-98af-4855-9f49-53d276741e01 tempest-TestInstancesWithCinderVolumes-1947083261 None] Lock "cinder-quobyte-5b7648e3-cb7f-428c-9792-061d8e214562" released by "delete_volume" :: held 0.848s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:32:30 devstack cinder-volume[87007]: WARNING cinder.quota [None req-bd9c15a3-98af-4855-9f49-53d276741e01 tempest-TestInstancesWithCinderVolumes-1947083261 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1845957037-273224755 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1845957037-273224755, it is now deprecated. Please use the default quota class for default quota. Sep 03 14:32:30 devstack cinder-volume[87007]: WARNING cinder.quota [None req-bd9c15a3-98af-4855-9f49-53d276741e01 tempest-TestInstancesWithCinderVolumes-1947083261 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1845957037-273224755 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1845957037-273224755, it is now deprecated. Please use the default quota class for default quota. Sep 03 14:32:30 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-bd9c15a3-98af-4855-9f49-53d276741e01 tempest-TestInstancesWithCinderVolumes-1947083261 None] Created reservations ['fc58cc2a-332b-4ef1-9fae-6de66fda4e65', '35da3c35-ee70-4c6d-ba4d-85ceee5fc7f5', '10b715b3-2854-4191-9f08-042aa9af2c2d', 'c3674210-f988-4b66-bccf-057a84396ec3'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:32:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-bd9c15a3-98af-4855-9f49-53d276741e01 tempest-TestInstancesWithCinderVolumes-1947083261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:32:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-bd9c15a3-98af-4855-9f49-53d276741e01 tempest-TestInstancesWithCinderVolumes-1947083261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:32:30 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-bd9c15a3-98af-4855-9f49-53d276741e01 tempest-TestInstancesWithCinderVolumes-1947083261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:32:30 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-bd9c15a3-98af-4855-9f49-53d276741e01 tempest-TestInstancesWithCinderVolumes-1947083261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:32:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-bd9c15a3-98af-4855-9f49-53d276741e01 tempest-TestInstancesWithCinderVolumes-1947083261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:32:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bd9c15a3-98af-4855-9f49-53d276741e01 tempest-TestInstancesWithCinderVolumes-1947083261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:31 devstack sudo[104016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:32:31 devstack sudo[104016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:31 devstack sudo[104016]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bd9c15a3-98af-4855-9f49-53d276741e01 tempest-TestInstancesWithCinderVolumes-1947083261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.361s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:31 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-bd9c15a3-98af-4855-9f49-53d276741e01 tempest-TestInstancesWithCinderVolumes-1947083261 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:32:31 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-bd9c15a3-98af-4855-9f49-53d276741e01 tempest-TestInstancesWithCinderVolumes-1947083261 None] Deleted volume successfully. Sep 03 14:32:31 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-bd9c15a3-98af-4855-9f49-53d276741e01 tempest-TestInstancesWithCinderVolumes-1947083261 None] Lock "cinder-5b7648e3-cb7f-428c-9792-061d8e214562-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:32:34 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cae7f58-5cb2-4a48-bb15-09907adb9f18 tempest-ProjectReaderTests-423436638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:32:34 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7cae7f58-5cb2-4a48-bb15-09907adb9f18 tempest-ProjectReaderTests-423436638 None] Flow 'volume_create_manager' (cbb9b273-adbb-4264-933c-a8f6d55f6003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:32:34 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7cae7f58-5cb2-4a48-bb15-09907adb9f18 tempest-ProjectReaderTests-423436638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (275a4cba-7bfc-48d4-9dd3-ef6923de7523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:34 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7cae7f58-5cb2-4a48-bb15-09907adb9f18 tempest-ProjectReaderTests-423436638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (275a4cba-7bfc-48d4-9dd3-ef6923de7523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-426714512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36bc992d-4bfa-428b-b613-c5addc67ad61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92a71e240d324f30a58eaef5861958d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:32:34Z,use_quota=True,user_id='f89638ba76734799957038dedc2fcb7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:34 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7cae7f58-5cb2-4a48-bb15-09907adb9f18 tempest-ProjectReaderTests-423436638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b07f0125-36d4-42d1-89c4-85e05352170d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:34 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7cae7f58-5cb2-4a48-bb15-09907adb9f18 tempest-ProjectReaderTests-423436638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b07f0125-36d4-42d1-89c4-85e05352170d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:34 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7cae7f58-5cb2-4a48-bb15-09907adb9f18 tempest-ProjectReaderTests-423436638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd61cd03-f841-4192-9cf4-d266b2983b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:34 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7cae7f58-5cb2-4a48-bb15-09907adb9f18 tempest-ProjectReaderTests-423436638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd61cd03-f841-4192-9cf4-d266b2983b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36bc992d-4bfa-428b-b613-c5addc67ad61', 'volume_name': 'volume-36bc992d-4bfa-428b-b613-c5addc67ad61', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:34 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7cae7f58-5cb2-4a48-bb15-09907adb9f18 tempest-ProjectReaderTests-423436638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faad260c-03cb-45b8-9837-dd5de2ac2700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:34 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7cae7f58-5cb2-4a48-bb15-09907adb9f18 tempest-ProjectReaderTests-423436638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faad260c-03cb-45b8-9837-dd5de2ac2700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:34 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7cae7f58-5cb2-4a48-bb15-09907adb9f18 tempest-ProjectReaderTests-423436638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e204ad5-7dc5-4427-8f36-30b9fc9ba379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:34 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-7cae7f58-5cb2-4a48-bb15-09907adb9f18 tempest-ProjectReaderTests-423436638 None] Volume 36bc992d-4bfa-428b-b613-c5addc67ad61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36bc992d-4bfa-428b-b613-c5addc67ad61', 'volume_size': 1} Sep 03 14:32:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7cae7f58-5cb2-4a48-bb15-09907adb9f18 tempest-ProjectReaderTests-423436638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:32:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7cae7f58-5cb2-4a48-bb15-09907adb9f18 tempest-ProjectReaderTests-423436638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:32:34 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-7cae7f58-5cb2-4a48-bb15-09907adb9f18 tempest-ProjectReaderTests-423436638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-426714512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36bc992d-4bfa-428b-b613-c5addc67ad61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92a71e240d324f30a58eaef5861958d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:32:34Z,use_quota=True,user_id='f89638ba76734799957038dedc2fcb7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:32:34 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-7cae7f58-5cb2-4a48-bb15-09907adb9f18 tempest-ProjectReaderTests-423436638 None] Creating volume 36bc992d-4bfa-428b-b613-c5addc67ad61 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:32:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7cae7f58-5cb2-4a48-bb15-09907adb9f18 tempest-ProjectReaderTests-423436638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:32:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7cae7f58-5cb2-4a48-bb15-09907adb9f18 tempest-ProjectReaderTests-423436638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:32:34 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-7cae7f58-5cb2-4a48-bb15-09907adb9f18 tempest-ProjectReaderTests-423436638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:32:34 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-7cae7f58-5cb2-4a48-bb15-09907adb9f18 tempest-ProjectReaderTests-423436638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:32:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7cae7f58-5cb2-4a48-bb15-09907adb9f18 tempest-ProjectReaderTests-423436638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:32:34 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-7cae7f58-5cb2-4a48-bb15-09907adb9f18 tempest-ProjectReaderTests-423436638 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:32:34 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-7cae7f58-5cb2-4a48-bb15-09907adb9f18 tempest-ProjectReaderTests-423436638 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:32:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7cae7f58-5cb2-4a48-bb15-09907adb9f18 tempest-ProjectReaderTests-423436638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36bc992d-4bfa-428b-b613-c5addc67ad61 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:34 devstack sudo[104045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36bc992d-4bfa-428b-b613-c5addc67ad61 1073741824 Sep 03 14:32:34 devstack sudo[104045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:35 devstack sudo[104045]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7cae7f58-5cb2-4a48-bb15-09907adb9f18 tempest-ProjectReaderTests-423436638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36bc992d-4bfa-428b-b613-c5addc67ad61 1073741824" returned: 0 in 0.539s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7cae7f58-5cb2-4a48-bb15-09907adb9f18 tempest-ProjectReaderTests-423436638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36bc992d-4bfa-428b-b613-c5addc67ad61 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:35 devstack sudo[104051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36bc992d-4bfa-428b-b613-c5addc67ad61 Sep 03 14:32:35 devstack sudo[104051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:35 devstack sudo[104051]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7cae7f58-5cb2-4a48-bb15-09907adb9f18 tempest-ProjectReaderTests-423436638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36bc992d-4bfa-428b-b613-c5addc67ad61" returned: 0 in 0.266s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:35 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-7cae7f58-5cb2-4a48-bb15-09907adb9f18 tempest-ProjectReaderTests-423436638 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:32:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7cae7f58-5cb2-4a48-bb15-09907adb9f18 tempest-ProjectReaderTests-423436638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:32:35 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7cae7f58-5cb2-4a48-bb15-09907adb9f18 tempest-ProjectReaderTests-423436638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e204ad5-7dc5-4427-8f36-30b9fc9ba379) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36bc992d-4bfa-428b-b613-c5addc67ad61', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:35 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7cae7f58-5cb2-4a48-bb15-09907adb9f18 tempest-ProjectReaderTests-423436638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fe6c295-5fa5-488d-941e-ea350d530184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:35 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-7cae7f58-5cb2-4a48-bb15-09907adb9f18 tempest-ProjectReaderTests-423436638 None] Volume volume-36bc992d-4bfa-428b-b613-c5addc67ad61 (36bc992d-4bfa-428b-b613-c5addc67ad61): created successfully Sep 03 14:32:35 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7cae7f58-5cb2-4a48-bb15-09907adb9f18 tempest-ProjectReaderTests-423436638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fe6c295-5fa5-488d-941e-ea350d530184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:35 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7cae7f58-5cb2-4a48-bb15-09907adb9f18 tempest-ProjectReaderTests-423436638 None] Flow 'volume_create_manager' (cbb9b273-adbb-4264-933c-a8f6d55f6003) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:32:35 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-7cae7f58-5cb2-4a48-bb15-09907adb9f18 tempest-ProjectReaderTests-423436638 None] Created volume successfully. Sep 03 14:32:36 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-76b4a024-6d1a-4f94-89de-06a69b795a0d tempest-ProjectReaderTests-423436638 None] Acquiring lock "cinder-36bc992d-4bfa-428b-b613-c5addc67ad61-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:32:36 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-76b4a024-6d1a-4f94-89de-06a69b795a0d tempest-ProjectReaderTests-423436638 None] Lock "cinder-36bc992d-4bfa-428b-b613-c5addc67ad61-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:32:36 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-76b4a024-6d1a-4f94-89de-06a69b795a0d tempest-ProjectReaderTests-423436638 None] Acquiring lock "cinder-quobyte-36bc992d-4bfa-428b-b613-c5addc67ad61" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:32:36 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-76b4a024-6d1a-4f94-89de-06a69b795a0d tempest-ProjectReaderTests-423436638 None] Lock "cinder-quobyte-36bc992d-4bfa-428b-b613-c5addc67ad61" acquired by "delete_volume" :: waited 0.029s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:32:36 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[16867319-8003-4b22-a29c-c74888cd452d]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:32:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-76b4a024-6d1a-4f94-89de-06a69b795a0d tempest-ProjectReaderTests-423436638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36bc992d-4bfa-428b-b613-c5addc67ad61 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:36 devstack sudo[104056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36bc992d-4bfa-428b-b613-c5addc67ad61 Sep 03 14:32:36 devstack sudo[104056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:36 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-e4d24c55-9ffb-4d74-8d82-3e65e18a553c req-2ce61b8c-d8c6-40a7-b521-8fea8ece79ce tempest-TestInstancesWithCinderVolumes-1947083261 None] Terminate volume connection completed successfully. Sep 03 14:32:36 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-e4d24c55-9ffb-4d74-8d82-3e65e18a553c req-2ce61b8c-d8c6-40a7-b521-8fea8ece79ce tempest-TestInstancesWithCinderVolumes-1947083261 None] Deleting attachment f9075f07-5fcc-4054-8124-da30cac8cced. {{(pid=87007) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 14:32:37 devstack sudo[104056]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-76b4a024-6d1a-4f94-89de-06a69b795a0d tempest-ProjectReaderTests-423436638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36bc992d-4bfa-428b-b613-c5addc67ad61" returned: 0 in 0.510s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-76b4a024-6d1a-4f94-89de-06a69b795a0d tempest-ProjectReaderTests-423436638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36bc992d-4bfa-428b-b613-c5addc67ad61 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:37 devstack sudo[104062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36bc992d-4bfa-428b-b613-c5addc67ad61 Sep 03 14:32:37 devstack sudo[104062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:37 devstack sudo[104062]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-76b4a024-6d1a-4f94-89de-06a69b795a0d tempest-ProjectReaderTests-423436638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36bc992d-4bfa-428b-b613-c5addc67ad61" returned: 0 in 0.377s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:37 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-76b4a024-6d1a-4f94-89de-06a69b795a0d tempest-ProjectReaderTests-423436638 None] Lock "cinder-quobyte-36bc992d-4bfa-428b-b613-c5addc67ad61" released by "delete_volume" :: held 0.960s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:32:37 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-76b4a024-6d1a-4f94-89de-06a69b795a0d tempest-ProjectReaderTests-423436638 None] Created reservations ['af324163-be33-43c1-b160-c4348b0a4634', 'e8f3faa1-5f22-4f7a-9325-5db2bf364459', '288d4da8-d247-4436-9d1a-1cbd8a7d8e48', '6b1c0681-2b59-43ae-9761-ab45c72e5c91'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:32:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-76b4a024-6d1a-4f94-89de-06a69b795a0d tempest-ProjectReaderTests-423436638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:32:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-76b4a024-6d1a-4f94-89de-06a69b795a0d tempest-ProjectReaderTests-423436638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:32:37 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-76b4a024-6d1a-4f94-89de-06a69b795a0d tempest-ProjectReaderTests-423436638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:32:37 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-76b4a024-6d1a-4f94-89de-06a69b795a0d tempest-ProjectReaderTests-423436638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:32:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-76b4a024-6d1a-4f94-89de-06a69b795a0d tempest-ProjectReaderTests-423436638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:32:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-76b4a024-6d1a-4f94-89de-06a69b795a0d tempest-ProjectReaderTests-423436638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:37 devstack sudo[104065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:32:37 devstack sudo[104065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:37 devstack sudo[104065]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-76b4a024-6d1a-4f94-89de-06a69b795a0d tempest-ProjectReaderTests-423436638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.306s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:37 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-76b4a024-6d1a-4f94-89de-06a69b795a0d tempest-ProjectReaderTests-423436638 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:32:38 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-76b4a024-6d1a-4f94-89de-06a69b795a0d tempest-ProjectReaderTests-423436638 None] Deleted volume successfully. Sep 03 14:32:38 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-76b4a024-6d1a-4f94-89de-06a69b795a0d tempest-ProjectReaderTests-423436638 None] Lock "cinder-36bc992d-4bfa-428b-b613-c5addc67ad61-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:32:38 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-945b70c7-3b93-40fb-89e5-fbdcc6f5db84 tempest-TestInstancesWithCinderVolumes-1947083261 None] Acquiring lock "cinder-b4812ac4-d9e3-41fd-8a67-cc8e8cbf66c6-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:32:38 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-945b70c7-3b93-40fb-89e5-fbdcc6f5db84 tempest-TestInstancesWithCinderVolumes-1947083261 None] Lock "cinder-b4812ac4-d9e3-41fd-8a67-cc8e8cbf66c6-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:32:38 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-945b70c7-3b93-40fb-89e5-fbdcc6f5db84 tempest-TestInstancesWithCinderVolumes-1947083261 None] Acquiring lock "cinder-quobyte-b4812ac4-d9e3-41fd-8a67-cc8e8cbf66c6" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:32:38 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-945b70c7-3b93-40fb-89e5-fbdcc6f5db84 tempest-TestInstancesWithCinderVolumes-1947083261 None] Lock "cinder-quobyte-b4812ac4-d9e3-41fd-8a67-cc8e8cbf66c6" acquired by "delete_volume" :: waited 0.029s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:32:38 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e10fae-e148-406c-bfb9-4af18f38515e]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:32:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-945b70c7-3b93-40fb-89e5-fbdcc6f5db84 tempest-TestInstancesWithCinderVolumes-1947083261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b4812ac4-d9e3-41fd-8a67-cc8e8cbf66c6 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:38 devstack sudo[104068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b4812ac4-d9e3-41fd-8a67-cc8e8cbf66c6 Sep 03 14:32:38 devstack sudo[104068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:39 devstack sudo[104068]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-945b70c7-3b93-40fb-89e5-fbdcc6f5db84 tempest-TestInstancesWithCinderVolumes-1947083261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b4812ac4-d9e3-41fd-8a67-cc8e8cbf66c6" returned: 0 in 0.447s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-945b70c7-3b93-40fb-89e5-fbdcc6f5db84 tempest-TestInstancesWithCinderVolumes-1947083261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b4812ac4-d9e3-41fd-8a67-cc8e8cbf66c6 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:39 devstack sudo[104073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b4812ac4-d9e3-41fd-8a67-cc8e8cbf66c6 Sep 03 14:32:39 devstack sudo[104073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:39 devstack sudo[104073]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-945b70c7-3b93-40fb-89e5-fbdcc6f5db84 tempest-TestInstancesWithCinderVolumes-1947083261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b4812ac4-d9e3-41fd-8a67-cc8e8cbf66c6" returned: 0 in 0.463s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:39 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-945b70c7-3b93-40fb-89e5-fbdcc6f5db84 tempest-TestInstancesWithCinderVolumes-1947083261 None] Lock "cinder-quobyte-b4812ac4-d9e3-41fd-8a67-cc8e8cbf66c6" released by "delete_volume" :: held 0.966s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:32:39 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab52ea52-ccc6-4aab-a6f8-51a55ab8a3ba tempest-ProjectReaderTests-423436638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:32:39 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ab52ea52-ccc6-4aab-a6f8-51a55ab8a3ba tempest-ProjectReaderTests-423436638 None] Flow 'volume_create_manager' (e6b70a13-3232-4702-b21a-984c1331b01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:32:39 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ab52ea52-ccc6-4aab-a6f8-51a55ab8a3ba tempest-ProjectReaderTests-423436638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (525cd94c-0cc6-4047-b0b8-c05ab38ca07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:39 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ab52ea52-ccc6-4aab-a6f8-51a55ab8a3ba tempest-ProjectReaderTests-423436638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (525cd94c-0cc6-4047-b0b8-c05ab38ca07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2059102393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18768895-e7ef-430a-9b5d-0cedf66cffb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92a71e240d324f30a58eaef5861958d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:32:40Z,use_quota=True,user_id='f89638ba76734799957038dedc2fcb7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:39 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ab52ea52-ccc6-4aab-a6f8-51a55ab8a3ba tempest-ProjectReaderTests-423436638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3aff150-1621-45af-88d7-f865407177e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:39 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ab52ea52-ccc6-4aab-a6f8-51a55ab8a3ba tempest-ProjectReaderTests-423436638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3aff150-1621-45af-88d7-f865407177e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:39 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ab52ea52-ccc6-4aab-a6f8-51a55ab8a3ba tempest-ProjectReaderTests-423436638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09e7b49e-9d71-4b56-a17c-0cbed05230e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:39 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ab52ea52-ccc6-4aab-a6f8-51a55ab8a3ba tempest-ProjectReaderTests-423436638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09e7b49e-9d71-4b56-a17c-0cbed05230e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18768895-e7ef-430a-9b5d-0cedf66cffb8', 'volume_name': 'volume-18768895-e7ef-430a-9b5d-0cedf66cffb8', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:39 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ab52ea52-ccc6-4aab-a6f8-51a55ab8a3ba tempest-ProjectReaderTests-423436638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (942e110e-1220-4852-ab71-1bf557716d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:39 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ab52ea52-ccc6-4aab-a6f8-51a55ab8a3ba tempest-ProjectReaderTests-423436638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (942e110e-1220-4852-ab71-1bf557716d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:39 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ab52ea52-ccc6-4aab-a6f8-51a55ab8a3ba tempest-ProjectReaderTests-423436638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (725f5ab8-035f-4a88-8b01-1c8aca72c545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:39 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-ab52ea52-ccc6-4aab-a6f8-51a55ab8a3ba tempest-ProjectReaderTests-423436638 None] Volume 18768895-e7ef-430a-9b5d-0cedf66cffb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18768895-e7ef-430a-9b5d-0cedf66cffb8', 'volume_size': 1} Sep 03 14:32:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ab52ea52-ccc6-4aab-a6f8-51a55ab8a3ba tempest-ProjectReaderTests-423436638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:32:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ab52ea52-ccc6-4aab-a6f8-51a55ab8a3ba tempest-ProjectReaderTests-423436638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:32:39 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ab52ea52-ccc6-4aab-a6f8-51a55ab8a3ba tempest-ProjectReaderTests-423436638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2059102393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18768895-e7ef-430a-9b5d-0cedf66cffb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92a71e240d324f30a58eaef5861958d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:32:40Z,use_quota=True,user_id='f89638ba76734799957038dedc2fcb7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:32:39 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-ab52ea52-ccc6-4aab-a6f8-51a55ab8a3ba tempest-ProjectReaderTests-423436638 None] Creating volume 18768895-e7ef-430a-9b5d-0cedf66cffb8 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:32:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ab52ea52-ccc6-4aab-a6f8-51a55ab8a3ba tempest-ProjectReaderTests-423436638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:32:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ab52ea52-ccc6-4aab-a6f8-51a55ab8a3ba tempest-ProjectReaderTests-423436638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:32:39 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ab52ea52-ccc6-4aab-a6f8-51a55ab8a3ba tempest-ProjectReaderTests-423436638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:32:39 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ab52ea52-ccc6-4aab-a6f8-51a55ab8a3ba tempest-ProjectReaderTests-423436638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:32:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ab52ea52-ccc6-4aab-a6f8-51a55ab8a3ba tempest-ProjectReaderTests-423436638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:32:39 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ab52ea52-ccc6-4aab-a6f8-51a55ab8a3ba tempest-ProjectReaderTests-423436638 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:32:39 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-ab52ea52-ccc6-4aab-a6f8-51a55ab8a3ba tempest-ProjectReaderTests-423436638 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:32:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ab52ea52-ccc6-4aab-a6f8-51a55ab8a3ba tempest-ProjectReaderTests-423436638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-18768895-e7ef-430a-9b5d-0cedf66cffb8 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:39 devstack cinder-volume[87007]: WARNING cinder.quota [None req-945b70c7-3b93-40fb-89e5-fbdcc6f5db84 tempest-TestInstancesWithCinderVolumes-1947083261 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2050705736-1597140793 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2050705736-1597140793, it is now deprecated. Please use the default quota class for default quota. Sep 03 14:32:39 devstack cinder-volume[87007]: WARNING cinder.quota [None req-945b70c7-3b93-40fb-89e5-fbdcc6f5db84 tempest-TestInstancesWithCinderVolumes-1947083261 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2050705736-1597140793 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2050705736-1597140793, it is now deprecated. Please use the default quota class for default quota. Sep 03 14:32:39 devstack sudo[104076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-18768895-e7ef-430a-9b5d-0cedf66cffb8 1073741824 Sep 03 14:32:39 devstack sudo[104076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:39 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-945b70c7-3b93-40fb-89e5-fbdcc6f5db84 tempest-TestInstancesWithCinderVolumes-1947083261 None] Created reservations ['19cab4cc-da65-4b27-a8dd-7ccd6aa53d7f', 'd13a2daa-fb7f-4933-8a52-8c9c1e2ae4d8', 'd9e80e58-cc61-4e2a-a0ce-8254a67a3918', 'b0a8c16e-f40d-451a-9a00-116d4b3700a1'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:32:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-945b70c7-3b93-40fb-89e5-fbdcc6f5db84 tempest-TestInstancesWithCinderVolumes-1947083261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:32:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-945b70c7-3b93-40fb-89e5-fbdcc6f5db84 tempest-TestInstancesWithCinderVolumes-1947083261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:32:39 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-945b70c7-3b93-40fb-89e5-fbdcc6f5db84 tempest-TestInstancesWithCinderVolumes-1947083261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:32:39 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-945b70c7-3b93-40fb-89e5-fbdcc6f5db84 tempest-TestInstancesWithCinderVolumes-1947083261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:32:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-945b70c7-3b93-40fb-89e5-fbdcc6f5db84 tempest-TestInstancesWithCinderVolumes-1947083261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:32:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-945b70c7-3b93-40fb-89e5-fbdcc6f5db84 tempest-TestInstancesWithCinderVolumes-1947083261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:39 devstack sudo[104078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:32:39 devstack sudo[104078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:40 devstack sudo[104078]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-945b70c7-3b93-40fb-89e5-fbdcc6f5db84 tempest-TestInstancesWithCinderVolumes-1947083261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.348s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:40 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-945b70c7-3b93-40fb-89e5-fbdcc6f5db84 tempest-TestInstancesWithCinderVolumes-1947083261 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:32:40 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-945b70c7-3b93-40fb-89e5-fbdcc6f5db84 tempest-TestInstancesWithCinderVolumes-1947083261 None] Deleted volume successfully. Sep 03 14:32:40 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-945b70c7-3b93-40fb-89e5-fbdcc6f5db84 tempest-TestInstancesWithCinderVolumes-1947083261 None] Lock "cinder-b4812ac4-d9e3-41fd-8a67-cc8e8cbf66c6-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:32:40 devstack sudo[104076]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ab52ea52-ccc6-4aab-a6f8-51a55ab8a3ba tempest-ProjectReaderTests-423436638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-18768895-e7ef-430a-9b5d-0cedf66cffb8 1073741824" returned: 0 in 0.625s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ab52ea52-ccc6-4aab-a6f8-51a55ab8a3ba tempest-ProjectReaderTests-423436638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-18768895-e7ef-430a-9b5d-0cedf66cffb8 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:40 devstack sudo[104085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-18768895-e7ef-430a-9b5d-0cedf66cffb8 Sep 03 14:32:40 devstack sudo[104085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:40 devstack sudo[104085]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ab52ea52-ccc6-4aab-a6f8-51a55ab8a3ba tempest-ProjectReaderTests-423436638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-18768895-e7ef-430a-9b5d-0cedf66cffb8" returned: 0 in 0.297s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:40 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ab52ea52-ccc6-4aab-a6f8-51a55ab8a3ba tempest-ProjectReaderTests-423436638 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:32:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ab52ea52-ccc6-4aab-a6f8-51a55ab8a3ba tempest-ProjectReaderTests-423436638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:32:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ab52ea52-ccc6-4aab-a6f8-51a55ab8a3ba tempest-ProjectReaderTests-423436638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (725f5ab8-035f-4a88-8b01-1c8aca72c545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18768895-e7ef-430a-9b5d-0cedf66cffb8', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ab52ea52-ccc6-4aab-a6f8-51a55ab8a3ba tempest-ProjectReaderTests-423436638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (911c2b61-8102-4f5f-8653-49f0fe62bd0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:40 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-ab52ea52-ccc6-4aab-a6f8-51a55ab8a3ba tempest-ProjectReaderTests-423436638 None] Volume volume-18768895-e7ef-430a-9b5d-0cedf66cffb8 (18768895-e7ef-430a-9b5d-0cedf66cffb8): created successfully Sep 03 14:32:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ab52ea52-ccc6-4aab-a6f8-51a55ab8a3ba tempest-ProjectReaderTests-423436638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (911c2b61-8102-4f5f-8653-49f0fe62bd0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ab52ea52-ccc6-4aab-a6f8-51a55ab8a3ba tempest-ProjectReaderTests-423436638 None] Flow 'volume_create_manager' (e6b70a13-3232-4702-b21a-984c1331b01c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:32:40 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-ab52ea52-ccc6-4aab-a6f8-51a55ab8a3ba tempest-ProjectReaderTests-423436638 None] Created volume successfully. Sep 03 14:32:41 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-872caf34-c47b-4c5e-9c81-530682f18d7a tempest-ProjectReaderTests-423436638 None] Acquiring lock "cinder-18768895-e7ef-430a-9b5d-0cedf66cffb8-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:32:41 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-872caf34-c47b-4c5e-9c81-530682f18d7a tempest-ProjectReaderTests-423436638 None] Lock "cinder-18768895-e7ef-430a-9b5d-0cedf66cffb8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:32:41 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-872caf34-c47b-4c5e-9c81-530682f18d7a tempest-ProjectReaderTests-423436638 None] Acquiring lock "cinder-quobyte-18768895-e7ef-430a-9b5d-0cedf66cffb8" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:32:41 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-872caf34-c47b-4c5e-9c81-530682f18d7a tempest-ProjectReaderTests-423436638 None] Lock "cinder-quobyte-18768895-e7ef-430a-9b5d-0cedf66cffb8" acquired by "delete_volume" :: waited 0.021s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:32:41 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[565d1c19-5763-4f5c-b0bb-369fad45add9]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:32:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-872caf34-c47b-4c5e-9c81-530682f18d7a tempest-ProjectReaderTests-423436638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-18768895-e7ef-430a-9b5d-0cedf66cffb8 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:41 devstack sudo[104104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-18768895-e7ef-430a-9b5d-0cedf66cffb8 Sep 03 14:32:41 devstack sudo[104104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:42 devstack sudo[104104]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-872caf34-c47b-4c5e-9c81-530682f18d7a tempest-ProjectReaderTests-423436638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-18768895-e7ef-430a-9b5d-0cedf66cffb8" returned: 0 in 0.519s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-872caf34-c47b-4c5e-9c81-530682f18d7a tempest-ProjectReaderTests-423436638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-18768895-e7ef-430a-9b5d-0cedf66cffb8 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:42 devstack sudo[104121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-18768895-e7ef-430a-9b5d-0cedf66cffb8 Sep 03 14:32:42 devstack sudo[104121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:42 devstack sudo[104121]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-872caf34-c47b-4c5e-9c81-530682f18d7a tempest-ProjectReaderTests-423436638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-18768895-e7ef-430a-9b5d-0cedf66cffb8" returned: 0 in 0.406s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:42 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-872caf34-c47b-4c5e-9c81-530682f18d7a tempest-ProjectReaderTests-423436638 None] Lock "cinder-quobyte-18768895-e7ef-430a-9b5d-0cedf66cffb8" released by "delete_volume" :: held 0.999s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:32:42 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-872caf34-c47b-4c5e-9c81-530682f18d7a tempest-ProjectReaderTests-423436638 None] Created reservations ['9f39496c-71f3-4cd1-affc-25c52b46a91a', 'b18db6c8-9919-4450-9686-fdb8d52a2109', '688c1377-fd0e-48fa-95ed-021cadd50680', '685ac79b-01e7-4d36-b5ee-5e8319bd13a9'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:32:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-872caf34-c47b-4c5e-9c81-530682f18d7a tempest-ProjectReaderTests-423436638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:32:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-872caf34-c47b-4c5e-9c81-530682f18d7a tempest-ProjectReaderTests-423436638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:32:42 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-872caf34-c47b-4c5e-9c81-530682f18d7a tempest-ProjectReaderTests-423436638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:32:42 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-872caf34-c47b-4c5e-9c81-530682f18d7a tempest-ProjectReaderTests-423436638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:32:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-872caf34-c47b-4c5e-9c81-530682f18d7a tempest-ProjectReaderTests-423436638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:32:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-872caf34-c47b-4c5e-9c81-530682f18d7a tempest-ProjectReaderTests-423436638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:42 devstack sudo[104124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:32:42 devstack sudo[104124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:43 devstack sudo[104124]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-872caf34-c47b-4c5e-9c81-530682f18d7a tempest-ProjectReaderTests-423436638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.308s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:43 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-872caf34-c47b-4c5e-9c81-530682f18d7a tempest-ProjectReaderTests-423436638 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:32:43 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-872caf34-c47b-4c5e-9c81-530682f18d7a tempest-ProjectReaderTests-423436638 None] Deleted volume successfully. Sep 03 14:32:43 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-872caf34-c47b-4c5e-9c81-530682f18d7a tempest-ProjectReaderTests-423436638 None] Lock "cinder-18768895-e7ef-430a-9b5d-0cedf66cffb8-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:32:51 devstack cinder-volume[87007]: DEBUG oslo_service.periodic_task [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87007) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 14:32:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:32:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:32:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:32:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:32:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:32:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:51 devstack sudo[104132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:32:51 devstack sudo[104132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:52 devstack sudo[104132]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.421s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:52 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:32:52 devstack cinder-volume[87007]: DEBUG oslo_service.periodic_task [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running periodic task VolumeManager._thread_info {{(pid=87007) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 14:32:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] thread count: 28 {{(pid=87007) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 14:32:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] thread info: [<_MainThread(MainThread, started 123689171054720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87007) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 14:32:52 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:UPDATE=125,cinder:SELECT=100,cinder:DELETE=15,cinder:INSERT=30 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:32:53 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:SELECT=102,cinder:UPDATE=131,cinder:INSERT=27,cinder:DELETE=6 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:32:58 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-89b96271-928c-4d67-8f1a-5eedf5a4e638 tempest-TestStampPattern-355266855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:32:58 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-89b96271-928c-4d67-8f1a-5eedf5a4e638 tempest-TestStampPattern-355266855 None] Flow 'volume_create_manager' (292c0dad-51e0-4f57-b03b-912f58c4b434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:32:58 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-89b96271-928c-4d67-8f1a-5eedf5a4e638 tempest-TestStampPattern-355266855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c202e3b1-3b57-4377-9e54-a5d43e2d63d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:58 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-89b96271-928c-4d67-8f1a-5eedf5a4e638 tempest-TestStampPattern-355266855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c202e3b1-3b57-4377-9e54-a5d43e2d63d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:32:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1852249235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c76b755-3a86-4b29-8abc-4cc21e32df6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7def88711b884bf491a7c4f6b37a9622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:32:58Z,use_quota=True,user_id='e636d32f5518424fa5de1a7d076b0362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:58 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-89b96271-928c-4d67-8f1a-5eedf5a4e638 tempest-TestStampPattern-355266855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b6b484e-34fd-4c97-bd22-8e9226ef4ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:58 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-89b96271-928c-4d67-8f1a-5eedf5a4e638 tempest-TestStampPattern-355266855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b6b484e-34fd-4c97-bd22-8e9226ef4ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:58 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-89b96271-928c-4d67-8f1a-5eedf5a4e638 tempest-TestStampPattern-355266855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad6787ec-1cb8-43cc-b9f8-64cac20e1358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:58 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-89b96271-928c-4d67-8f1a-5eedf5a4e638 tempest-TestStampPattern-355266855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad6787ec-1cb8-43cc-b9f8-64cac20e1358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c76b755-3a86-4b29-8abc-4cc21e32df6a', 'volume_name': 'volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:58 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-89b96271-928c-4d67-8f1a-5eedf5a4e638 tempest-TestStampPattern-355266855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (733ac9f0-7a7f-41fe-a7c0-e7518d55571e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:58 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-89b96271-928c-4d67-8f1a-5eedf5a4e638 tempest-TestStampPattern-355266855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (733ac9f0-7a7f-41fe-a7c0-e7518d55571e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:58 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-89b96271-928c-4d67-8f1a-5eedf5a4e638 tempest-TestStampPattern-355266855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31536086-263f-48f7-a6dd-5d716bf508de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:58 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-89b96271-928c-4d67-8f1a-5eedf5a4e638 tempest-TestStampPattern-355266855 None] Volume 7c76b755-3a86-4b29-8abc-4cc21e32df6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a', 'volume_size': 1} Sep 03 14:32:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-89b96271-928c-4d67-8f1a-5eedf5a4e638 tempest-TestStampPattern-355266855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:32:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-89b96271-928c-4d67-8f1a-5eedf5a4e638 tempest-TestStampPattern-355266855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:32:58 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-89b96271-928c-4d67-8f1a-5eedf5a4e638 tempest-TestStampPattern-355266855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:32:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1852249235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c76b755-3a86-4b29-8abc-4cc21e32df6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7def88711b884bf491a7c4f6b37a9622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:32:58Z,use_quota=True,user_id='e636d32f5518424fa5de1a7d076b0362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:32:58 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-89b96271-928c-4d67-8f1a-5eedf5a4e638 tempest-TestStampPattern-355266855 None] Creating volume 7c76b755-3a86-4b29-8abc-4cc21e32df6a {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:32:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-89b96271-928c-4d67-8f1a-5eedf5a4e638 tempest-TestStampPattern-355266855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:32:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-89b96271-928c-4d67-8f1a-5eedf5a4e638 tempest-TestStampPattern-355266855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:32:58 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-89b96271-928c-4d67-8f1a-5eedf5a4e638 tempest-TestStampPattern-355266855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:32:58 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-89b96271-928c-4d67-8f1a-5eedf5a4e638 tempest-TestStampPattern-355266855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:32:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-89b96271-928c-4d67-8f1a-5eedf5a4e638 tempest-TestStampPattern-355266855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:32:58 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-89b96271-928c-4d67-8f1a-5eedf5a4e638 tempest-TestStampPattern-355266855 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:32:58 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-89b96271-928c-4d67-8f1a-5eedf5a4e638 tempest-TestStampPattern-355266855 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:32:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-89b96271-928c-4d67-8f1a-5eedf5a4e638 tempest-TestStampPattern-355266855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:58 devstack sudo[104152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a 1073741824 Sep 03 14:32:58 devstack sudo[104152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:59 devstack sudo[104152]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-89b96271-928c-4d67-8f1a-5eedf5a4e638 tempest-TestStampPattern-355266855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a 1073741824" returned: 0 in 0.602s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-89b96271-928c-4d67-8f1a-5eedf5a4e638 tempest-TestStampPattern-355266855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:32:59 devstack sudo[104157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a Sep 03 14:32:59 devstack sudo[104157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:32:59 devstack sudo[104157]: pam_unix(sudo:session): session closed for user root Sep 03 14:32:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-89b96271-928c-4d67-8f1a-5eedf5a4e638 tempest-TestStampPattern-355266855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a" returned: 0 in 0.448s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:32:59 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-89b96271-928c-4d67-8f1a-5eedf5a4e638 tempest-TestStampPattern-355266855 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:32:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-89b96271-928c-4d67-8f1a-5eedf5a4e638 tempest-TestStampPattern-355266855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:32:59 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-89b96271-928c-4d67-8f1a-5eedf5a4e638 tempest-TestStampPattern-355266855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31536086-263f-48f7-a6dd-5d716bf508de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:59 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-89b96271-928c-4d67-8f1a-5eedf5a4e638 tempest-TestStampPattern-355266855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (686243c7-3f2f-431b-8d8a-688388c59bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:32:59 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-89b96271-928c-4d67-8f1a-5eedf5a4e638 tempest-TestStampPattern-355266855 None] Volume volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a (7c76b755-3a86-4b29-8abc-4cc21e32df6a): created successfully Sep 03 14:32:59 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-89b96271-928c-4d67-8f1a-5eedf5a4e638 tempest-TestStampPattern-355266855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (686243c7-3f2f-431b-8d8a-688388c59bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:32:59 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-89b96271-928c-4d67-8f1a-5eedf5a4e638 tempest-TestStampPattern-355266855 None] Flow 'volume_create_manager' (292c0dad-51e0-4f57-b03b-912f58c4b434) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:32:59 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-89b96271-928c-4d67-8f1a-5eedf5a4e638 tempest-TestStampPattern-355266855 None] Created volume successfully. Sep 03 14:33:03 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-46154a18-accf-441f-b016-a35f59303c77 tempest-CreateVolumesFromSnapshotTest-289886111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:33:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-46154a18-accf-441f-b016-a35f59303c77 tempest-CreateVolumesFromSnapshotTest-289886111 None] Flow 'volume_create_manager' (370dda26-95a3-4b54-bae6-247fb5cd7d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:33:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-46154a18-accf-441f-b016-a35f59303c77 tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a4999ff-9bfa-4082-8112-88227164460d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-46154a18-accf-441f-b016-a35f59303c77 tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a4999ff-9bfa-4082-8112-88227164460d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1800233392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b92b52a3-0c1f-40b5-a1fa-112cacd1ed19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc6aadc191848a495b0cbf9439b8fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:33:04Z,use_quota=True,user_id='0c7c875726a147f2b79e359a533cd470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-46154a18-accf-441f-b016-a35f59303c77 tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da6e6bbe-928f-49d8-b950-75ee4fc60965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-46154a18-accf-441f-b016-a35f59303c77 tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da6e6bbe-928f-49d8-b950-75ee4fc60965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-46154a18-accf-441f-b016-a35f59303c77 tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e2e4672-0796-40f9-913a-5c8c9618a83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-46154a18-accf-441f-b016-a35f59303c77 tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e2e4672-0796-40f9-913a-5c8c9618a83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b92b52a3-0c1f-40b5-a1fa-112cacd1ed19', 'volume_name': 'volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-46154a18-accf-441f-b016-a35f59303c77 tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ee50215-c47e-4480-973d-229a76eade56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-46154a18-accf-441f-b016-a35f59303c77 tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ee50215-c47e-4480-973d-229a76eade56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-46154a18-accf-441f-b016-a35f59303c77 tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8778d08e-563b-495c-9d9d-11efcd75d97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:03 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-46154a18-accf-441f-b016-a35f59303c77 tempest-CreateVolumesFromSnapshotTest-289886111 None] Volume b92b52a3-0c1f-40b5-a1fa-112cacd1ed19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19', 'volume_size': 1} Sep 03 14:33:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-46154a18-accf-441f-b016-a35f59303c77 tempest-CreateVolumesFromSnapshotTest-289886111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:33:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-46154a18-accf-441f-b016-a35f59303c77 tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:33:03 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-46154a18-accf-441f-b016-a35f59303c77 tempest-CreateVolumesFromSnapshotTest-289886111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1800233392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b92b52a3-0c1f-40b5-a1fa-112cacd1ed19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc6aadc191848a495b0cbf9439b8fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:33:04Z,use_quota=True,user_id='0c7c875726a147f2b79e359a533cd470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:33:03 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-46154a18-accf-441f-b016-a35f59303c77 tempest-CreateVolumesFromSnapshotTest-289886111 None] Creating volume b92b52a3-0c1f-40b5-a1fa-112cacd1ed19 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:33:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-46154a18-accf-441f-b016-a35f59303c77 tempest-CreateVolumesFromSnapshotTest-289886111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:33:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-46154a18-accf-441f-b016-a35f59303c77 tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:33:03 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-46154a18-accf-441f-b016-a35f59303c77 tempest-CreateVolumesFromSnapshotTest-289886111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:33:04 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-46154a18-accf-441f-b016-a35f59303c77 tempest-CreateVolumesFromSnapshotTest-289886111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:33:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-46154a18-accf-441f-b016-a35f59303c77 tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:33:04 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-46154a18-accf-441f-b016-a35f59303c77 tempest-CreateVolumesFromSnapshotTest-289886111 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:33:04 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-46154a18-accf-441f-b016-a35f59303c77 tempest-CreateVolumesFromSnapshotTest-289886111 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:33:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-46154a18-accf-441f-b016-a35f59303c77 tempest-CreateVolumesFromSnapshotTest-289886111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:04 devstack sudo[104181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19 1073741824 Sep 03 14:33:04 devstack sudo[104181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:04 devstack sudo[104181]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-46154a18-accf-441f-b016-a35f59303c77 tempest-CreateVolumesFromSnapshotTest-289886111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19 1073741824" returned: 0 in 0.573s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-46154a18-accf-441f-b016-a35f59303c77 tempest-CreateVolumesFromSnapshotTest-289886111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:04 devstack sudo[104188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19 Sep 03 14:33:04 devstack sudo[104188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:05 devstack sudo[104188]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-46154a18-accf-441f-b016-a35f59303c77 tempest-CreateVolumesFromSnapshotTest-289886111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19" returned: 0 in 0.415s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:05 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-46154a18-accf-441f-b016-a35f59303c77 tempest-CreateVolumesFromSnapshotTest-289886111 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:33:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-46154a18-accf-441f-b016-a35f59303c77 tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:33:05 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-46154a18-accf-441f-b016-a35f59303c77 tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8778d08e-563b-495c-9d9d-11efcd75d97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:05 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-46154a18-accf-441f-b016-a35f59303c77 tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d2000b7-76c8-45f1-8b88-dde4af6b7034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:05 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-46154a18-accf-441f-b016-a35f59303c77 tempest-CreateVolumesFromSnapshotTest-289886111 None] Volume volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19 (b92b52a3-0c1f-40b5-a1fa-112cacd1ed19): created successfully Sep 03 14:33:05 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-46154a18-accf-441f-b016-a35f59303c77 tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d2000b7-76c8-45f1-8b88-dde4af6b7034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:05 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-46154a18-accf-441f-b016-a35f59303c77 tempest-CreateVolumesFromSnapshotTest-289886111 None] Flow 'volume_create_manager' (370dda26-95a3-4b54-bae6-247fb5cd7d65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:33:05 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-46154a18-accf-441f-b016-a35f59303c77 tempest-CreateVolumesFromSnapshotTest-289886111 None] Created volume successfully. Sep 03 14:33:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-0f9d7fb8-3024-4083-bc3f-665fa092b608 tempest-CreateVolumesFromSnapshotTest-289886111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:33:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-0f9d7fb8-3024-4083-bc3f-665fa092b608 tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:33:06 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-0f9d7fb8-3024-4083-bc3f-665fa092b608 tempest-CreateVolumesFromSnapshotTest-289886111 None] Creating offline snapshot 366167f7-023d-4168-b33a-d4d943a5fbf7 of volume b92b52a3-0c1f-40b5-a1fa-112cacd1ed19 {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:33:06 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ad477a-d422-44c8-b486-abf23b0ee925]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:33:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0f9d7fb8-3024-4083-bc3f-665fa092b608 tempest-CreateVolumesFromSnapshotTest-289886111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:06 devstack sudo[104258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19 Sep 03 14:33:06 devstack sudo[104258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:06 devstack sudo[104258]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0f9d7fb8-3024-4083-bc3f-665fa092b608 tempest-CreateVolumesFromSnapshotTest-289886111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19" returned: 0 in 0.440s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0f9d7fb8-3024-4083-bc3f-665fa092b608 tempest-CreateVolumesFromSnapshotTest-289886111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19.366167f7-023d-4168-b33a-d4d943a5fbf7 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:06 devstack sudo[104265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19.366167f7-023d-4168-b33a-d4d943a5fbf7 1G Sep 03 14:33:06 devstack sudo[104265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:07 devstack sudo[104265]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0f9d7fb8-3024-4083-bc3f-665fa092b608 tempest-CreateVolumesFromSnapshotTest-289886111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19.366167f7-023d-4168-b33a-d4d943a5fbf7 1G" returned: 0 in 0.477s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0f9d7fb8-3024-4083-bc3f-665fa092b608 tempest-CreateVolumesFromSnapshotTest-289886111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19.366167f7-023d-4168-b33a-d4d943a5fbf7 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:07 devstack sudo[104270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19.366167f7-023d-4168-b33a-d4d943a5fbf7 Sep 03 14:33:07 devstack sudo[104270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:07 devstack sudo[104270]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0f9d7fb8-3024-4083-bc3f-665fa092b608 tempest-CreateVolumesFromSnapshotTest-289886111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19.366167f7-023d-4168-b33a-d4d943a5fbf7" returned: 0 in 0.360s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:07 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-0f9d7fb8-3024-4083-bc3f-665fa092b608 tempest-CreateVolumesFromSnapshotTest-289886111 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19.366167f7-023d-4168-b33a-d4d943a5fbf7 is being set with open permissions: ugo+rw Sep 03 14:33:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0f9d7fb8-3024-4083-bc3f-665fa092b608 tempest-CreateVolumesFromSnapshotTest-289886111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19.366167f7-023d-4168-b33a-d4d943a5fbf7 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:07 devstack sudo[104278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19.366167f7-023d-4168-b33a-d4d943a5fbf7 Sep 03 14:33:07 devstack sudo[104278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:07 devstack sudo[104278]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0f9d7fb8-3024-4083-bc3f-665fa092b608 tempest-CreateVolumesFromSnapshotTest-289886111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19.366167f7-023d-4168-b33a-d4d943a5fbf7" returned: 0 in 0.268s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0f9d7fb8-3024-4083-bc3f-665fa092b608 tempest-CreateVolumesFromSnapshotTest-289886111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:08 devstack sudo[104283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19.info Sep 03 14:33:08 devstack sudo[104283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:08 devstack sudo[104283]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0f9d7fb8-3024-4083-bc3f-665fa092b608 tempest-CreateVolumesFromSnapshotTest-289886111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19.info" returned: 0 in 0.367s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:08 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-0f9d7fb8-3024-4083-bc3f-665fa092b608 tempest-CreateVolumesFromSnapshotTest-289886111 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19.info is being set with open permissions: ugo+rw Sep 03 14:33:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0f9d7fb8-3024-4083-bc3f-665fa092b608 tempest-CreateVolumesFromSnapshotTest-289886111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:08 devstack sudo[104287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19.info Sep 03 14:33:08 devstack sudo[104287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:08 devstack sudo[104287]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0f9d7fb8-3024-4083-bc3f-665fa092b608 tempest-CreateVolumesFromSnapshotTest-289886111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19.info" returned: 0 in 0.328s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-0f9d7fb8-3024-4083-bc3f-665fa092b608 tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.370s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:33:08 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-0f9d7fb8-3024-4083-bc3f-665fa092b608 tempest-CreateVolumesFromSnapshotTest-289886111 None] Create snapshot completed successfully Sep 03 14:33:10 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d58441f-c502-4218-aef8-d2ef6e43161c tempest-CreateVolumesFromSnapshotTest-289886111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:33:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6d58441f-c502-4218-aef8-d2ef6e43161c tempest-CreateVolumesFromSnapshotTest-289886111 None] Flow 'volume_create_manager' (952854e3-68b2-40cf-a5dd-37de9a75610a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:33:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6d58441f-c502-4218-aef8-d2ef6e43161c tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12823703-7fc6-4cdd-b097-4a9d05d1b095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6d58441f-c502-4218-aef8-d2ef6e43161c tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12823703-7fc6-4cdd-b097-4a9d05d1b095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-183226350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4459df17-c109-4318-b1cc-cecd6558b02e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc6aadc191848a495b0cbf9439b8fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:33:11Z,use_quota=True,user_id='0c7c875726a147f2b79e359a533cd470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6d58441f-c502-4218-aef8-d2ef6e43161c tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7763fde9-e705-4881-9e65-50e5c3a21f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6d58441f-c502-4218-aef8-d2ef6e43161c tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7763fde9-e705-4881-9e65-50e5c3a21f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6d58441f-c502-4218-aef8-d2ef6e43161c tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aa637dc-4c22-46fb-90e4-036999f3b67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6d58441f-c502-4218-aef8-d2ef6e43161c tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aa637dc-4c22-46fb-90e4-036999f3b67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4459df17-c109-4318-b1cc-cecd6558b02e', 'volume_name': 'volume-4459df17-c109-4318-b1cc-cecd6558b02e', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6d58441f-c502-4218-aef8-d2ef6e43161c tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (696adfe3-e574-41ef-911e-bed4b49e09aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6d58441f-c502-4218-aef8-d2ef6e43161c tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (696adfe3-e574-41ef-911e-bed4b49e09aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6d58441f-c502-4218-aef8-d2ef6e43161c tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1be12ea-f3b5-4eaa-93cf-57c51da3bb31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:10 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-6d58441f-c502-4218-aef8-d2ef6e43161c tempest-CreateVolumesFromSnapshotTest-289886111 None] Volume 4459df17-c109-4318-b1cc-cecd6558b02e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4459df17-c109-4318-b1cc-cecd6558b02e', 'volume_size': 1} Sep 03 14:33:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6d58441f-c502-4218-aef8-d2ef6e43161c tempest-CreateVolumesFromSnapshotTest-289886111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:33:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6d58441f-c502-4218-aef8-d2ef6e43161c tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:33:10 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-6d58441f-c502-4218-aef8-d2ef6e43161c tempest-CreateVolumesFromSnapshotTest-289886111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-183226350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4459df17-c109-4318-b1cc-cecd6558b02e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc6aadc191848a495b0cbf9439b8fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:33:11Z,use_quota=True,user_id='0c7c875726a147f2b79e359a533cd470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:33:10 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-6d58441f-c502-4218-aef8-d2ef6e43161c tempest-CreateVolumesFromSnapshotTest-289886111 None] Creating volume 4459df17-c109-4318-b1cc-cecd6558b02e {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:33:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6d58441f-c502-4218-aef8-d2ef6e43161c tempest-CreateVolumesFromSnapshotTest-289886111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:33:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6d58441f-c502-4218-aef8-d2ef6e43161c tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:33:10 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-6d58441f-c502-4218-aef8-d2ef6e43161c tempest-CreateVolumesFromSnapshotTest-289886111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:33:10 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-6d58441f-c502-4218-aef8-d2ef6e43161c tempest-CreateVolumesFromSnapshotTest-289886111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:33:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6d58441f-c502-4218-aef8-d2ef6e43161c tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:33:10 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-6d58441f-c502-4218-aef8-d2ef6e43161c tempest-CreateVolumesFromSnapshotTest-289886111 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:33:10 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-6d58441f-c502-4218-aef8-d2ef6e43161c tempest-CreateVolumesFromSnapshotTest-289886111 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:33:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6d58441f-c502-4218-aef8-d2ef6e43161c tempest-CreateVolumesFromSnapshotTest-289886111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4459df17-c109-4318-b1cc-cecd6558b02e 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:10 devstack sudo[104331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4459df17-c109-4318-b1cc-cecd6558b02e 1073741824 Sep 03 14:33:10 devstack sudo[104331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:11 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f9be62f-bb24-4c97-8b17-89f156442fea tempest-CreateVolumesFromSnapshotTest-289886111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:33:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8f9be62f-bb24-4c97-8b17-89f156442fea tempest-CreateVolumesFromSnapshotTest-289886111 None] Flow 'volume_create_manager' (abbe00e7-a9c2-4f5e-835b-de199a929886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:33:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8f9be62f-bb24-4c97-8b17-89f156442fea tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (889d8e9d-0e6f-46db-a73a-f4e48438ee59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8f9be62f-bb24-4c97-8b17-89f156442fea tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (889d8e9d-0e6f-46db-a73a-f4e48438ee59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:33:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1187286410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=354fdb97-6cd5-41d4-9b87-78628bc5b214,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc6aadc191848a495b0cbf9439b8fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:33:11Z,use_quota=True,user_id='0c7c875726a147f2b79e359a533cd470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8f9be62f-bb24-4c97-8b17-89f156442fea tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8507a362-d25f-4396-b67a-27432a3bf5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8f9be62f-bb24-4c97-8b17-89f156442fea tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8507a362-d25f-4396-b67a-27432a3bf5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8f9be62f-bb24-4c97-8b17-89f156442fea tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (897499f1-9a3f-45fc-8d1b-16a296e8c9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8f9be62f-bb24-4c97-8b17-89f156442fea tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (897499f1-9a3f-45fc-8d1b-16a296e8c9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '354fdb97-6cd5-41d4-9b87-78628bc5b214', 'volume_name': 'volume-354fdb97-6cd5-41d4-9b87-78628bc5b214', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8f9be62f-bb24-4c97-8b17-89f156442fea tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6360235-f9d0-4129-8209-58c844de8d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8f9be62f-bb24-4c97-8b17-89f156442fea tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6360235-f9d0-4129-8209-58c844de8d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8f9be62f-bb24-4c97-8b17-89f156442fea tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (453ac911-d7bf-48ea-8c81-d5715af206b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:11 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-8f9be62f-bb24-4c97-8b17-89f156442fea tempest-CreateVolumesFromSnapshotTest-289886111 None] Volume 354fdb97-6cd5-41d4-9b87-78628bc5b214: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-354fdb97-6cd5-41d4-9b87-78628bc5b214', 'volume_size': 1} Sep 03 14:33:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8f9be62f-bb24-4c97-8b17-89f156442fea tempest-CreateVolumesFromSnapshotTest-289886111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:33:11 devstack sudo[104331]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6d58441f-c502-4218-aef8-d2ef6e43161c tempest-CreateVolumesFromSnapshotTest-289886111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4459df17-c109-4318-b1cc-cecd6558b02e 1073741824" returned: 0 in 0.982s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6d58441f-c502-4218-aef8-d2ef6e43161c tempest-CreateVolumesFromSnapshotTest-289886111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4459df17-c109-4318-b1cc-cecd6558b02e {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:12 devstack sudo[104339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4459df17-c109-4318-b1cc-cecd6558b02e Sep 03 14:33:12 devstack sudo[104339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:12 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-b57bba4d-4d4f-461d-945c-6683d265eccf tempest-CreateVolumesFromSnapshotTest-289886111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:33:12 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b57bba4d-4d4f-461d-945c-6683d265eccf tempest-CreateVolumesFromSnapshotTest-289886111 None] Flow 'volume_create_manager' (5edbd50e-cea4-482b-b7d5-4d6a2168220d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:33:12 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b57bba4d-4d4f-461d-945c-6683d265eccf tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be601558-1e12-4251-b58c-4c83a6b865be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:12 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b57bba4d-4d4f-461d-945c-6683d265eccf tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be601558-1e12-4251-b58c-4c83a6b865be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:33:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-912750375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=812efeb8-1c31-418e-a1c2-b919706366f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc6aadc191848a495b0cbf9439b8fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:33:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:33:12Z,use_quota=True,user_id='0c7c875726a147f2b79e359a533cd470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:12 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b57bba4d-4d4f-461d-945c-6683d265eccf tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e65bca52-52c6-4c86-88d0-decee2f02ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:12 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b57bba4d-4d4f-461d-945c-6683d265eccf tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e65bca52-52c6-4c86-88d0-decee2f02ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:12 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b57bba4d-4d4f-461d-945c-6683d265eccf tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c642d1ff-6082-407f-9877-bae62199300e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:12 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b57bba4d-4d4f-461d-945c-6683d265eccf tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c642d1ff-6082-407f-9877-bae62199300e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '812efeb8-1c31-418e-a1c2-b919706366f3', 'volume_name': 'volume-812efeb8-1c31-418e-a1c2-b919706366f3', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:12 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b57bba4d-4d4f-461d-945c-6683d265eccf tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb818866-6201-42b3-a263-80a6b05f7be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:12 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b57bba4d-4d4f-461d-945c-6683d265eccf tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb818866-6201-42b3-a263-80a6b05f7be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:12 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b57bba4d-4d4f-461d-945c-6683d265eccf tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eadb44dd-f9f2-4e8e-bc1f-a92cfee18a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:12 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-b57bba4d-4d4f-461d-945c-6683d265eccf tempest-CreateVolumesFromSnapshotTest-289886111 None] Volume 812efeb8-1c31-418e-a1c2-b919706366f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-812efeb8-1c31-418e-a1c2-b919706366f3', 'volume_size': 1} Sep 03 14:33:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b57bba4d-4d4f-461d-945c-6683d265eccf tempest-CreateVolumesFromSnapshotTest-289886111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:33:12 devstack sudo[104339]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6d58441f-c502-4218-aef8-d2ef6e43161c tempest-CreateVolumesFromSnapshotTest-289886111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4459df17-c109-4318-b1cc-cecd6558b02e" returned: 0 in 0.703s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:12 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-6d58441f-c502-4218-aef8-d2ef6e43161c tempest-CreateVolumesFromSnapshotTest-289886111 None] <== create_volume: return (1794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:33:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6d58441f-c502-4218-aef8-d2ef6e43161c tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.801s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:33:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8f9be62f-bb24-4c97-8b17-89f156442fea tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.165s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:33:12 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-8f9be62f-bb24-4c97-8b17-89f156442fea tempest-CreateVolumesFromSnapshotTest-289886111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:33:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1187286410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=354fdb97-6cd5-41d4-9b87-78628bc5b214,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc6aadc191848a495b0cbf9439b8fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:33:11Z,use_quota=True,user_id='0c7c875726a147f2b79e359a533cd470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:33:12 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-8f9be62f-bb24-4c97-8b17-89f156442fea tempest-CreateVolumesFromSnapshotTest-289886111 None] Creating volume 354fdb97-6cd5-41d4-9b87-78628bc5b214 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:33:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8f9be62f-bb24-4c97-8b17-89f156442fea tempest-CreateVolumesFromSnapshotTest-289886111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:33:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8f9be62f-bb24-4c97-8b17-89f156442fea tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:33:12 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-8f9be62f-bb24-4c97-8b17-89f156442fea tempest-CreateVolumesFromSnapshotTest-289886111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:33:12 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-8f9be62f-bb24-4c97-8b17-89f156442fea tempest-CreateVolumesFromSnapshotTest-289886111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:33:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8f9be62f-bb24-4c97-8b17-89f156442fea tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:33:12 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-8f9be62f-bb24-4c97-8b17-89f156442fea tempest-CreateVolumesFromSnapshotTest-289886111 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:33:12 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-8f9be62f-bb24-4c97-8b17-89f156442fea tempest-CreateVolumesFromSnapshotTest-289886111 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:33:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8f9be62f-bb24-4c97-8b17-89f156442fea tempest-CreateVolumesFromSnapshotTest-289886111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-354fdb97-6cd5-41d4-9b87-78628bc5b214 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:12 devstack sudo[104343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-354fdb97-6cd5-41d4-9b87-78628bc5b214 1073741824 Sep 03 14:33:12 devstack sudo[104343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:12 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6d58441f-c502-4218-aef8-d2ef6e43161c tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1be12ea-f3b5-4eaa-93cf-57c51da3bb31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4459df17-c109-4318-b1cc-cecd6558b02e', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:12 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6d58441f-c502-4218-aef8-d2ef6e43161c tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6926fb40-0bc6-4023-8a52-af7d43dace77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:12 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-6d58441f-c502-4218-aef8-d2ef6e43161c tempest-CreateVolumesFromSnapshotTest-289886111 None] Volume volume-4459df17-c109-4318-b1cc-cecd6558b02e (4459df17-c109-4318-b1cc-cecd6558b02e): created successfully Sep 03 14:33:12 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6d58441f-c502-4218-aef8-d2ef6e43161c tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6926fb40-0bc6-4023-8a52-af7d43dace77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:12 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6d58441f-c502-4218-aef8-d2ef6e43161c tempest-CreateVolumesFromSnapshotTest-289886111 None] Flow 'volume_create_manager' (952854e3-68b2-40cf-a5dd-37de9a75610a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:33:13 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-6d58441f-c502-4218-aef8-d2ef6e43161c tempest-CreateVolumesFromSnapshotTest-289886111 None] Created volume successfully. Sep 03 14:33:13 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d89d2d8-11d4-4efb-9b11-df2dbbc9133c tempest-CreateVolumesFromSnapshotTest-289886111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:33:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2d89d2d8-11d4-4efb-9b11-df2dbbc9133c tempest-CreateVolumesFromSnapshotTest-289886111 None] Flow 'volume_create_manager' (a62d0e03-08fc-48e1-b930-fa7c48c8bda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:33:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2d89d2d8-11d4-4efb-9b11-df2dbbc9133c tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe24dc38-865d-441f-942a-843901021934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:13 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-60d7787a-e812-4fd4-9b0b-23759cd9039e req-761a9c87-d727-4205-9481-2ddc76df4eaa tempest-TestMinimumBasicScenario-923270773 None] Terminate volume connection completed successfully. Sep 03 14:33:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-60d7787a-e812-4fd4-9b0b-23759cd9039e req-761a9c87-d727-4205-9481-2ddc76df4eaa tempest-TestMinimumBasicScenario-923270773 None] Deleting attachment 3ef8462d-af9c-47cd-88e7-229d25d2176f. {{(pid=87007) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 14:33:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2d89d2d8-11d4-4efb-9b11-df2dbbc9133c tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe24dc38-865d-441f-942a-843901021934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:33:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1969642229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1640140-4178-442e-9b1b-c1ae7efb72d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc6aadc191848a495b0cbf9439b8fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:33:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:33:13Z,use_quota=True,user_id='0c7c875726a147f2b79e359a533cd470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2d89d2d8-11d4-4efb-9b11-df2dbbc9133c tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (513a71c0-7468-4a23-8a2d-a73f299b0dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2d89d2d8-11d4-4efb-9b11-df2dbbc9133c tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (513a71c0-7468-4a23-8a2d-a73f299b0dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2d89d2d8-11d4-4efb-9b11-df2dbbc9133c tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c3dbcd1-b5ce-4b30-8de1-4895a336eaca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2d89d2d8-11d4-4efb-9b11-df2dbbc9133c tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c3dbcd1-b5ce-4b30-8de1-4895a336eaca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1640140-4178-442e-9b1b-c1ae7efb72d3', 'volume_name': 'volume-b1640140-4178-442e-9b1b-c1ae7efb72d3', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2d89d2d8-11d4-4efb-9b11-df2dbbc9133c tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ad03611-855d-469e-bd95-1acda2e4058f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2d89d2d8-11d4-4efb-9b11-df2dbbc9133c tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ad03611-855d-469e-bd95-1acda2e4058f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2d89d2d8-11d4-4efb-9b11-df2dbbc9133c tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29479ab1-fc4d-4f12-a1b8-10c44a31f2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:13 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-2d89d2d8-11d4-4efb-9b11-df2dbbc9133c tempest-CreateVolumesFromSnapshotTest-289886111 None] Volume b1640140-4178-442e-9b1b-c1ae7efb72d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1640140-4178-442e-9b1b-c1ae7efb72d3', 'volume_size': 1} Sep 03 14:33:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2d89d2d8-11d4-4efb-9b11-df2dbbc9133c tempest-CreateVolumesFromSnapshotTest-289886111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:33:13 devstack sudo[104343]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8f9be62f-bb24-4c97-8b17-89f156442fea tempest-CreateVolumesFromSnapshotTest-289886111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-354fdb97-6cd5-41d4-9b87-78628bc5b214 1073741824" returned: 0 in 1.076s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8f9be62f-bb24-4c97-8b17-89f156442fea tempest-CreateVolumesFromSnapshotTest-289886111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-354fdb97-6cd5-41d4-9b87-78628bc5b214 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:13 devstack sudo[104350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-354fdb97-6cd5-41d4-9b87-78628bc5b214 Sep 03 14:33:13 devstack sudo[104350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:13 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7674c53-9f76-49ad-8bb4-429960c3ee28 tempest-CreateVolumesFromSnapshotTest-289886111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:33:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c7674c53-9f76-49ad-8bb4-429960c3ee28 tempest-CreateVolumesFromSnapshotTest-289886111 None] Flow 'volume_create_manager' (59a4a0bd-0e21-484f-95b0-ca6fe3400b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:33:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c7674c53-9f76-49ad-8bb4-429960c3ee28 tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fbe6a98-3d3d-489e-a30a-e823451e4806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c7674c53-9f76-49ad-8bb4-429960c3ee28 tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fbe6a98-3d3d-489e-a30a-e823451e4806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-454842068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9536222c-dd61-4db5-8307-88a76f5107f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc6aadc191848a495b0cbf9439b8fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:33:14Z,use_quota=True,user_id='0c7c875726a147f2b79e359a533cd470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c7674c53-9f76-49ad-8bb4-429960c3ee28 tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3059c91-cc84-4f5f-8821-551948e4750f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c7674c53-9f76-49ad-8bb4-429960c3ee28 tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3059c91-cc84-4f5f-8821-551948e4750f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c7674c53-9f76-49ad-8bb4-429960c3ee28 tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa2869e-6874-4c84-b1a3-227271723cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c7674c53-9f76-49ad-8bb4-429960c3ee28 tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa2869e-6874-4c84-b1a3-227271723cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9536222c-dd61-4db5-8307-88a76f5107f1', 'volume_name': 'volume-9536222c-dd61-4db5-8307-88a76f5107f1', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c7674c53-9f76-49ad-8bb4-429960c3ee28 tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf22a768-1114-441c-9412-e895e4e4b3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c7674c53-9f76-49ad-8bb4-429960c3ee28 tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf22a768-1114-441c-9412-e895e4e4b3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c7674c53-9f76-49ad-8bb4-429960c3ee28 tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f924c05-6fdb-4c17-96b8-c6b608c45a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:14 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-c7674c53-9f76-49ad-8bb4-429960c3ee28 tempest-CreateVolumesFromSnapshotTest-289886111 None] Volume 9536222c-dd61-4db5-8307-88a76f5107f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9536222c-dd61-4db5-8307-88a76f5107f1', 'volume_size': 1} Sep 03 14:33:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c7674c53-9f76-49ad-8bb4-429960c3ee28 tempest-CreateVolumesFromSnapshotTest-289886111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:33:14 devstack sudo[104350]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8f9be62f-bb24-4c97-8b17-89f156442fea tempest-CreateVolumesFromSnapshotTest-289886111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-354fdb97-6cd5-41d4-9b87-78628bc5b214" returned: 0 in 0.292s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-8f9be62f-bb24-4c97-8b17-89f156442fea tempest-CreateVolumesFromSnapshotTest-289886111 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:33:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8f9be62f-bb24-4c97-8b17-89f156442fea tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.456s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:33:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b57bba4d-4d4f-461d-945c-6683d265eccf tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.677s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:33:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b57bba4d-4d4f-461d-945c-6683d265eccf tempest-CreateVolumesFromSnapshotTest-289886111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:33:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-912750375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=812efeb8-1c31-418e-a1c2-b919706366f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc6aadc191848a495b0cbf9439b8fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:33:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:33:12Z,use_quota=True,user_id='0c7c875726a147f2b79e359a533cd470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:33:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-b57bba4d-4d4f-461d-945c-6683d265eccf tempest-CreateVolumesFromSnapshotTest-289886111 None] Creating volume 812efeb8-1c31-418e-a1c2-b919706366f3 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:33:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b57bba4d-4d4f-461d-945c-6683d265eccf tempest-CreateVolumesFromSnapshotTest-289886111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:33:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b57bba4d-4d4f-461d-945c-6683d265eccf tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:33:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b57bba4d-4d4f-461d-945c-6683d265eccf tempest-CreateVolumesFromSnapshotTest-289886111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:33:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b57bba4d-4d4f-461d-945c-6683d265eccf tempest-CreateVolumesFromSnapshotTest-289886111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:33:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b57bba4d-4d4f-461d-945c-6683d265eccf tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:33:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b57bba4d-4d4f-461d-945c-6683d265eccf tempest-CreateVolumesFromSnapshotTest-289886111 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:33:14 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-b57bba4d-4d4f-461d-945c-6683d265eccf tempest-CreateVolumesFromSnapshotTest-289886111 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:33:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b57bba4d-4d4f-461d-945c-6683d265eccf tempest-CreateVolumesFromSnapshotTest-289886111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-812efeb8-1c31-418e-a1c2-b919706366f3 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8f9be62f-bb24-4c97-8b17-89f156442fea tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (453ac911-d7bf-48ea-8c81-d5715af206b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-354fdb97-6cd5-41d4-9b87-78628bc5b214', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8f9be62f-bb24-4c97-8b17-89f156442fea tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22e1c285-abbc-48f6-b9fc-8d22027c41ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:14 devstack sudo[104353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-812efeb8-1c31-418e-a1c2-b919706366f3 1073741824 Sep 03 14:33:14 devstack sudo[104353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:14 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-8f9be62f-bb24-4c97-8b17-89f156442fea tempest-CreateVolumesFromSnapshotTest-289886111 None] Volume volume-354fdb97-6cd5-41d4-9b87-78628bc5b214 (354fdb97-6cd5-41d4-9b87-78628bc5b214): created successfully Sep 03 14:33:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8f9be62f-bb24-4c97-8b17-89f156442fea tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22e1c285-abbc-48f6-b9fc-8d22027c41ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-8f9be62f-bb24-4c97-8b17-89f156442fea tempest-CreateVolumesFromSnapshotTest-289886111 None] Flow 'volume_create_manager' (abbe00e7-a9c2-4f5e-835b-de199a929886) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:33:14 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-8f9be62f-bb24-4c97-8b17-89f156442fea tempest-CreateVolumesFromSnapshotTest-289886111 None] Created volume successfully. Sep 03 14:33:14 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a0cb8669-0755-4294-ab35-1266737a9292 tempest-TestMinimumBasicScenario-923270773 None] Acquiring lock "cinder-badc2d73-24b3-4617-b3bd-7413b9e379c5-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:33:14 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a0cb8669-0755-4294-ab35-1266737a9292 tempest-TestMinimumBasicScenario-923270773 None] Lock "cinder-badc2d73-24b3-4617-b3bd-7413b9e379c5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:33:14 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a0cb8669-0755-4294-ab35-1266737a9292 tempest-TestMinimumBasicScenario-923270773 None] Acquiring lock "cinder-quobyte-badc2d73-24b3-4617-b3bd-7413b9e379c5" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:33:14 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a0cb8669-0755-4294-ab35-1266737a9292 tempest-TestMinimumBasicScenario-923270773 None] Lock "cinder-quobyte-badc2d73-24b3-4617-b3bd-7413b9e379c5" acquired by "delete_volume" :: waited 0.016s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:33:14 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffd5b56-e437-477b-a4b5-a2cec4f9d189]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:33:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a0cb8669-0755-4294-ab35-1266737a9292 tempest-TestMinimumBasicScenario-923270773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-badc2d73-24b3-4617-b3bd-7413b9e379c5 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:14 devstack sudo[104353]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b57bba4d-4d4f-461d-945c-6683d265eccf tempest-CreateVolumesFromSnapshotTest-289886111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-812efeb8-1c31-418e-a1c2-b919706366f3 1073741824" returned: 0 in 0.468s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:14 devstack sudo[104359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-badc2d73-24b3-4617-b3bd-7413b9e379c5 Sep 03 14:33:14 devstack sudo[104359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b57bba4d-4d4f-461d-945c-6683d265eccf tempest-CreateVolumesFromSnapshotTest-289886111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-812efeb8-1c31-418e-a1c2-b919706366f3 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:14 devstack sudo[104361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-812efeb8-1c31-418e-a1c2-b919706366f3 Sep 03 14:33:14 devstack sudo[104361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:14 devstack sudo[104361]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b57bba4d-4d4f-461d-945c-6683d265eccf tempest-CreateVolumesFromSnapshotTest-289886111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-812efeb8-1c31-418e-a1c2-b919706366f3" returned: 0 in 0.272s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b57bba4d-4d4f-461d-945c-6683d265eccf tempest-CreateVolumesFromSnapshotTest-289886111 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:33:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b57bba4d-4d4f-461d-945c-6683d265eccf tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:33:14 devstack sudo[104359]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2d89d2d8-11d4-4efb-9b11-df2dbbc9133c tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.584s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:33:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2d89d2d8-11d4-4efb-9b11-df2dbbc9133c tempest-CreateVolumesFromSnapshotTest-289886111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:33:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1969642229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1640140-4178-442e-9b1b-c1ae7efb72d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc6aadc191848a495b0cbf9439b8fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:33:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:33:13Z,use_quota=True,user_id='0c7c875726a147f2b79e359a533cd470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:33:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-2d89d2d8-11d4-4efb-9b11-df2dbbc9133c tempest-CreateVolumesFromSnapshotTest-289886111 None] Creating volume b1640140-4178-442e-9b1b-c1ae7efb72d3 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:33:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2d89d2d8-11d4-4efb-9b11-df2dbbc9133c tempest-CreateVolumesFromSnapshotTest-289886111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:33:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2d89d2d8-11d4-4efb-9b11-df2dbbc9133c tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:33:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2d89d2d8-11d4-4efb-9b11-df2dbbc9133c tempest-CreateVolumesFromSnapshotTest-289886111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:33:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2d89d2d8-11d4-4efb-9b11-df2dbbc9133c tempest-CreateVolumesFromSnapshotTest-289886111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:33:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2d89d2d8-11d4-4efb-9b11-df2dbbc9133c tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:33:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2d89d2d8-11d4-4efb-9b11-df2dbbc9133c tempest-CreateVolumesFromSnapshotTest-289886111 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:33:14 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-2d89d2d8-11d4-4efb-9b11-df2dbbc9133c tempest-CreateVolumesFromSnapshotTest-289886111 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:33:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2d89d2d8-11d4-4efb-9b11-df2dbbc9133c tempest-CreateVolumesFromSnapshotTest-289886111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b1640140-4178-442e-9b1b-c1ae7efb72d3 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a0cb8669-0755-4294-ab35-1266737a9292 tempest-TestMinimumBasicScenario-923270773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-badc2d73-24b3-4617-b3bd-7413b9e379c5" returned: 0 in 0.446s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a0cb8669-0755-4294-ab35-1266737a9292 tempest-TestMinimumBasicScenario-923270773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-badc2d73-24b3-4617-b3bd-7413b9e379c5 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:15 devstack sudo[104367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b1640140-4178-442e-9b1b-c1ae7efb72d3 1073741824 Sep 03 14:33:15 devstack sudo[104367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:15 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b57bba4d-4d4f-461d-945c-6683d265eccf tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eadb44dd-f9f2-4e8e-bc1f-a92cfee18a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-812efeb8-1c31-418e-a1c2-b919706366f3', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:15 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b57bba4d-4d4f-461d-945c-6683d265eccf tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0468e05f-27ac-4ce3-b3c5-a6bec975a876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:15 devstack sudo[104369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-badc2d73-24b3-4617-b3bd-7413b9e379c5 Sep 03 14:33:15 devstack sudo[104369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:15 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-b57bba4d-4d4f-461d-945c-6683d265eccf tempest-CreateVolumesFromSnapshotTest-289886111 None] Volume volume-812efeb8-1c31-418e-a1c2-b919706366f3 (812efeb8-1c31-418e-a1c2-b919706366f3): created successfully Sep 03 14:33:15 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b57bba4d-4d4f-461d-945c-6683d265eccf tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0468e05f-27ac-4ce3-b3c5-a6bec975a876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:15 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b57bba4d-4d4f-461d-945c-6683d265eccf tempest-CreateVolumesFromSnapshotTest-289886111 None] Flow 'volume_create_manager' (5edbd50e-cea4-482b-b7d5-4d6a2168220d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:33:15 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-b57bba4d-4d4f-461d-945c-6683d265eccf tempest-CreateVolumesFromSnapshotTest-289886111 None] Created volume successfully. Sep 03 14:33:15 devstack sudo[104369]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a0cb8669-0755-4294-ab35-1266737a9292 tempest-TestMinimumBasicScenario-923270773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-badc2d73-24b3-4617-b3bd-7413b9e379c5" returned: 0 in 0.334s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:15 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a0cb8669-0755-4294-ab35-1266737a9292 tempest-TestMinimumBasicScenario-923270773 None] Lock "cinder-quobyte-badc2d73-24b3-4617-b3bd-7413b9e379c5" released by "delete_volume" :: held 0.822s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:33:15 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-a0cb8669-0755-4294-ab35-1266737a9292 tempest-TestMinimumBasicScenario-923270773 None] Created reservations ['88ce57eb-a3b6-4746-b40c-941ea036a596', '82c116a2-0f31-4ee4-ad7c-badc02f573dd', '5c04a247-ea22-4f6e-a1e6-0395a489dc9e', '75c5aa19-6db3-445b-98df-336248be001b'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:33:15 devstack sudo[104367]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2d89d2d8-11d4-4efb-9b11-df2dbbc9133c tempest-CreateVolumesFromSnapshotTest-289886111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b1640140-4178-442e-9b1b-c1ae7efb72d3 1073741824" returned: 0 in 0.478s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a0cb8669-0755-4294-ab35-1266737a9292 tempest-TestMinimumBasicScenario-923270773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:33:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a0cb8669-0755-4294-ab35-1266737a9292 tempest-TestMinimumBasicScenario-923270773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:33:15 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a0cb8669-0755-4294-ab35-1266737a9292 tempest-TestMinimumBasicScenario-923270773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:33:15 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a0cb8669-0755-4294-ab35-1266737a9292 tempest-TestMinimumBasicScenario-923270773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:33:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a0cb8669-0755-4294-ab35-1266737a9292 tempest-TestMinimumBasicScenario-923270773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:33:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a0cb8669-0755-4294-ab35-1266737a9292 tempest-TestMinimumBasicScenario-923270773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2d89d2d8-11d4-4efb-9b11-df2dbbc9133c tempest-CreateVolumesFromSnapshotTest-289886111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b1640140-4178-442e-9b1b-c1ae7efb72d3 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:15 devstack sudo[104375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:33:15 devstack sudo[104375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:15 devstack sudo[104376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b1640140-4178-442e-9b1b-c1ae7efb72d3 Sep 03 14:33:15 devstack sudo[104376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:15 devstack sudo[104376]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2d89d2d8-11d4-4efb-9b11-df2dbbc9133c tempest-CreateVolumesFromSnapshotTest-289886111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b1640140-4178-442e-9b1b-c1ae7efb72d3" returned: 0 in 0.360s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:15 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2d89d2d8-11d4-4efb-9b11-df2dbbc9133c tempest-CreateVolumesFromSnapshotTest-289886111 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:33:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2d89d2d8-11d4-4efb-9b11-df2dbbc9133c tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:33:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c7674c53-9f76-49ad-8bb4-429960c3ee28 tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.835s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:33:15 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-c7674c53-9f76-49ad-8bb4-429960c3ee28 tempest-CreateVolumesFromSnapshotTest-289886111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-454842068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9536222c-dd61-4db5-8307-88a76f5107f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc6aadc191848a495b0cbf9439b8fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:33:14Z,use_quota=True,user_id='0c7c875726a147f2b79e359a533cd470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:33:15 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-c7674c53-9f76-49ad-8bb4-429960c3ee28 tempest-CreateVolumesFromSnapshotTest-289886111 None] Creating volume 9536222c-dd61-4db5-8307-88a76f5107f1 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:33:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c7674c53-9f76-49ad-8bb4-429960c3ee28 tempest-CreateVolumesFromSnapshotTest-289886111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:33:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c7674c53-9f76-49ad-8bb4-429960c3ee28 tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:33:15 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-c7674c53-9f76-49ad-8bb4-429960c3ee28 tempest-CreateVolumesFromSnapshotTest-289886111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:33:15 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-c7674c53-9f76-49ad-8bb4-429960c3ee28 tempest-CreateVolumesFromSnapshotTest-289886111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:33:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c7674c53-9f76-49ad-8bb4-429960c3ee28 tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:33:15 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-c7674c53-9f76-49ad-8bb4-429960c3ee28 tempest-CreateVolumesFromSnapshotTest-289886111 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:33:15 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-c7674c53-9f76-49ad-8bb4-429960c3ee28 tempest-CreateVolumesFromSnapshotTest-289886111 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:33:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c7674c53-9f76-49ad-8bb4-429960c3ee28 tempest-CreateVolumesFromSnapshotTest-289886111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9536222c-dd61-4db5-8307-88a76f5107f1 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:15 devstack sudo[104375]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:15 devstack sudo[104382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9536222c-dd61-4db5-8307-88a76f5107f1 1073741824 Sep 03 14:33:15 devstack sudo[104382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:15 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2d89d2d8-11d4-4efb-9b11-df2dbbc9133c tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29479ab1-fc4d-4f12-a1b8-10c44a31f2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1640140-4178-442e-9b1b-c1ae7efb72d3', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:15 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2d89d2d8-11d4-4efb-9b11-df2dbbc9133c tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f1c7c2b-2b00-478c-9405-2c04f286a717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a0cb8669-0755-4294-ab35-1266737a9292 tempest-TestMinimumBasicScenario-923270773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.453s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:15 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-a0cb8669-0755-4294-ab35-1266737a9292 tempest-TestMinimumBasicScenario-923270773 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:33:15 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-a0cb8669-0755-4294-ab35-1266737a9292 tempest-TestMinimumBasicScenario-923270773 None] Deleted volume successfully. Sep 03 14:33:15 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-2d89d2d8-11d4-4efb-9b11-df2dbbc9133c tempest-CreateVolumesFromSnapshotTest-289886111 None] Volume volume-b1640140-4178-442e-9b1b-c1ae7efb72d3 (b1640140-4178-442e-9b1b-c1ae7efb72d3): created successfully Sep 03 14:33:15 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2d89d2d8-11d4-4efb-9b11-df2dbbc9133c tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f1c7c2b-2b00-478c-9405-2c04f286a717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:15 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2d89d2d8-11d4-4efb-9b11-df2dbbc9133c tempest-CreateVolumesFromSnapshotTest-289886111 None] Flow 'volume_create_manager' (a62d0e03-08fc-48e1-b930-fa7c48c8bda1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:33:16 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-2d89d2d8-11d4-4efb-9b11-df2dbbc9133c tempest-CreateVolumesFromSnapshotTest-289886111 None] Created volume successfully. Sep 03 14:33:16 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a0cb8669-0755-4294-ab35-1266737a9292 tempest-TestMinimumBasicScenario-923270773 None] Lock "cinder-badc2d73-24b3-4617-b3bd-7413b9e379c5-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:33:16 devstack sudo[104382]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c7674c53-9f76-49ad-8bb4-429960c3ee28 tempest-CreateVolumesFromSnapshotTest-289886111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9536222c-dd61-4db5-8307-88a76f5107f1 1073741824" returned: 0 in 0.845s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c7674c53-9f76-49ad-8bb4-429960c3ee28 tempest-CreateVolumesFromSnapshotTest-289886111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9536222c-dd61-4db5-8307-88a76f5107f1 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:16 devstack sudo[104409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9536222c-dd61-4db5-8307-88a76f5107f1 Sep 03 14:33:16 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:17 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c7674c53-9f76-49ad-8bb4-429960c3ee28 tempest-CreateVolumesFromSnapshotTest-289886111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9536222c-dd61-4db5-8307-88a76f5107f1" returned: 0 in 0.344s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:17 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-c7674c53-9f76-49ad-8bb4-429960c3ee28 tempest-CreateVolumesFromSnapshotTest-289886111 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:33:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c7674c53-9f76-49ad-8bb4-429960c3ee28 tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.261s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:33:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c7674c53-9f76-49ad-8bb4-429960c3ee28 tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f924c05-6fdb-4c17-96b8-c6b608c45a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9536222c-dd61-4db5-8307-88a76f5107f1', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c7674c53-9f76-49ad-8bb4-429960c3ee28 tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79bbef04-c9ee-4d0e-bdbd-eae4ad940a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:17 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-c7674c53-9f76-49ad-8bb4-429960c3ee28 tempest-CreateVolumesFromSnapshotTest-289886111 None] Volume volume-9536222c-dd61-4db5-8307-88a76f5107f1 (9536222c-dd61-4db5-8307-88a76f5107f1): created successfully Sep 03 14:33:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c7674c53-9f76-49ad-8bb4-429960c3ee28 tempest-CreateVolumesFromSnapshotTest-289886111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79bbef04-c9ee-4d0e-bdbd-eae4ad940a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c7674c53-9f76-49ad-8bb4-429960c3ee28 tempest-CreateVolumesFromSnapshotTest-289886111 None] Flow 'volume_create_manager' (59a4a0bd-0e21-484f-95b0-ca6fe3400b26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:33:17 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-c7674c53-9f76-49ad-8bb4-429960c3ee28 tempest-CreateVolumesFromSnapshotTest-289886111 None] Created volume successfully. Sep 03 14:33:17 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2cd6f021-01ce-4d7e-a04b-fa7c47200389 tempest-CreateVolumesFromSnapshotTest-289886111 None] Acquiring lock "cinder-9536222c-dd61-4db5-8307-88a76f5107f1-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:33:17 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2cd6f021-01ce-4d7e-a04b-fa7c47200389 tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "cinder-9536222c-dd61-4db5-8307-88a76f5107f1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:33:17 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2cd6f021-01ce-4d7e-a04b-fa7c47200389 tempest-CreateVolumesFromSnapshotTest-289886111 None] Acquiring lock "cinder-quobyte-9536222c-dd61-4db5-8307-88a76f5107f1" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:33:17 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2cd6f021-01ce-4d7e-a04b-fa7c47200389 tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "cinder-quobyte-9536222c-dd61-4db5-8307-88a76f5107f1" acquired by "delete_volume" :: waited 0.028s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:33:17 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f02242-a7d2-457f-a450-ad6b740ace11]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:33:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2cd6f021-01ce-4d7e-a04b-fa7c47200389 tempest-CreateVolumesFromSnapshotTest-289886111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9536222c-dd61-4db5-8307-88a76f5107f1 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:18 devstack sudo[104414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9536222c-dd61-4db5-8307-88a76f5107f1 Sep 03 14:33:18 devstack sudo[104414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:18 devstack sudo[104414]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2cd6f021-01ce-4d7e-a04b-fa7c47200389 tempest-CreateVolumesFromSnapshotTest-289886111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9536222c-dd61-4db5-8307-88a76f5107f1" returned: 0 in 0.400s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2cd6f021-01ce-4d7e-a04b-fa7c47200389 tempest-CreateVolumesFromSnapshotTest-289886111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9536222c-dd61-4db5-8307-88a76f5107f1 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:18 devstack sudo[104419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9536222c-dd61-4db5-8307-88a76f5107f1 Sep 03 14:33:18 devstack sudo[104419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:18 devstack sudo[104419]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2cd6f021-01ce-4d7e-a04b-fa7c47200389 tempest-CreateVolumesFromSnapshotTest-289886111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9536222c-dd61-4db5-8307-88a76f5107f1" returned: 0 in 0.261s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:18 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2cd6f021-01ce-4d7e-a04b-fa7c47200389 tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "cinder-quobyte-9536222c-dd61-4db5-8307-88a76f5107f1" released by "delete_volume" :: held 0.722s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:33:18 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-2cd6f021-01ce-4d7e-a04b-fa7c47200389 tempest-CreateVolumesFromSnapshotTest-289886111 None] Created reservations ['fc2fcb7f-758f-4f4c-b7d2-25f2d79d37ad', '3124e159-9d7f-4ce2-9f3b-14948e435103', '8d540536-64a6-4a31-bc9b-fce3d2fcf453', 'bd872186-46fe-4d1f-8d49-648e0088af78'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:33:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2cd6f021-01ce-4d7e-a04b-fa7c47200389 tempest-CreateVolumesFromSnapshotTest-289886111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:33:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2cd6f021-01ce-4d7e-a04b-fa7c47200389 tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:33:18 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2cd6f021-01ce-4d7e-a04b-fa7c47200389 tempest-CreateVolumesFromSnapshotTest-289886111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:33:18 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2cd6f021-01ce-4d7e-a04b-fa7c47200389 tempest-CreateVolumesFromSnapshotTest-289886111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:33:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2cd6f021-01ce-4d7e-a04b-fa7c47200389 tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:33:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2cd6f021-01ce-4d7e-a04b-fa7c47200389 tempest-CreateVolumesFromSnapshotTest-289886111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:18 devstack sudo[104422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:33:18 devstack sudo[104422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:18 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2ff0e436-c7b3-4fc5-b87e-52346d76e75c tempest-CreateVolumesFromSnapshotTest-289886111 None] Acquiring lock "cinder-b1640140-4178-442e-9b1b-c1ae7efb72d3-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:33:19 devstack sudo[104422]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:19 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2ff0e436-c7b3-4fc5-b87e-52346d76e75c tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "cinder-b1640140-4178-442e-9b1b-c1ae7efb72d3-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:33:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2cd6f021-01ce-4d7e-a04b-fa7c47200389 tempest-CreateVolumesFromSnapshotTest-289886111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.302s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:19 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-2cd6f021-01ce-4d7e-a04b-fa7c47200389 tempest-CreateVolumesFromSnapshotTest-289886111 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:33:19 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-2cd6f021-01ce-4d7e-a04b-fa7c47200389 tempest-CreateVolumesFromSnapshotTest-289886111 None] Deleted volume successfully. Sep 03 14:33:19 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2cd6f021-01ce-4d7e-a04b-fa7c47200389 tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "cinder-9536222c-dd61-4db5-8307-88a76f5107f1-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:33:19 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2ff0e436-c7b3-4fc5-b87e-52346d76e75c tempest-CreateVolumesFromSnapshotTest-289886111 None] Acquiring lock "cinder-quobyte-b1640140-4178-442e-9b1b-c1ae7efb72d3" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:33:19 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2ff0e436-c7b3-4fc5-b87e-52346d76e75c tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "cinder-quobyte-b1640140-4178-442e-9b1b-c1ae7efb72d3" acquired by "delete_volume" :: waited 0.019s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:33:19 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5541c7-c7bf-4dc3-b316-cbc697b55bed]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:33:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2ff0e436-c7b3-4fc5-b87e-52346d76e75c tempest-CreateVolumesFromSnapshotTest-289886111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b1640140-4178-442e-9b1b-c1ae7efb72d3 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:19 devstack sudo[104425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b1640140-4178-442e-9b1b-c1ae7efb72d3 Sep 03 14:33:19 devstack sudo[104425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:19 devstack sudo[104425]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2ff0e436-c7b3-4fc5-b87e-52346d76e75c tempest-CreateVolumesFromSnapshotTest-289886111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b1640140-4178-442e-9b1b-c1ae7efb72d3" returned: 0 in 0.451s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2ff0e436-c7b3-4fc5-b87e-52346d76e75c tempest-CreateVolumesFromSnapshotTest-289886111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b1640140-4178-442e-9b1b-c1ae7efb72d3 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:19 devstack sudo[104452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b1640140-4178-442e-9b1b-c1ae7efb72d3 Sep 03 14:33:19 devstack sudo[104452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:19 devstack sudo[104452]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2ff0e436-c7b3-4fc5-b87e-52346d76e75c tempest-CreateVolumesFromSnapshotTest-289886111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b1640140-4178-442e-9b1b-c1ae7efb72d3" returned: 0 in 0.270s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:19 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2ff0e436-c7b3-4fc5-b87e-52346d76e75c tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "cinder-quobyte-b1640140-4178-442e-9b1b-c1ae7efb72d3" released by "delete_volume" :: held 0.777s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:33:19 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-2ff0e436-c7b3-4fc5-b87e-52346d76e75c tempest-CreateVolumesFromSnapshotTest-289886111 None] Created reservations ['701600fa-b545-4d3c-bc85-7b5afc65b579', '3770df86-16c7-46af-871e-c1b32542a97a', 'd70a333c-244b-4308-b2d4-8be33548d9aa', 'ed55f601-760f-4cb0-b389-8242c2d2682e'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:33:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2ff0e436-c7b3-4fc5-b87e-52346d76e75c tempest-CreateVolumesFromSnapshotTest-289886111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:33:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2ff0e436-c7b3-4fc5-b87e-52346d76e75c tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:33:20 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2ff0e436-c7b3-4fc5-b87e-52346d76e75c tempest-CreateVolumesFromSnapshotTest-289886111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:33:20 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2ff0e436-c7b3-4fc5-b87e-52346d76e75c tempest-CreateVolumesFromSnapshotTest-289886111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:33:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2ff0e436-c7b3-4fc5-b87e-52346d76e75c tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:33:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2ff0e436-c7b3-4fc5-b87e-52346d76e75c tempest-CreateVolumesFromSnapshotTest-289886111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:20 devstack sudo[104455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:33:20 devstack sudo[104455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:20 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-774f8c3b-270e-4237-ac4f-e811364ccdfa tempest-CreateVolumesFromSnapshotTest-289886111 None] Acquiring lock "cinder-812efeb8-1c31-418e-a1c2-b919706366f3-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:33:20 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-774f8c3b-270e-4237-ac4f-e811364ccdfa tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "cinder-812efeb8-1c31-418e-a1c2-b919706366f3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:33:20 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-774f8c3b-270e-4237-ac4f-e811364ccdfa tempest-CreateVolumesFromSnapshotTest-289886111 None] Acquiring lock "cinder-quobyte-812efeb8-1c31-418e-a1c2-b919706366f3" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:33:20 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-774f8c3b-270e-4237-ac4f-e811364ccdfa tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "cinder-quobyte-812efeb8-1c31-418e-a1c2-b919706366f3" acquired by "delete_volume" :: waited 0.022s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:33:20 devstack sudo[104455]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2ff0e436-c7b3-4fc5-b87e-52346d76e75c tempest-CreateVolumesFromSnapshotTest-289886111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.350s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:20 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-2ff0e436-c7b3-4fc5-b87e-52346d76e75c tempest-CreateVolumesFromSnapshotTest-289886111 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:33:20 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[609c1e4f-c983-48d0-8ad2-84413a1ee3da]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:33:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-774f8c3b-270e-4237-ac4f-e811364ccdfa tempest-CreateVolumesFromSnapshotTest-289886111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-812efeb8-1c31-418e-a1c2-b919706366f3 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:20 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-2ff0e436-c7b3-4fc5-b87e-52346d76e75c tempest-CreateVolumesFromSnapshotTest-289886111 None] Deleted volume successfully. Sep 03 14:33:20 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2ff0e436-c7b3-4fc5-b87e-52346d76e75c tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "cinder-b1640140-4178-442e-9b1b-c1ae7efb72d3-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:33:20 devstack sudo[104458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-812efeb8-1c31-418e-a1c2-b919706366f3 Sep 03 14:33:20 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:20 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-774f8c3b-270e-4237-ac4f-e811364ccdfa tempest-CreateVolumesFromSnapshotTest-289886111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-812efeb8-1c31-418e-a1c2-b919706366f3" returned: 0 in 0.378s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-774f8c3b-270e-4237-ac4f-e811364ccdfa tempest-CreateVolumesFromSnapshotTest-289886111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-812efeb8-1c31-418e-a1c2-b919706366f3 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:20 devstack sudo[104463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-812efeb8-1c31-418e-a1c2-b919706366f3 Sep 03 14:33:20 devstack sudo[104463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:21 devstack sudo[104463]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-774f8c3b-270e-4237-ac4f-e811364ccdfa tempest-CreateVolumesFromSnapshotTest-289886111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-812efeb8-1c31-418e-a1c2-b919706366f3" returned: 0 in 0.280s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:21 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-774f8c3b-270e-4237-ac4f-e811364ccdfa tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "cinder-quobyte-812efeb8-1c31-418e-a1c2-b919706366f3" released by "delete_volume" :: held 0.703s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:33:21 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-774f8c3b-270e-4237-ac4f-e811364ccdfa tempest-CreateVolumesFromSnapshotTest-289886111 None] Created reservations ['c8336a10-6720-4d22-9537-04ad0bc3fca9', 'ac61744c-5683-4b05-96a4-301248efe1c2', 'af4122fc-06a2-42e1-8b81-67ba406930b0', 'fc3ab106-1f51-414d-b4f1-6e4dbb9341f1'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:33:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-774f8c3b-270e-4237-ac4f-e811364ccdfa tempest-CreateVolumesFromSnapshotTest-289886111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:33:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-774f8c3b-270e-4237-ac4f-e811364ccdfa tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:33:21 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-774f8c3b-270e-4237-ac4f-e811364ccdfa tempest-CreateVolumesFromSnapshotTest-289886111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:33:21 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-774f8c3b-270e-4237-ac4f-e811364ccdfa tempest-CreateVolumesFromSnapshotTest-289886111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:33:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-774f8c3b-270e-4237-ac4f-e811364ccdfa tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:33:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-774f8c3b-270e-4237-ac4f-e811364ccdfa tempest-CreateVolumesFromSnapshotTest-289886111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:21 devstack sudo[104467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:33:21 devstack sudo[104467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:21 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b853ad06-05f5-4d25-8ed8-6992b86e8d6f tempest-CreateVolumesFromSnapshotTest-289886111 None] Acquiring lock "cinder-354fdb97-6cd5-41d4-9b87-78628bc5b214-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:33:21 devstack sudo[104467]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-774f8c3b-270e-4237-ac4f-e811364ccdfa tempest-CreateVolumesFromSnapshotTest-289886111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.276s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:21 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-774f8c3b-270e-4237-ac4f-e811364ccdfa tempest-CreateVolumesFromSnapshotTest-289886111 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:33:21 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b853ad06-05f5-4d25-8ed8-6992b86e8d6f tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "cinder-354fdb97-6cd5-41d4-9b87-78628bc5b214-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:33:21 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-774f8c3b-270e-4237-ac4f-e811364ccdfa tempest-CreateVolumesFromSnapshotTest-289886111 None] Deleted volume successfully. Sep 03 14:33:21 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-774f8c3b-270e-4237-ac4f-e811364ccdfa tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "cinder-812efeb8-1c31-418e-a1c2-b919706366f3-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:33:21 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b853ad06-05f5-4d25-8ed8-6992b86e8d6f tempest-CreateVolumesFromSnapshotTest-289886111 None] Acquiring lock "cinder-quobyte-354fdb97-6cd5-41d4-9b87-78628bc5b214" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:33:21 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b853ad06-05f5-4d25-8ed8-6992b86e8d6f tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "cinder-quobyte-354fdb97-6cd5-41d4-9b87-78628bc5b214" acquired by "delete_volume" :: waited 0.017s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:33:21 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33ee369-f848-4e79-b7e1-333922f70f83]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:33:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b853ad06-05f5-4d25-8ed8-6992b86e8d6f tempest-CreateVolumesFromSnapshotTest-289886111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-354fdb97-6cd5-41d4-9b87-78628bc5b214 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:21 devstack sudo[104470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-354fdb97-6cd5-41d4-9b87-78628bc5b214 Sep 03 14:33:21 devstack sudo[104470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b853ad06-05f5-4d25-8ed8-6992b86e8d6f tempest-CreateVolumesFromSnapshotTest-289886111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-354fdb97-6cd5-41d4-9b87-78628bc5b214" returned: 0 in 0.370s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:21 devstack sudo[104470]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b853ad06-05f5-4d25-8ed8-6992b86e8d6f tempest-CreateVolumesFromSnapshotTest-289886111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-354fdb97-6cd5-41d4-9b87-78628bc5b214 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:22 devstack sudo[104475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-354fdb97-6cd5-41d4-9b87-78628bc5b214 Sep 03 14:33:22 devstack sudo[104475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:22 devstack sudo[104475]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b853ad06-05f5-4d25-8ed8-6992b86e8d6f tempest-CreateVolumesFromSnapshotTest-289886111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-354fdb97-6cd5-41d4-9b87-78628bc5b214" returned: 0 in 0.269s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b853ad06-05f5-4d25-8ed8-6992b86e8d6f tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "cinder-quobyte-354fdb97-6cd5-41d4-9b87-78628bc5b214" released by "delete_volume" :: held 0.686s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:33:22 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-b853ad06-05f5-4d25-8ed8-6992b86e8d6f tempest-CreateVolumesFromSnapshotTest-289886111 None] Created reservations ['f0e7f323-77a2-4191-b32d-a6e478b7006b', '577212c0-6663-47af-aa87-8bc7c026ffc9', '5c2ddf0f-85fd-4f1f-a0be-3dee51c033aa', 'e556b479-b8f7-4840-8fe2-08a9fe8f5e2e'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:33:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b853ad06-05f5-4d25-8ed8-6992b86e8d6f tempest-CreateVolumesFromSnapshotTest-289886111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:33:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b853ad06-05f5-4d25-8ed8-6992b86e8d6f tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:33:22 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b853ad06-05f5-4d25-8ed8-6992b86e8d6f tempest-CreateVolumesFromSnapshotTest-289886111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:33:22 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b853ad06-05f5-4d25-8ed8-6992b86e8d6f tempest-CreateVolumesFromSnapshotTest-289886111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:33:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b853ad06-05f5-4d25-8ed8-6992b86e8d6f tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:33:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b853ad06-05f5-4d25-8ed8-6992b86e8d6f tempest-CreateVolumesFromSnapshotTest-289886111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:22 devstack sudo[104478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:33:22 devstack sudo[104478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:22 devstack sudo[104478]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b853ad06-05f5-4d25-8ed8-6992b86e8d6f tempest-CreateVolumesFromSnapshotTest-289886111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.243s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:22 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-b853ad06-05f5-4d25-8ed8-6992b86e8d6f tempest-CreateVolumesFromSnapshotTest-289886111 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:33:22 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-b853ad06-05f5-4d25-8ed8-6992b86e8d6f tempest-CreateVolumesFromSnapshotTest-289886111 None] Deleted volume successfully. Sep 03 14:33:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b853ad06-05f5-4d25-8ed8-6992b86e8d6f tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "cinder-354fdb97-6cd5-41d4-9b87-78628bc5b214-delete_volume" released by "delete_volume" :: held 1.139s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:33:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-37d0a605-2724-4094-bb34-253ed566d540 tempest-CreateVolumesFromSnapshotTest-289886111 None] Acquiring lock "cinder-4459df17-c109-4318-b1cc-cecd6558b02e-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:33:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-37d0a605-2724-4094-bb34-253ed566d540 tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "cinder-4459df17-c109-4318-b1cc-cecd6558b02e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:33:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-37d0a605-2724-4094-bb34-253ed566d540 tempest-CreateVolumesFromSnapshotTest-289886111 None] Acquiring lock "cinder-quobyte-4459df17-c109-4318-b1cc-cecd6558b02e" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:33:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-37d0a605-2724-4094-bb34-253ed566d540 tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "cinder-quobyte-4459df17-c109-4318-b1cc-cecd6558b02e" acquired by "delete_volume" :: waited 0.018s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:33:22 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfdd539-7360-4b2b-a41d-fd29e992d083]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:33:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-37d0a605-2724-4094-bb34-253ed566d540 tempest-CreateVolumesFromSnapshotTest-289886111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4459df17-c109-4318-b1cc-cecd6558b02e {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:22 devstack sudo[104482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4459df17-c109-4318-b1cc-cecd6558b02e Sep 03 14:33:22 devstack sudo[104482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:23 devstack sudo[104482]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-37d0a605-2724-4094-bb34-253ed566d540 tempest-CreateVolumesFromSnapshotTest-289886111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4459df17-c109-4318-b1cc-cecd6558b02e" returned: 0 in 0.438s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-37d0a605-2724-4094-bb34-253ed566d540 tempest-CreateVolumesFromSnapshotTest-289886111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4459df17-c109-4318-b1cc-cecd6558b02e {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:23 devstack sudo[104496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4459df17-c109-4318-b1cc-cecd6558b02e Sep 03 14:33:23 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:23 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-37d0a605-2724-4094-bb34-253ed566d540 tempest-CreateVolumesFromSnapshotTest-289886111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4459df17-c109-4318-b1cc-cecd6558b02e" returned: 0 in 0.280s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:23 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-37d0a605-2724-4094-bb34-253ed566d540 tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "cinder-quobyte-4459df17-c109-4318-b1cc-cecd6558b02e" released by "delete_volume" :: held 0.764s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:33:23 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-37d0a605-2724-4094-bb34-253ed566d540 tempest-CreateVolumesFromSnapshotTest-289886111 None] Created reservations ['beccaf7a-7c43-4e6f-aee6-ba4b374425cb', '98e13108-2453-45c7-95a6-b602c9c059ad', 'cb9f3b91-ed70-4be2-b125-cd25db7b5e49', 'cf137971-1f65-44f7-971c-9d2afe210998'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:33:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-37d0a605-2724-4094-bb34-253ed566d540 tempest-CreateVolumesFromSnapshotTest-289886111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:33:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-37d0a605-2724-4094-bb34-253ed566d540 tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:33:23 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-37d0a605-2724-4094-bb34-253ed566d540 tempest-CreateVolumesFromSnapshotTest-289886111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:33:23 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-37d0a605-2724-4094-bb34-253ed566d540 tempest-CreateVolumesFromSnapshotTest-289886111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:33:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-37d0a605-2724-4094-bb34-253ed566d540 tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:33:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-37d0a605-2724-4094-bb34-253ed566d540 tempest-CreateVolumesFromSnapshotTest-289886111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:23 devstack sudo[104499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:33:23 devstack sudo[104499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:23 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-e5c28b86-00fe-4482-b918-c0eb459e97c7 tempest-CreateVolumesFromSnapshotTest-289886111 None] Acquiring lock "cinder-366167f7-023d-4168-b33a-d4d943a5fbf7-delete_snapshot" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:33:23 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-e5c28b86-00fe-4482-b918-c0eb459e97c7 tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "cinder-366167f7-023d-4168-b33a-d4d943a5fbf7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:33:23 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-e5c28b86-00fe-4482-b918-c0eb459e97c7 tempest-CreateVolumesFromSnapshotTest-289886111 None] Acquiring lock "cinder-quobyte-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:33:23 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-e5c28b86-00fe-4482-b918-c0eb459e97c7 tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "cinder-quobyte-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:33:23 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-e5c28b86-00fe-4482-b918-c0eb459e97c7 tempest-CreateVolumesFromSnapshotTest-289886111 None] Acquiring lock "cinder-quobyte-366167f7-023d-4168-b33a-d4d943a5fbf7" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:33:23 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-e5c28b86-00fe-4482-b918-c0eb459e97c7 tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "cinder-quobyte-366167f7-023d-4168-b33a-d4d943a5fbf7" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:33:23 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-e5c28b86-00fe-4482-b918-c0eb459e97c7 tempest-CreateVolumesFromSnapshotTest-289886111 None] Deleting offline snapshot 366167f7-023d-4168-b33a-d4d943a5fbf7 of volume b92b52a3-0c1f-40b5-a1fa-112cacd1ed19 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:33:23 devstack sudo[104499]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:23 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-e5c28b86-00fe-4482-b918-c0eb459e97c7 tempest-CreateVolumesFromSnapshotTest-289886111 None] snapshot_file for this snap is: volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19.366167f7-023d-4168-b33a-d4d943a5fbf7 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:33:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-37d0a605-2724-4094-bb34-253ed566d540 tempest-CreateVolumesFromSnapshotTest-289886111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.329s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:23 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-37d0a605-2724-4094-bb34-253ed566d540 tempest-CreateVolumesFromSnapshotTest-289886111 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:33:23 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-37d0a605-2724-4094-bb34-253ed566d540 tempest-CreateVolumesFromSnapshotTest-289886111 None] Deleted volume successfully. Sep 03 14:33:23 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[763b9a5e-37d8-4d45-996f-91dc00ede5a7]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:33:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e5c28b86-00fe-4482-b918-c0eb459e97c7 tempest-CreateVolumesFromSnapshotTest-289886111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19.366167f7-023d-4168-b33a-d4d943a5fbf7 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:23 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-37d0a605-2724-4094-bb34-253ed566d540 tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "cinder-4459df17-c109-4318-b1cc-cecd6558b02e-delete_volume" released by "delete_volume" :: held 1.330s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:33:24 devstack sudo[104502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19.366167f7-023d-4168-b33a-d4d943a5fbf7 Sep 03 14:33:24 devstack sudo[104502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:24 devstack sudo[104502]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e5c28b86-00fe-4482-b918-c0eb459e97c7 tempest-CreateVolumesFromSnapshotTest-289886111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19.366167f7-023d-4168-b33a-d4d943a5fbf7" returned: 0 in 0.434s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:24 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-e5c28b86-00fe-4482-b918-c0eb459e97c7 tempest-CreateVolumesFromSnapshotTest-289886111 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:33:24 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e11469-d00c-4fe9-96d3-012dee5bb8e2]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:33:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e5c28b86-00fe-4482-b918-c0eb459e97c7 tempest-CreateVolumesFromSnapshotTest-289886111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:24 devstack sudo[104508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19 Sep 03 14:33:24 devstack sudo[104508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:24 devstack sudo[104508]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e5c28b86-00fe-4482-b918-c0eb459e97c7 tempest-CreateVolumesFromSnapshotTest-289886111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19" returned: 0 in 0.358s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e5c28b86-00fe-4482-b918-c0eb459e97c7 tempest-CreateVolumesFromSnapshotTest-289886111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19.366167f7-023d-4168-b33a-d4d943a5fbf7 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:24 devstack sudo[104513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19.366167f7-023d-4168-b33a-d4d943a5fbf7 Sep 03 14:33:24 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:25 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e5c28b86-00fe-4482-b918-c0eb459e97c7 tempest-CreateVolumesFromSnapshotTest-289886111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19.366167f7-023d-4168-b33a-d4d943a5fbf7" returned: 0 in 0.394s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e5c28b86-00fe-4482-b918-c0eb459e97c7 tempest-CreateVolumesFromSnapshotTest-289886111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19.366167f7-023d-4168-b33a-d4d943a5fbf7 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:25 devstack sudo[104524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19.366167f7-023d-4168-b33a-d4d943a5fbf7 Sep 03 14:33:25 devstack sudo[104524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:25 devstack sudo[104524]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e5c28b86-00fe-4482-b918-c0eb459e97c7 tempest-CreateVolumesFromSnapshotTest-289886111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19.366167f7-023d-4168-b33a-d4d943a5fbf7" returned: 0 in 0.255s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:25 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-e5c28b86-00fe-4482-b918-c0eb459e97c7 tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "cinder-quobyte-366167f7-023d-4168-b33a-d4d943a5fbf7" released by "_delete_snapshot" :: held 1.563s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:33:25 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-e5c28b86-00fe-4482-b918-c0eb459e97c7 tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "cinder-quobyte-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19" released by "delete_snapshot" :: held 1.587s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:33:25 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-e5c28b86-00fe-4482-b918-c0eb459e97c7 tempest-CreateVolumesFromSnapshotTest-289886111 None] Created reservations ['3070239a-c03f-430a-a944-2f5eb0ca558f', 'af0a4802-bee3-4f2f-ae83-7aa850398acf', '2bacd41d-d17f-4601-90e5-26626fdbb9a3', '3f5bce83-2c49-4c19-bd25-1a890ba3e137'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:33:25 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-e5c28b86-00fe-4482-b918-c0eb459e97c7 tempest-CreateVolumesFromSnapshotTest-289886111 None] Delete snapshot completed successfully. Sep 03 14:33:25 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-e5c28b86-00fe-4482-b918-c0eb459e97c7 tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "cinder-366167f7-023d-4168-b33a-d4d943a5fbf7-delete_snapshot" released by "delete_snapshot" :: held 1.744s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:33:26 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b139d81b-747e-44d4-91e7-beaee3b7e172 tempest-CreateVolumesFromSnapshotTest-289886111 None] Acquiring lock "cinder-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:33:26 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b139d81b-747e-44d4-91e7-beaee3b7e172 tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "cinder-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:33:26 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b139d81b-747e-44d4-91e7-beaee3b7e172 tempest-CreateVolumesFromSnapshotTest-289886111 None] Acquiring lock "cinder-quobyte-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:33:26 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b139d81b-747e-44d4-91e7-beaee3b7e172 tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "cinder-quobyte-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19" acquired by "delete_volume" :: waited 0.016s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:33:26 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43b4e41-6506-451f-b8e9-ebf03bad88ec]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:33:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b139d81b-747e-44d4-91e7-beaee3b7e172 tempest-CreateVolumesFromSnapshotTest-289886111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:26 devstack sudo[104528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19 Sep 03 14:33:26 devstack sudo[104528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:26 devstack sudo[104528]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b139d81b-747e-44d4-91e7-beaee3b7e172 tempest-CreateVolumesFromSnapshotTest-289886111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19" returned: 0 in 0.415s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b139d81b-747e-44d4-91e7-beaee3b7e172 tempest-CreateVolumesFromSnapshotTest-289886111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:26 devstack sudo[104534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19 Sep 03 14:33:26 devstack sudo[104534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:26 devstack sudo[104534]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b139d81b-747e-44d4-91e7-beaee3b7e172 tempest-CreateVolumesFromSnapshotTest-289886111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19" returned: 0 in 0.321s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:26 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b139d81b-747e-44d4-91e7-beaee3b7e172 tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "cinder-quobyte-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19" released by "delete_volume" :: held 0.793s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:33:26 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-b139d81b-747e-44d4-91e7-beaee3b7e172 tempest-CreateVolumesFromSnapshotTest-289886111 None] Created reservations ['67bbf4ab-046b-44a2-9d09-8cf27e346cb2', '5194011f-2aa8-4446-8c81-5385f055960d', '5d936f99-0644-4c20-9b2a-fcf6b3669c67', '51510376-3808-4b59-8ff7-2d35470d682b'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:33:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b139d81b-747e-44d4-91e7-beaee3b7e172 tempest-CreateVolumesFromSnapshotTest-289886111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:33:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b139d81b-747e-44d4-91e7-beaee3b7e172 tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:33:27 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b139d81b-747e-44d4-91e7-beaee3b7e172 tempest-CreateVolumesFromSnapshotTest-289886111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:33:27 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b139d81b-747e-44d4-91e7-beaee3b7e172 tempest-CreateVolumesFromSnapshotTest-289886111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:33:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b139d81b-747e-44d4-91e7-beaee3b7e172 tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:33:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b139d81b-747e-44d4-91e7-beaee3b7e172 tempest-CreateVolumesFromSnapshotTest-289886111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:27 devstack sudo[104537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:33:27 devstack sudo[104537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:27 devstack sudo[104537]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b139d81b-747e-44d4-91e7-beaee3b7e172 tempest-CreateVolumesFromSnapshotTest-289886111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.262s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:27 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-b139d81b-747e-44d4-91e7-beaee3b7e172 tempest-CreateVolumesFromSnapshotTest-289886111 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:33:27 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-b139d81b-747e-44d4-91e7-beaee3b7e172 tempest-CreateVolumesFromSnapshotTest-289886111 None] Deleted volume successfully. Sep 03 14:33:27 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b139d81b-747e-44d4-91e7-beaee3b7e172 tempest-CreateVolumesFromSnapshotTest-289886111 None] Lock "cinder-b92b52a3-0c1f-40b5-a1fa-112cacd1ed19-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:33:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-b9228f4e-c9cf-4b60-bfdc-6185e42d2b41 req-67ad0880-6735-48ec-a616-33f68d5ff4fb tempest-TestStampPattern-355266855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:33:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-b9228f4e-c9cf-4b60-bfdc-6185e42d2b41 req-67ad0880-6735-48ec-a616-33f68d5ff4fb tempest-TestStampPattern-355266855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:33:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-b9228f4e-c9cf-4b60-bfdc-6185e42d2b41 req-67ad0880-6735-48ec-a616-33f68d5ff4fb tempest-TestStampPattern-355266855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:33:32 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-b9228f4e-c9cf-4b60-bfdc-6185e42d2b41 req-67ad0880-6735-48ec-a616-33f68d5ff4fb tempest-TestStampPattern-355266855 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713', 'name': 'volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '811fde62-ff54-48a2-bc60-7c51419bf3a0', 'enforce_multipath': True} {{(pid=87007) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 14:33:32 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-b9228f4e-c9cf-4b60-bfdc-6185e42d2b41 req-67ad0880-6735-48ec-a616-33f68d5ff4fb tempest-TestStampPattern-355266855 None] attachment_update completed successfully. Sep 03 14:33:33 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:33:33 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Flow 'volume_create_manager' (dec895f5-f1ab-478b-a399-698b0b8aa1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:33:33 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a0dce19-2f3b-44ba-ac36-d76d2c4eb0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:33 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a0dce19-2f3b-44ba-ac36-d76d2c4eb0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76ec1ee0-7d64-4c66-9c03-c045537d0b8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='402fd1cb9587439fb94fe221cedf6f69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:33:34Z,use_quota=True,user_id='8b88e1f573394b78bf2e907aa2e2c767',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:33 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f27511fc-93ca-4ed0-b21e-e703c3ab17bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:33 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f27511fc-93ca-4ed0-b21e-e703c3ab17bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:33 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b50c964-24a7-45e0-8d09-c8b56dbb56ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:33 devstack cinder-volume[87007]: DEBUG cinder.image.glance [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Creating Keystone auth plugin from conf {{(pid=87007) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 14:33:34 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b50c964-24a7-45e0-8d09-c8b56dbb56ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '76ec1ee0-7d64-4c66-9c03-c045537d0b8b', 'volume_name': 'volume-76ec1ee0-7d64-4c66-9c03-c045537d0b8b', 'volume_size': 1, 'image_id': '26365983-224b-4003-90d3-cdb071c24fb2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26365983-224b-4003-90d3-cdb071c24fb2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '66f2fcbc9c4c57b0f3767df3ca6d7266', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '402fd1cb9587439fb94fe221cedf6f69', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f13f9a37437853aec37b1f7b0979b3de7a8840fbf3282668ab3b81624c020ec76152030b5772b5dc21260c4f21d2992eb84d8725219dc734100d4f35939f94e5', 'id': '26365983-224b-4003-90d3-cdb071c24fb2', 'created_at': datetime.datetime(2026, 9, 3, 12, 33, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 12, 33, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26365983-224b-4003-90d3-cdb071c24fb2/file', 'properties': {}}, 'image_service': }' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:34 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84f3a173-c17e-4dea-a294-394a26515825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:34 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84f3a173-c17e-4dea-a294-394a26515825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:34 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c92f2f8c-2a82-433a-9c41-5f014fd0e9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:34 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Volume 76ec1ee0-7d64-4c66-9c03-c045537d0b8b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-76ec1ee0-7d64-4c66-9c03-c045537d0b8b', 'volume_size': 1, 'image_id': '26365983-224b-4003-90d3-cdb071c24fb2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26365983-224b-4003-90d3-cdb071c24fb2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '66f2fcbc9c4c57b0f3767df3ca6d7266', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '402fd1cb9587439fb94fe221cedf6f69', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f13f9a37437853aec37b1f7b0979b3de7a8840fbf3282668ab3b81624c020ec76152030b5772b5dc21260c4f21d2992eb84d8725219dc734100d4f35939f94e5', 'id': '26365983-224b-4003-90d3-cdb071c24fb2', 'created_at': datetime.datetime(2026, 9, 3, 12, 33, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 12, 33, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26365983-224b-4003-90d3-cdb071c24fb2/file', 'properties': {}}, 'image_service': } Sep 03 14:33:34 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Trying to clone 76ec1ee0-7d64-4c66-9c03-c045537d0b8b from image 26365983-224b-4003-90d3-cdb071c24fb2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/26365983-224b-4003-90d3-cdb071c24fb2', 'metadata': {}}]). {{(pid=87007) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 14:33:34 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_26365983-224b-4003-90d3-cdb071c24fb2_35xjryq4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87007) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 14:33:34 devstack cinder-volume[87007]: INFO cinder.image.image_utils [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Image download 0.00 MB at 0.00 MB/s Sep 03 14:33:34 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[862ba2d4-5fb0-4754-800a-2bf065774a48]: (4, 'raw') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:33:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26365983-224b-4003-90d3-cdb071c24fb2_35xjryq4devstack@QuobyteHD {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:34 devstack sudo[104942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26365983-224b-4003-90d3-cdb071c24fb2_35xjryq4devstack@QuobyteHD Sep 03 14:33:34 devstack sudo[104942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:34 devstack sudo[104942]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26365983-224b-4003-90d3-cdb071c24fb2_35xjryq4devstack@QuobyteHD" returned: 0 in 0.372s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26365983-224b-4003-90d3-cdb071c24fb2_35xjryq4devstack@QuobyteHD {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:34 devstack sudo[104953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26365983-224b-4003-90d3-cdb071c24fb2_35xjryq4devstack@QuobyteHD Sep 03 14:33:34 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:35 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26365983-224b-4003-90d3-cdb071c24fb2_35xjryq4devstack@QuobyteHD" returned: 1 in 0.357s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26365983-224b-4003-90d3-cdb071c24fb2_35xjryq4devstack@QuobyteHD' failed. Not Retrying. {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 14:33:35 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Temporary image 26365983-224b-4003-90d3-cdb071c24fb2 is fetched for user 8b88e1f573394b78bf2e907aa2e2c767. {{(pid=87007) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 14:33:35 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[607f684d-20be-4b14-98f5-e6fd9d09cbd8]: (4, 'raw') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:33:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26365983-224b-4003-90d3-cdb071c24fb2_35xjryq4devstack@QuobyteHD {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:35 devstack sudo[104958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26365983-224b-4003-90d3-cdb071c24fb2_35xjryq4devstack@QuobyteHD Sep 03 14:33:35 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:35 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26365983-224b-4003-90d3-cdb071c24fb2_35xjryq4devstack@QuobyteHD" returned: 0 in 0.370s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26365983-224b-4003-90d3-cdb071c24fb2_35xjryq4devstack@QuobyteHD {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:35 devstack sudo[104962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26365983-224b-4003-90d3-cdb071c24fb2_35xjryq4devstack@QuobyteHD Sep 03 14:33:35 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:35 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26365983-224b-4003-90d3-cdb071c24fb2_35xjryq4devstack@QuobyteHD" returned: 1 in 0.355s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26365983-224b-4003-90d3-cdb071c24fb2_35xjryq4devstack@QuobyteHD' failed. Not Retrying. {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 14:33:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:33:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:33:35 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76ec1ee0-7d64-4c66-9c03-c045537d0b8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='402fd1cb9587439fb94fe221cedf6f69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:33:34Z,use_quota=True,user_id='8b88e1f573394b78bf2e907aa2e2c767',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:33:35 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Creating volume 76ec1ee0-7d64-4c66-9c03-c045537d0b8b {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:33:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:33:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:33:35 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:33:35 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:33:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:33:35 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:33:35 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:33:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-76ec1ee0-7d64-4c66-9c03-c045537d0b8b 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:35 devstack sudo[104967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-76ec1ee0-7d64-4c66-9c03-c045537d0b8b 1073741824 Sep 03 14:33:35 devstack sudo[104967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:36 devstack sudo[104967]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-76ec1ee0-7d64-4c66-9c03-c045537d0b8b 1073741824" returned: 0 in 0.524s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:36 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:33:36 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Flow 'volume_create_manager' (38202001-5970-450f-a442-8693e858b8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:33:36 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad81403c-a02c-4630-9764-23d9615c3485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:36 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad81403c-a02c-4630-9764-23d9615c3485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3279f298-7731-496e-96dd-aaf2221abb7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ebc69e0a26d442bb12460cb5a93a494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:33:36Z,use_quota=True,user_id='070ea6c9a3e74e4cba1440cde51a6629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76bc61c4-4b31-45ee-ae6b-2ca592864374),volume_type_id=76bc61c4-4b31-45ee-ae6b-2ca592864374)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:36 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5906c8c3-5450-4f3a-bc4d-3a07b60c92b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:36 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5906c8c3-5450-4f3a-bc4d-3a07b60c92b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:36 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76be0e47-ee10-49dc-a381-438967faccb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:36 devstack cinder-volume[87007]: DEBUG cinder.image.glance [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Creating Keystone auth plugin from conf {{(pid=87007) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 14:33:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-76ec1ee0-7d64-4c66-9c03-c045537d0b8b {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:36 devstack sudo[104979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-76ec1ee0-7d64-4c66-9c03-c045537d0b8b Sep 03 14:33:36 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:36 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76be0e47-ee10-49dc-a381-438967faccb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3279f298-7731-496e-96dd-aaf2221abb7a', 'volume_name': 'volume-3279f298-7731-496e-96dd-aaf2221abb7a', 'volume_size': 1, 'image_id': '27adaa66-bd7a-44f9-992e-f88b779da8d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/27adaa66-bd7a-44f9-992e-f88b779da8d3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9b027b555e909bc2bcb715a4ec0934b2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9ebc69e0a26d442bb12460cb5a93a494', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '05ab22bf8ab45b79f4f2302b512c926bbc4b66dedccd6d8a24803c1e5c74a1da522d207f514d2469971d9cf6e663ab490072d92a7321a548958ef30f5cfe8281', 'id': '27adaa66-bd7a-44f9-992e-f88b779da8d3', 'created_at': datetime.datetime(2026, 9, 3, 12, 33, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 12, 33, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/27adaa66-bd7a-44f9-992e-f88b779da8d3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:36 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad2fec91-9057-4190-b266-f4320c90537d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:36 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad2fec91-9057-4190-b266-f4320c90537d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:36 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (128605d3-55f3-4e49-ba0d-8f4efae74f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:36 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Volume 3279f298-7731-496e-96dd-aaf2221abb7a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3279f298-7731-496e-96dd-aaf2221abb7a', 'volume_size': 1, 'image_id': '27adaa66-bd7a-44f9-992e-f88b779da8d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/27adaa66-bd7a-44f9-992e-f88b779da8d3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9b027b555e909bc2bcb715a4ec0934b2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9ebc69e0a26d442bb12460cb5a93a494', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '05ab22bf8ab45b79f4f2302b512c926bbc4b66dedccd6d8a24803c1e5c74a1da522d207f514d2469971d9cf6e663ab490072d92a7321a548958ef30f5cfe8281', 'id': '27adaa66-bd7a-44f9-992e-f88b779da8d3', 'created_at': datetime.datetime(2026, 9, 3, 12, 33, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 12, 33, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/27adaa66-bd7a-44f9-992e-f88b779da8d3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 03 14:33:36 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Trying to clone 3279f298-7731-496e-96dd-aaf2221abb7a from image 27adaa66-bd7a-44f9-992e-f88b779da8d3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/27adaa66-bd7a-44f9-992e-f88b779da8d3', 'metadata': {}}]). {{(pid=87007) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 14:33:36 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-76ec1ee0-7d64-4c66-9c03-c045537d0b8b" returned: 0 in 0.297s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:36 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:33:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:33:36 devstack cinder-volume[87007]: DEBUG cinder.volume.volume_utils [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Attempting download of 26365983-224b-4003-90d3-cdb071c24fb2 ((None, [{'url': 'file:///opt/stack/data/glance/images/26365983-224b-4003-90d3-cdb071c24fb2', 'metadata': {}}])) to volume 76ec1ee0-7d64-4c66-9c03-c045537d0b8b. {{(pid=87007) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 14:33:36 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_27adaa66-bd7a-44f9-992e-f88b779da8d3_jtamj6wkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87007) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 14:33:36 devstack cinder-volume[87007]: INFO cinder.image.image_utils [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Image download 0.00 MB at 0.00 MB/s Sep 03 14:33:36 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67105cc-bdfb-4185-8612-ab1b7b31aa05]: (4, 'raw') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:33:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26365983-224b-4003-90d3-cdb071c24fb2_pjynu376 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:36 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e20001-aa53-49dc-96bf-f1aa60abdb17]: (4, 'raw') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:33:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_27adaa66-bd7a-44f9-992e-f88b779da8d3_jtamj6wkdevstack@QuobyteHD {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:37 devstack sudo[104989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26365983-224b-4003-90d3-cdb071c24fb2_pjynu376 Sep 03 14:33:37 devstack sudo[104989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:37 devstack sudo[104990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_27adaa66-bd7a-44f9-992e-f88b779da8d3_jtamj6wkdevstack@QuobyteHD Sep 03 14:33:37 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:37 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_27adaa66-bd7a-44f9-992e-f88b779da8d3_jtamj6wkdevstack@QuobyteHD" returned: 0 in 0.382s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27adaa66-bd7a-44f9-992e-f88b779da8d3_jtamj6wkdevstack@QuobyteHD {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:37 devstack sudo[104989]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26365983-224b-4003-90d3-cdb071c24fb2_pjynu376" returned: 0 in 0.430s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26365983-224b-4003-90d3-cdb071c24fb2_pjynu376 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:37 devstack sudo[104997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27adaa66-bd7a-44f9-992e-f88b779da8d3_jtamj6wkdevstack@QuobyteHD Sep 03 14:33:37 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:37 devstack sudo[104998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26365983-224b-4003-90d3-cdb071c24fb2_pjynu376 Sep 03 14:33:37 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:37 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27adaa66-bd7a-44f9-992e-f88b779da8d3_jtamj6wkdevstack@QuobyteHD" returned: 1 in 0.377s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27adaa66-bd7a-44f9-992e-f88b779da8d3_jtamj6wkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 14:33:37 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Temporary image 27adaa66-bd7a-44f9-992e-f88b779da8d3 is fetched for user 070ea6c9a3e74e4cba1440cde51a6629. {{(pid=87007) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 14:33:37 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-4c1810d6-41de-4f66-838d-c64764c0aae5 req-2270ab36-1308-4ebd-80b7-f1050711dfeb tempest-TestStampPattern-355266855 None] Terminate volume connection completed successfully. Sep 03 14:33:37 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-4c1810d6-41de-4f66-838d-c64764c0aae5 req-2270ab36-1308-4ebd-80b7-f1050711dfeb tempest-TestStampPattern-355266855 None] Deleting attachment 811fde62-ff54-48a2-bc60-7c51419bf3a0. {{(pid=87007) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 14:33:37 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26365983-224b-4003-90d3-cdb071c24fb2_pjynu376" returned: 1 in 0.399s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26365983-224b-4003-90d3-cdb071c24fb2_pjynu376' failed. Not Retrying. {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 14:33:37 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad795ee-9ac5-4d33-903f-db0db1c61447]: (4, 'raw') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:33:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26365983-224b-4003-90d3-cdb071c24fb2_35xjryq4devstack@QuobyteHD {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:37 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c86b3a2-9fc3-4a78-ad47-7f41eae4a403]: (4, 'raw') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:33:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_27adaa66-bd7a-44f9-992e-f88b779da8d3_jtamj6wkdevstack@QuobyteHD {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:37 devstack sudo[105034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26365983-224b-4003-90d3-cdb071c24fb2_35xjryq4devstack@QuobyteHD Sep 03 14:33:37 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:37 devstack sudo[105035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_27adaa66-bd7a-44f9-992e-f88b779da8d3_jtamj6wkdevstack@QuobyteHD Sep 03 14:33:37 devstack sudo[105035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:38 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26365983-224b-4003-90d3-cdb071c24fb2_35xjryq4devstack@QuobyteHD" returned: 0 in 0.351s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26365983-224b-4003-90d3-cdb071c24fb2_35xjryq4devstack@QuobyteHD {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:38 devstack sudo[105035]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_27adaa66-bd7a-44f9-992e-f88b779da8d3_jtamj6wkdevstack@QuobyteHD" returned: 0 in 0.349s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27adaa66-bd7a-44f9-992e-f88b779da8d3_jtamj6wkdevstack@QuobyteHD {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:38 devstack sudo[105041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26365983-224b-4003-90d3-cdb071c24fb2_35xjryq4devstack@QuobyteHD Sep 03 14:33:38 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:38 devstack sudo[105043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27adaa66-bd7a-44f9-992e-f88b779da8d3_jtamj6wkdevstack@QuobyteHD Sep 03 14:33:38 devstack sudo[105043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:38 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26365983-224b-4003-90d3-cdb071c24fb2_35xjryq4devstack@QuobyteHD" returned: 1 in 0.365s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26365983-224b-4003-90d3-cdb071c24fb2_35xjryq4devstack@QuobyteHD' failed. Not Retrying. {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 14:33:38 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] 26365983-224b-4003-90d3-cdb071c24fb2 was raw, converting to qcow2 {{(pid=87007) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 14:33:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_26365983-224b-4003-90d3-cdb071c24fb2_35xjryq4devstack@QuobyteHD /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-76ec1ee0-7d64-4c66-9c03-c045537d0b8b {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:38 devstack sudo[105043]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27adaa66-bd7a-44f9-992e-f88b779da8d3_jtamj6wkdevstack@QuobyteHD" returned: 1 in 0.347s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27adaa66-bd7a-44f9-992e-f88b779da8d3_jtamj6wkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 14:33:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:33:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:33:38 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3279f298-7731-496e-96dd-aaf2221abb7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ebc69e0a26d442bb12460cb5a93a494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:33:36Z,use_quota=True,user_id='070ea6c9a3e74e4cba1440cde51a6629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76bc61c4-4b31-45ee-ae6b-2ca592864374),volume_type_id=76bc61c4-4b31-45ee-ae6b-2ca592864374)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:33:38 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Creating volume 3279f298-7731-496e-96dd-aaf2221abb7a {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:33:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:33:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:33:38 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:33:38 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:33:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:33:38 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:33:38 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:33:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3279f298-7731-496e-96dd-aaf2221abb7a 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:38 devstack sudo[105052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_26365983-224b-4003-90d3-cdb071c24fb2_35xjryq4devstack@QuobyteHD /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-76ec1ee0-7d64-4c66-9c03-c045537d0b8b Sep 03 14:33:38 devstack sudo[105052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:38 devstack sudo[105054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3279f298-7731-496e-96dd-aaf2221abb7a 1073741824 Sep 03 14:33:38 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6cf03ce6-b9cd-4bc3-977f-1da29fab80ab tempest-TestStampPattern-355266855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:33:38 devstack sudo[105052]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_26365983-224b-4003-90d3-cdb071c24fb2_35xjryq4devstack@QuobyteHD /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-76ec1ee0-7d64-4c66-9c03-c045537d0b8b" returned: 0 in 0.475s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:38 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_26365983-224b-4003-90d3-cdb071c24fb2_35xjryq4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-76ec1ee0-7d64-4c66-9c03-c045537d0b8b {{(pid=87007) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 14:33:38 devstack cinder-volume[87007]: INFO cinder.image.image_utils [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Converted 0.00 MB image at 0.00 MB/s Sep 03 14:33:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-76ec1ee0-7d64-4c66-9c03-c045537d0b8b 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:38 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3279f298-7731-496e-96dd-aaf2221abb7a 1073741824" returned: 0 in 0.469s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:38 devstack sudo[105064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-76ec1ee0-7d64-4c66-9c03-c045537d0b8b 1G Sep 03 14:33:38 devstack sudo[105064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3279f298-7731-496e-96dd-aaf2221abb7a {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:39 devstack sudo[105066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3279f298-7731-496e-96dd-aaf2221abb7a Sep 03 14:33:39 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:39 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3279f298-7731-496e-96dd-aaf2221abb7a" returned: 0 in 0.261s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:39 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:33:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:33:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6cf03ce6-b9cd-4bc3-977f-1da29fab80ab tempest-TestStampPattern-355266855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.564s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:33:39 devstack sudo[105064]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-76ec1ee0-7d64-4c66-9c03-c045537d0b8b 1G" returned: 0 in 0.340s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:39 devstack cinder-volume[87007]: DEBUG cinder.volume.volume_utils [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Downloaded image 26365983-224b-4003-90d3-cdb071c24fb2 ((None, [{'url': 'file:///opt/stack/data/glance/images/26365983-224b-4003-90d3-cdb071c24fb2', 'metadata': {}}])) to volume 76ec1ee0-7d64-4c66-9c03-c045537d0b8b successfully. {{(pid=87007) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 14:33:39 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Temporary image 26365983-224b-4003-90d3-cdb071c24fb2 for user 8b88e1f573394b78bf2e907aa2e2c767 is deleted. {{(pid=87007) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 14:33:39 devstack cinder-volume[87007]: DEBUG cinder.volume.volume_utils [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Marking volume 76ec1ee0-7d64-4c66-9c03-c045537d0b8b as bootable. {{(pid=87007) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 14:33:39 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-6cf03ce6-b9cd-4bc3-977f-1da29fab80ab tempest-TestStampPattern-355266855 None] Creating offline snapshot b3603331-0911-48eb-9973-4f9dc95e246a of volume 7c76b755-3a86-4b29-8abc-4cc21e32df6a {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:33:39 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Copying metadata from image 26365983-224b-4003-90d3-cdb071c24fb2 to 76ec1ee0-7d64-4c66-9c03-c045537d0b8b. {{(pid=87007) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 14:33:39 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Creating volume glance metadata for volume 76ec1ee0-7d64-4c66-9c03-c045537d0b8b backed by image 26365983-224b-4003-90d3-cdb071c24fb2 with: {'image_id': '26365983-224b-4003-90d3-cdb071c24fb2', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '66f2fcbc9c4c57b0f3767df3ca6d7266', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87007) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 14:33:39 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a8a058-502c-4e04-8a66-9f9d28c1d22d]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:33:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6cf03ce6-b9cd-4bc3-977f-1da29fab80ab tempest-TestStampPattern-355266855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:39 devstack cinder-volume[87007]: DEBUG cinder.volume.volume_utils [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Attempting download of 27adaa66-bd7a-44f9-992e-f88b779da8d3 ((None, [{'url': 'file:///opt/stack/data/glance/images/27adaa66-bd7a-44f9-992e-f88b779da8d3', 'metadata': {}}])) to volume 3279f298-7731-496e-96dd-aaf2221abb7a. {{(pid=87007) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 14:33:39 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f473a4bf-ab22-42dd-bd95-5c4f8b1df31b]: (4, 'raw') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:33:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_27adaa66-bd7a-44f9-992e-f88b779da8d3_ge9vefu_ {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:39 devstack sudo[105072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a Sep 03 14:33:39 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:39 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c92f2f8c-2a82-433a-9c41-5f014fd0e9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76ec1ee0-7d64-4c66-9c03-c045537d0b8b', 'volume_size': 1, 'image_id': '26365983-224b-4003-90d3-cdb071c24fb2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26365983-224b-4003-90d3-cdb071c24fb2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '66f2fcbc9c4c57b0f3767df3ca6d7266', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '402fd1cb9587439fb94fe221cedf6f69', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f13f9a37437853aec37b1f7b0979b3de7a8840fbf3282668ab3b81624c020ec76152030b5772b5dc21260c4f21d2992eb84d8725219dc734100d4f35939f94e5', 'id': '26365983-224b-4003-90d3-cdb071c24fb2', 'created_at': datetime.datetime(2026, 9, 3, 12, 33, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 12, 33, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26365983-224b-4003-90d3-cdb071c24fb2/file', 'properties': {}}, 'image_service': }' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:39 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a226fe9-6d28-4a9e-a5bc-fff0d69067e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:39 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Volume volume-76ec1ee0-7d64-4c66-9c03-c045537d0b8b (76ec1ee0-7d64-4c66-9c03-c045537d0b8b): created successfully Sep 03 14:33:39 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a226fe9-6d28-4a9e-a5bc-fff0d69067e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:39 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Flow 'volume_create_manager' (dec895f5-f1ab-478b-a399-698b0b8aa1dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:33:39 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-e7c44daa-48d5-49c5-b7aa-5f4d13763bd7 tempest-VolumeImageDependencyTests-1402199067 None] Created volume successfully. Sep 03 14:33:39 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_27adaa66-bd7a-44f9-992e-f88b779da8d3_ge9vefu_ Sep 03 14:33:39 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:39 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6cf03ce6-b9cd-4bc3-977f-1da29fab80ab tempest-TestStampPattern-355266855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a" returned: 0 in 0.410s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6cf03ce6-b9cd-4bc3-977f-1da29fab80ab tempest-TestStampPattern-355266855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a.b3603331-0911-48eb-9973-4f9dc95e246a 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:39 devstack sudo[105079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a.b3603331-0911-48eb-9973-4f9dc95e246a 1G Sep 03 14:33:39 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:39 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_27adaa66-bd7a-44f9-992e-f88b779da8d3_ge9vefu_" returned: 0 in 0.375s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_27adaa66-bd7a-44f9-992e-f88b779da8d3_ge9vefu_ {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:39 devstack sudo[105083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_27adaa66-bd7a-44f9-992e-f88b779da8d3_ge9vefu_ Sep 03 14:33:39 devstack sudo[105083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:40 devstack sudo[105083]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_27adaa66-bd7a-44f9-992e-f88b779da8d3_ge9vefu_" returned: 1 in 0.368s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_27adaa66-bd7a-44f9-992e-f88b779da8d3_ge9vefu_' failed. Not Retrying. {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 14:33:40 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c948ea3-8098-4270-95a4-7a48f90d36eb]: (4, 'raw') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:33:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_27adaa66-bd7a-44f9-992e-f88b779da8d3_jtamj6wkdevstack@QuobyteHD {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:40 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6cf03ce6-b9cd-4bc3-977f-1da29fab80ab tempest-TestStampPattern-355266855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a.b3603331-0911-48eb-9973-4f9dc95e246a 1G" returned: 0 in 0.459s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6cf03ce6-b9cd-4bc3-977f-1da29fab80ab tempest-TestStampPattern-355266855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a.b3603331-0911-48eb-9973-4f9dc95e246a {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:40 devstack sudo[105091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a.b3603331-0911-48eb-9973-4f9dc95e246a Sep 03 14:33:40 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:40 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-07f1169b-4403-4701-b4d3-472d223e164a tempest-VolumeImageDependencyTests-1402199067 None] Acquiring lock "cinder-76ec1ee0-7d64-4c66-9c03-c045537d0b8b-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:33:40 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-07f1169b-4403-4701-b4d3-472d223e164a tempest-VolumeImageDependencyTests-1402199067 None] Lock "cinder-76ec1ee0-7d64-4c66-9c03-c045537d0b8b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:33:40 devstack sudo[105090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_27adaa66-bd7a-44f9-992e-f88b779da8d3_jtamj6wkdevstack@QuobyteHD Sep 03 14:33:40 devstack sudo[105090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:40 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-07f1169b-4403-4701-b4d3-472d223e164a tempest-VolumeImageDependencyTests-1402199067 None] Acquiring lock "cinder-quobyte-76ec1ee0-7d64-4c66-9c03-c045537d0b8b" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:33:40 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-07f1169b-4403-4701-b4d3-472d223e164a tempest-VolumeImageDependencyTests-1402199067 None] Lock "cinder-quobyte-76ec1ee0-7d64-4c66-9c03-c045537d0b8b" acquired by "delete_volume" :: waited 0.032s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:33:40 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22ac621-fb62-4b14-9d02-77b0b008b7a5]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:33:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-07f1169b-4403-4701-b4d3-472d223e164a tempest-VolumeImageDependencyTests-1402199067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-76ec1ee0-7d64-4c66-9c03-c045537d0b8b {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:40 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6cf03ce6-b9cd-4bc3-977f-1da29fab80ab tempest-TestStampPattern-355266855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a.b3603331-0911-48eb-9973-4f9dc95e246a" returned: 0 in 0.365s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:40 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-6cf03ce6-b9cd-4bc3-977f-1da29fab80ab tempest-TestStampPattern-355266855 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a.b3603331-0911-48eb-9973-4f9dc95e246a is being set with open permissions: ugo+rw Sep 03 14:33:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6cf03ce6-b9cd-4bc3-977f-1da29fab80ab tempest-TestStampPattern-355266855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a.b3603331-0911-48eb-9973-4f9dc95e246a {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:40 devstack sudo[105094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-76ec1ee0-7d64-4c66-9c03-c045537d0b8b Sep 03 14:33:40 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:40 devstack sudo[105090]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:40 devstack sudo[105101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a.b3603331-0911-48eb-9973-4f9dc95e246a Sep 03 14:33:40 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_27adaa66-bd7a-44f9-992e-f88b779da8d3_jtamj6wkdevstack@QuobyteHD" returned: 0 in 0.412s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27adaa66-bd7a-44f9-992e-f88b779da8d3_jtamj6wkdevstack@QuobyteHD {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:40 devstack sudo[105103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27adaa66-bd7a-44f9-992e-f88b779da8d3_jtamj6wkdevstack@QuobyteHD Sep 03 14:33:40 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:40 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:40 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-07f1169b-4403-4701-b4d3-472d223e164a tempest-VolumeImageDependencyTests-1402199067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-76ec1ee0-7d64-4c66-9c03-c045537d0b8b" returned: 0 in 0.381s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6cf03ce6-b9cd-4bc3-977f-1da29fab80ab tempest-TestStampPattern-355266855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a.b3603331-0911-48eb-9973-4f9dc95e246a" returned: 0 in 0.262s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-07f1169b-4403-4701-b4d3-472d223e164a tempest-VolumeImageDependencyTests-1402199067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-76ec1ee0-7d64-4c66-9c03-c045537d0b8b {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:40 devstack sudo[105109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-76ec1ee0-7d64-4c66-9c03-c045537d0b8b Sep 03 14:33:40 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6cf03ce6-b9cd-4bc3-977f-1da29fab80ab tempest-TestStampPattern-355266855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:40 devstack sudo[105111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a.info Sep 03 14:33:40 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:40 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27adaa66-bd7a-44f9-992e-f88b779da8d3_jtamj6wkdevstack@QuobyteHD" returned: 1 in 0.369s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27adaa66-bd7a-44f9-992e-f88b779da8d3_jtamj6wkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 14:33:40 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] 27adaa66-bd7a-44f9-992e-f88b779da8d3 was raw, converting to qcow2 {{(pid=87007) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 14:33:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_27adaa66-bd7a-44f9-992e-f88b779da8d3_jtamj6wkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3279f298-7731-496e-96dd-aaf2221abb7a {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:40 devstack sudo[105116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_27adaa66-bd7a-44f9-992e-f88b779da8d3_jtamj6wkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3279f298-7731-496e-96dd-aaf2221abb7a Sep 03 14:33:40 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:41 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-07f1169b-4403-4701-b4d3-472d223e164a tempest-VolumeImageDependencyTests-1402199067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-76ec1ee0-7d64-4c66-9c03-c045537d0b8b" returned: 0 in 0.288s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:41 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-07f1169b-4403-4701-b4d3-472d223e164a tempest-VolumeImageDependencyTests-1402199067 None] Lock "cinder-quobyte-76ec1ee0-7d64-4c66-9c03-c045537d0b8b" released by "delete_volume" :: held 0.739s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:33:41 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6cf03ce6-b9cd-4bc3-977f-1da29fab80ab tempest-TestStampPattern-355266855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a.info" returned: 0 in 0.277s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:41 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-6cf03ce6-b9cd-4bc3-977f-1da29fab80ab tempest-TestStampPattern-355266855 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a.info is being set with open permissions: ugo+rw Sep 03 14:33:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6cf03ce6-b9cd-4bc3-977f-1da29fab80ab tempest-TestStampPattern-355266855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:41 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a.info Sep 03 14:33:41 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:41 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-07f1169b-4403-4701-b4d3-472d223e164a tempest-VolumeImageDependencyTests-1402199067 None] Created reservations ['88d91615-05bc-4209-b6b1-e79d7873e55e', '50438022-b1b7-4e4e-b5ec-65385b76ebbf', 'c828f55a-5a45-4c6e-b921-4639979bd4a6', '3bd10a25-ef4c-4f49-ba19-b2876b2cb8bf'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:33:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-07f1169b-4403-4701-b4d3-472d223e164a tempest-VolumeImageDependencyTests-1402199067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:33:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-07f1169b-4403-4701-b4d3-472d223e164a tempest-VolumeImageDependencyTests-1402199067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:33:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-07f1169b-4403-4701-b4d3-472d223e164a tempest-VolumeImageDependencyTests-1402199067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:33:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-07f1169b-4403-4701-b4d3-472d223e164a tempest-VolumeImageDependencyTests-1402199067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:33:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-07f1169b-4403-4701-b4d3-472d223e164a tempest-VolumeImageDependencyTests-1402199067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:33:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-07f1169b-4403-4701-b4d3-472d223e164a tempest-VolumeImageDependencyTests-1402199067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:41 devstack sudo[105125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:33:41 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:41 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6cf03ce6-b9cd-4bc3-977f-1da29fab80ab tempest-TestStampPattern-355266855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a.info" returned: 0 in 0.285s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6cf03ce6-b9cd-4bc3-977f-1da29fab80ab tempest-TestStampPattern-355266855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.179s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:33:41 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_27adaa66-bd7a-44f9-992e-f88b779da8d3_jtamj6wkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3279f298-7731-496e-96dd-aaf2221abb7a" returned: 0 in 0.512s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:41 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_27adaa66-bd7a-44f9-992e-f88b779da8d3_jtamj6wkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3279f298-7731-496e-96dd-aaf2221abb7a {{(pid=87007) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 14:33:41 devstack cinder-volume[87007]: INFO cinder.image.image_utils [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Converted 0.00 MB image at 0.00 MB/s Sep 03 14:33:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3279f298-7731-496e-96dd-aaf2221abb7a 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:41 devstack sudo[105129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3279f298-7731-496e-96dd-aaf2221abb7a 1G Sep 03 14:33:41 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-6cf03ce6-b9cd-4bc3-977f-1da29fab80ab tempest-TestStampPattern-355266855 None] Create snapshot completed successfully Sep 03 14:33:41 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:41 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-07f1169b-4403-4701-b4d3-472d223e164a tempest-VolumeImageDependencyTests-1402199067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.372s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:41 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-07f1169b-4403-4701-b4d3-472d223e164a tempest-VolumeImageDependencyTests-1402199067 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:33:41 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-07f1169b-4403-4701-b4d3-472d223e164a tempest-VolumeImageDependencyTests-1402199067 None] Deleted volume successfully. Sep 03 14:33:41 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-07f1169b-4403-4701-b4d3-472d223e164a tempest-VolumeImageDependencyTests-1402199067 None] Lock "cinder-76ec1ee0-7d64-4c66-9c03-c045537d0b8b-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:33:41 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3279f298-7731-496e-96dd-aaf2221abb7a 1G" returned: 0 in 0.390s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:41 devstack cinder-volume[87007]: DEBUG cinder.volume.volume_utils [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Downloaded image 27adaa66-bd7a-44f9-992e-f88b779da8d3 ((None, [{'url': 'file:///opt/stack/data/glance/images/27adaa66-bd7a-44f9-992e-f88b779da8d3', 'metadata': {}}])) to volume 3279f298-7731-496e-96dd-aaf2221abb7a successfully. {{(pid=87007) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 14:33:41 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Temporary image 27adaa66-bd7a-44f9-992e-f88b779da8d3 for user 070ea6c9a3e74e4cba1440cde51a6629 is deleted. {{(pid=87007) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 14:33:41 devstack cinder-volume[87007]: DEBUG cinder.volume.volume_utils [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Marking volume 3279f298-7731-496e-96dd-aaf2221abb7a as bootable. {{(pid=87007) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 14:33:41 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Copying metadata from image 27adaa66-bd7a-44f9-992e-f88b779da8d3 to 3279f298-7731-496e-96dd-aaf2221abb7a. {{(pid=87007) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 14:33:41 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Creating volume glance metadata for volume 3279f298-7731-496e-96dd-aaf2221abb7a backed by image 27adaa66-bd7a-44f9-992e-f88b779da8d3 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '27adaa66-bd7a-44f9-992e-f88b779da8d3', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '9b027b555e909bc2bcb715a4ec0934b2', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87007) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 14:33:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (128605d3-55f3-4e49-ba0d-8f4efae74f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3279f298-7731-496e-96dd-aaf2221abb7a', 'volume_size': 1, 'image_id': '27adaa66-bd7a-44f9-992e-f88b779da8d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/27adaa66-bd7a-44f9-992e-f88b779da8d3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9b027b555e909bc2bcb715a4ec0934b2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9ebc69e0a26d442bb12460cb5a93a494', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '05ab22bf8ab45b79f4f2302b512c926bbc4b66dedccd6d8a24803c1e5c74a1da522d207f514d2469971d9cf6e663ab490072d92a7321a548958ef30f5cfe8281', 'id': '27adaa66-bd7a-44f9-992e-f88b779da8d3', 'created_at': datetime.datetime(2026, 9, 3, 12, 33, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 12, 33, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/27adaa66-bd7a-44f9-992e-f88b779da8d3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca8b248b-3eb3-43ea-9244-f8a720c5a000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:41 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Volume volume-3279f298-7731-496e-96dd-aaf2221abb7a (3279f298-7731-496e-96dd-aaf2221abb7a): created successfully Sep 03 14:33:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca8b248b-3eb3-43ea-9244-f8a720c5a000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Flow 'volume_create_manager' (38202001-5970-450f-a442-8693e858b8a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:33:42 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-eb86a8fe-d5fe-4cf0-84ac-35ef47f5603d tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Created volume successfully. Sep 03 14:33:42 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2372f51c-b263-4e85-aa60-ef4d72d14592 tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Acquiring lock "cinder-3279f298-7731-496e-96dd-aaf2221abb7a-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:33:42 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2372f51c-b263-4e85-aa60-ef4d72d14592 tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Lock "cinder-3279f298-7731-496e-96dd-aaf2221abb7a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:33:42 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2372f51c-b263-4e85-aa60-ef4d72d14592 tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Acquiring lock "cinder-quobyte-3279f298-7731-496e-96dd-aaf2221abb7a" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:33:42 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2372f51c-b263-4e85-aa60-ef4d72d14592 tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Lock "cinder-quobyte-3279f298-7731-496e-96dd-aaf2221abb7a" acquired by "delete_volume" :: waited 0.021s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:33:42 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1948df9-9bb3-496d-a6ef-f7488b14d2fb]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:33:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2372f51c-b263-4e85-aa60-ef4d72d14592 tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3279f298-7731-496e-96dd-aaf2221abb7a {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:42 devstack sudo[105136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3279f298-7731-496e-96dd-aaf2221abb7a Sep 03 14:33:42 devstack sudo[105136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:43 devstack sudo[105136]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2372f51c-b263-4e85-aa60-ef4d72d14592 tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3279f298-7731-496e-96dd-aaf2221abb7a" returned: 0 in 0.427s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2372f51c-b263-4e85-aa60-ef4d72d14592 tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3279f298-7731-496e-96dd-aaf2221abb7a {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:43 devstack sudo[105141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3279f298-7731-496e-96dd-aaf2221abb7a Sep 03 14:33:43 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:43 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2372f51c-b263-4e85-aa60-ef4d72d14592 tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3279f298-7731-496e-96dd-aaf2221abb7a" returned: 0 in 0.263s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:43 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2372f51c-b263-4e85-aa60-ef4d72d14592 tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Lock "cinder-quobyte-3279f298-7731-496e-96dd-aaf2221abb7a" released by "delete_volume" :: held 0.758s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:33:43 devstack cinder-volume[87007]: WARNING cinder.quota [None req-2372f51c-b263-4e85-aa60-ef4d72d14592 tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 03 14:33:43 devstack cinder-volume[87007]: WARNING cinder.quota [None req-2372f51c-b263-4e85-aa60-ef4d72d14592 tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 03 14:33:43 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-2372f51c-b263-4e85-aa60-ef4d72d14592 tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Created reservations ['65c3ffbe-29d1-4db7-bc94-00385e7a1d49', '2b7bc4a4-4782-4cf8-8241-c8de164930f1', 'a07e75b0-072b-4ee1-b0fa-bb3a9e707530', '9cb9f8b5-0960-47a1-b53d-93c3ba492210'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:33:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2372f51c-b263-4e85-aa60-ef4d72d14592 tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:33:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2372f51c-b263-4e85-aa60-ef4d72d14592 tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:33:43 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2372f51c-b263-4e85-aa60-ef4d72d14592 tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:33:43 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2372f51c-b263-4e85-aa60-ef4d72d14592 tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:33:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2372f51c-b263-4e85-aa60-ef4d72d14592 tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:33:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2372f51c-b263-4e85-aa60-ef4d72d14592 tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:43 devstack sudo[105150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:33:43 devstack sudo[105150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:43 devstack sudo[105150]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2372f51c-b263-4e85-aa60-ef4d72d14592 tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.279s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:43 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-2372f51c-b263-4e85-aa60-ef4d72d14592 tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:33:44 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-2372f51c-b263-4e85-aa60-ef4d72d14592 tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Deleted volume successfully. Sep 03 14:33:44 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2372f51c-b263-4e85-aa60-ef4d72d14592 tempest-VolumeAndVolumeTypeFromImageTest-832282384 None] Lock "cinder-3279f298-7731-496e-96dd-aaf2221abb7a-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:33:46 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-84b35099-b150-4725-bfbd-49f77abbef50 tempest-ProjectReaderTests-1337665981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:33:46 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-84b35099-b150-4725-bfbd-49f77abbef50 tempest-ProjectReaderTests-1337665981 None] Flow 'volume_create_manager' (369b056a-e230-4175-9786-164a4263947c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:33:46 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-84b35099-b150-4725-bfbd-49f77abbef50 tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51944012-0862-4d68-a632-d32c912f36eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:46 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-84b35099-b150-4725-bfbd-49f77abbef50 tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51944012-0862-4d68-a632-d32c912f36eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1673726927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96d910f4-7a96-449e-8f04-04e44a008c2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04fa2c7a8efb43c9b0d435efadadbf3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:33:46Z,use_quota=True,user_id='989919ea70764178b7cdbe37f93c0695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:46 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-84b35099-b150-4725-bfbd-49f77abbef50 tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e739ce99-2a9b-407e-a8f7-9087fe918b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:46 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-84b35099-b150-4725-bfbd-49f77abbef50 tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e739ce99-2a9b-407e-a8f7-9087fe918b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:46 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-84b35099-b150-4725-bfbd-49f77abbef50 tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e0a9e20-f64c-4779-b21a-6f48b1905222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:46 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-84b35099-b150-4725-bfbd-49f77abbef50 tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e0a9e20-f64c-4779-b21a-6f48b1905222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96d910f4-7a96-449e-8f04-04e44a008c2e', 'volume_name': 'volume-96d910f4-7a96-449e-8f04-04e44a008c2e', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:46 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-84b35099-b150-4725-bfbd-49f77abbef50 tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9a998a9-0997-44a4-a1a3-032bc6d14dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:46 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-84b35099-b150-4725-bfbd-49f77abbef50 tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9a998a9-0997-44a4-a1a3-032bc6d14dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:46 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-84b35099-b150-4725-bfbd-49f77abbef50 tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (708da77f-8a60-418f-b477-028375e22804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:46 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-84b35099-b150-4725-bfbd-49f77abbef50 tempest-ProjectReaderTests-1337665981 None] Volume 96d910f4-7a96-449e-8f04-04e44a008c2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96d910f4-7a96-449e-8f04-04e44a008c2e', 'volume_size': 1} Sep 03 14:33:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-84b35099-b150-4725-bfbd-49f77abbef50 tempest-ProjectReaderTests-1337665981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:33:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-84b35099-b150-4725-bfbd-49f77abbef50 tempest-ProjectReaderTests-1337665981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:33:46 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-84b35099-b150-4725-bfbd-49f77abbef50 tempest-ProjectReaderTests-1337665981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1673726927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96d910f4-7a96-449e-8f04-04e44a008c2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04fa2c7a8efb43c9b0d435efadadbf3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:33:46Z,use_quota=True,user_id='989919ea70764178b7cdbe37f93c0695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:33:46 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-84b35099-b150-4725-bfbd-49f77abbef50 tempest-ProjectReaderTests-1337665981 None] Creating volume 96d910f4-7a96-449e-8f04-04e44a008c2e {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:33:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-84b35099-b150-4725-bfbd-49f77abbef50 tempest-ProjectReaderTests-1337665981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:33:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-84b35099-b150-4725-bfbd-49f77abbef50 tempest-ProjectReaderTests-1337665981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:33:46 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-84b35099-b150-4725-bfbd-49f77abbef50 tempest-ProjectReaderTests-1337665981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:33:46 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-84b35099-b150-4725-bfbd-49f77abbef50 tempest-ProjectReaderTests-1337665981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:33:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-84b35099-b150-4725-bfbd-49f77abbef50 tempest-ProjectReaderTests-1337665981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:33:46 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-84b35099-b150-4725-bfbd-49f77abbef50 tempest-ProjectReaderTests-1337665981 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:33:46 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-84b35099-b150-4725-bfbd-49f77abbef50 tempest-ProjectReaderTests-1337665981 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:33:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-84b35099-b150-4725-bfbd-49f77abbef50 tempest-ProjectReaderTests-1337665981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-96d910f4-7a96-449e-8f04-04e44a008c2e 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:46 devstack sudo[105179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-96d910f4-7a96-449e-8f04-04e44a008c2e 1073741824 Sep 03 14:33:46 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:47 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-84b35099-b150-4725-bfbd-49f77abbef50 tempest-ProjectReaderTests-1337665981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-96d910f4-7a96-449e-8f04-04e44a008c2e 1073741824" returned: 0 in 0.486s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-84b35099-b150-4725-bfbd-49f77abbef50 tempest-ProjectReaderTests-1337665981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-96d910f4-7a96-449e-8f04-04e44a008c2e {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:47 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-96d910f4-7a96-449e-8f04-04e44a008c2e Sep 03 14:33:47 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:47 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-84b35099-b150-4725-bfbd-49f77abbef50 tempest-ProjectReaderTests-1337665981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-96d910f4-7a96-449e-8f04-04e44a008c2e" returned: 0 in 0.301s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:47 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-84b35099-b150-4725-bfbd-49f77abbef50 tempest-ProjectReaderTests-1337665981 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:33:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-84b35099-b150-4725-bfbd-49f77abbef50 tempest-ProjectReaderTests-1337665981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:33:47 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-84b35099-b150-4725-bfbd-49f77abbef50 tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (708da77f-8a60-418f-b477-028375e22804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96d910f4-7a96-449e-8f04-04e44a008c2e', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:47 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-84b35099-b150-4725-bfbd-49f77abbef50 tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d15f75a-6082-45a6-8eb1-d38dcb4b1ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:47 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-84b35099-b150-4725-bfbd-49f77abbef50 tempest-ProjectReaderTests-1337665981 None] Volume volume-96d910f4-7a96-449e-8f04-04e44a008c2e (96d910f4-7a96-449e-8f04-04e44a008c2e): created successfully Sep 03 14:33:47 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-84b35099-b150-4725-bfbd-49f77abbef50 tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d15f75a-6082-45a6-8eb1-d38dcb4b1ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:47 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-84b35099-b150-4725-bfbd-49f77abbef50 tempest-ProjectReaderTests-1337665981 None] Flow 'volume_create_manager' (369b056a-e230-4175-9786-164a4263947c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:33:47 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-84b35099-b150-4725-bfbd-49f77abbef50 tempest-ProjectReaderTests-1337665981 None] Created volume successfully. Sep 03 14:33:48 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-f413a0ab-2263-4d3a-9c13-f6f376420afe tempest-ProjectReaderTests-1337665981 None] Acquiring lock "cinder-96d910f4-7a96-449e-8f04-04e44a008c2e-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:33:48 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-f413a0ab-2263-4d3a-9c13-f6f376420afe tempest-ProjectReaderTests-1337665981 None] Lock "cinder-96d910f4-7a96-449e-8f04-04e44a008c2e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:33:48 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-f413a0ab-2263-4d3a-9c13-f6f376420afe tempest-ProjectReaderTests-1337665981 None] Acquiring lock "cinder-quobyte-96d910f4-7a96-449e-8f04-04e44a008c2e" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:33:48 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-f413a0ab-2263-4d3a-9c13-f6f376420afe tempest-ProjectReaderTests-1337665981 None] Lock "cinder-quobyte-96d910f4-7a96-449e-8f04-04e44a008c2e" acquired by "delete_volume" :: waited 0.020s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:33:48 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6088f160-e9cc-400d-b236-462f6a5db6fb]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:33:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f413a0ab-2263-4d3a-9c13-f6f376420afe tempest-ProjectReaderTests-1337665981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-96d910f4-7a96-449e-8f04-04e44a008c2e {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:48 devstack sudo[105188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-96d910f4-7a96-449e-8f04-04e44a008c2e Sep 03 14:33:48 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:49 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-938ceee5-b969-478e-b55f-646661fb8a73 tempest-CreateVolumesFromImageTest-2104690810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:33:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-938ceee5-b969-478e-b55f-646661fb8a73 tempest-CreateVolumesFromImageTest-2104690810 None] Flow 'volume_create_manager' (109cdfd8-25ae-4ff1-a20a-36b63a476904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:33:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-938ceee5-b969-478e-b55f-646661fb8a73 tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc9de77a-28f2-4f03-8696-62e78d03d18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-938ceee5-b969-478e-b55f-646661fb8a73 tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc9de77a-28f2-4f03-8696-62e78d03d18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1601765644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=834c0007-bf8c-4595-9732-a9d5d45e9bf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b5f0f4bfaee4618898f7b823c820242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:33:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:33:49Z,use_quota=True,user_id='2adef300e1164c9a89d2a1a297533963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-938ceee5-b969-478e-b55f-646661fb8a73 tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a70d3452-c93d-4e26-915a-bbf5fad248e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-938ceee5-b969-478e-b55f-646661fb8a73 tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a70d3452-c93d-4e26-915a-bbf5fad248e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-938ceee5-b969-478e-b55f-646661fb8a73 tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (243c1052-5984-456c-bbb6-0b5f32a0db27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-938ceee5-b969-478e-b55f-646661fb8a73 tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (243c1052-5984-456c-bbb6-0b5f32a0db27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '834c0007-bf8c-4595-9732-a9d5d45e9bf8', 'volume_name': 'volume-834c0007-bf8c-4595-9732-a9d5d45e9bf8', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-938ceee5-b969-478e-b55f-646661fb8a73 tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf18ffac-ce4f-4b6e-aa75-b09c26a57655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-938ceee5-b969-478e-b55f-646661fb8a73 tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf18ffac-ce4f-4b6e-aa75-b09c26a57655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-938ceee5-b969-478e-b55f-646661fb8a73 tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (717d66b0-46fc-4475-aba1-c4698ca8576f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:49 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-938ceee5-b969-478e-b55f-646661fb8a73 tempest-CreateVolumesFromImageTest-2104690810 None] Volume 834c0007-bf8c-4595-9732-a9d5d45e9bf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-834c0007-bf8c-4595-9732-a9d5d45e9bf8', 'volume_size': 1} Sep 03 14:33:49 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-938ceee5-b969-478e-b55f-646661fb8a73 tempest-CreateVolumesFromImageTest-2104690810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:33:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-938ceee5-b969-478e-b55f-646661fb8a73 tempest-CreateVolumesFromImageTest-2104690810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:33:49 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-938ceee5-b969-478e-b55f-646661fb8a73 tempest-CreateVolumesFromImageTest-2104690810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1601765644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=834c0007-bf8c-4595-9732-a9d5d45e9bf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b5f0f4bfaee4618898f7b823c820242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:33:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:33:49Z,use_quota=True,user_id='2adef300e1164c9a89d2a1a297533963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:33:49 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-938ceee5-b969-478e-b55f-646661fb8a73 tempest-CreateVolumesFromImageTest-2104690810 None] Creating volume 834c0007-bf8c-4595-9732-a9d5d45e9bf8 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:33:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-938ceee5-b969-478e-b55f-646661fb8a73 tempest-CreateVolumesFromImageTest-2104690810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:33:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-938ceee5-b969-478e-b55f-646661fb8a73 tempest-CreateVolumesFromImageTest-2104690810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:33:49 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-938ceee5-b969-478e-b55f-646661fb8a73 tempest-CreateVolumesFromImageTest-2104690810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:33:49 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-938ceee5-b969-478e-b55f-646661fb8a73 tempest-CreateVolumesFromImageTest-2104690810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:33:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-938ceee5-b969-478e-b55f-646661fb8a73 tempest-CreateVolumesFromImageTest-2104690810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:33:49 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-938ceee5-b969-478e-b55f-646661fb8a73 tempest-CreateVolumesFromImageTest-2104690810 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:33:49 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-938ceee5-b969-478e-b55f-646661fb8a73 tempest-CreateVolumesFromImageTest-2104690810 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:33:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-938ceee5-b969-478e-b55f-646661fb8a73 tempest-CreateVolumesFromImageTest-2104690810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-834c0007-bf8c-4595-9732-a9d5d45e9bf8 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f413a0ab-2263-4d3a-9c13-f6f376420afe tempest-ProjectReaderTests-1337665981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-96d910f4-7a96-449e-8f04-04e44a008c2e" returned: 0 in 0.459s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f413a0ab-2263-4d3a-9c13-f6f376420afe tempest-ProjectReaderTests-1337665981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-96d910f4-7a96-449e-8f04-04e44a008c2e {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:49 devstack sudo[105193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-834c0007-bf8c-4595-9732-a9d5d45e9bf8 1073741824 Sep 03 14:33:49 devstack sudo[105193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:49 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-96d910f4-7a96-449e-8f04-04e44a008c2e Sep 03 14:33:49 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:49 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f413a0ab-2263-4d3a-9c13-f6f376420afe tempest-ProjectReaderTests-1337665981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-96d910f4-7a96-449e-8f04-04e44a008c2e" returned: 0 in 0.343s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:49 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-f413a0ab-2263-4d3a-9c13-f6f376420afe tempest-ProjectReaderTests-1337665981 None] Lock "cinder-quobyte-96d910f4-7a96-449e-8f04-04e44a008c2e" released by "delete_volume" :: held 0.859s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:33:49 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-6877c298-7f23-448b-a833-e626cecc169b tempest-CreateVolumesFromImageTest-2104690810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:33:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6877c298-7f23-448b-a833-e626cecc169b tempest-CreateVolumesFromImageTest-2104690810 None] Flow 'volume_create_manager' (7068bace-1701-457b-85a0-73fbcddc63f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:33:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6877c298-7f23-448b-a833-e626cecc169b tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a18d02a0-bb74-4364-b909-f02ed0dd7ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6877c298-7f23-448b-a833-e626cecc169b tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a18d02a0-bb74-4364-b909-f02ed0dd7ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-31284842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67042893-2f78-42e0-aed8-a69be4dff5cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b5f0f4bfaee4618898f7b823c820242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:33:50Z,use_quota=True,user_id='2adef300e1164c9a89d2a1a297533963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6877c298-7f23-448b-a833-e626cecc169b tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd07487f-a414-462a-94aa-84c5d94e7355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6877c298-7f23-448b-a833-e626cecc169b tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd07487f-a414-462a-94aa-84c5d94e7355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6877c298-7f23-448b-a833-e626cecc169b tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14555e09-2d35-400f-9cef-f5740d080dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6877c298-7f23-448b-a833-e626cecc169b tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14555e09-2d35-400f-9cef-f5740d080dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67042893-2f78-42e0-aed8-a69be4dff5cb', 'volume_name': 'volume-67042893-2f78-42e0-aed8-a69be4dff5cb', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6877c298-7f23-448b-a833-e626cecc169b tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e24b0701-0a71-4358-9721-2b7f5581485f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6877c298-7f23-448b-a833-e626cecc169b tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e24b0701-0a71-4358-9721-2b7f5581485f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6877c298-7f23-448b-a833-e626cecc169b tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c17c8e5-3632-4200-8e79-6894b07b8511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:49 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-6877c298-7f23-448b-a833-e626cecc169b tempest-CreateVolumesFromImageTest-2104690810 None] Volume 67042893-2f78-42e0-aed8-a69be4dff5cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67042893-2f78-42e0-aed8-a69be4dff5cb', 'volume_size': 1} Sep 03 14:33:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6877c298-7f23-448b-a833-e626cecc169b tempest-CreateVolumesFromImageTest-2104690810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:33:49 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-f413a0ab-2263-4d3a-9c13-f6f376420afe tempest-ProjectReaderTests-1337665981 None] Created reservations ['b5b82612-e04e-45c1-b51f-6e03f62d8d63', '8b05028d-92f9-46b4-bb74-40f6ac026b6a', '69a699ca-0ede-483f-9533-cd0c15af5c22', '3d549179-cf7f-47c3-9092-7f0d295e8415'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:33:49 devstack sudo[105193]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-938ceee5-b969-478e-b55f-646661fb8a73 tempest-CreateVolumesFromImageTest-2104690810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-834c0007-bf8c-4595-9732-a9d5d45e9bf8 1073741824" returned: 0 in 0.693s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f413a0ab-2263-4d3a-9c13-f6f376420afe tempest-ProjectReaderTests-1337665981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:33:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f413a0ab-2263-4d3a-9c13-f6f376420afe tempest-ProjectReaderTests-1337665981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:33:49 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f413a0ab-2263-4d3a-9c13-f6f376420afe tempest-ProjectReaderTests-1337665981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f413a0ab-2263-4d3a-9c13-f6f376420afe tempest-ProjectReaderTests-1337665981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f413a0ab-2263-4d3a-9c13-f6f376420afe tempest-ProjectReaderTests-1337665981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f413a0ab-2263-4d3a-9c13-f6f376420afe tempest-ProjectReaderTests-1337665981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-938ceee5-b969-478e-b55f-646661fb8a73 tempest-CreateVolumesFromImageTest-2104690810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-834c0007-bf8c-4595-9732-a9d5d45e9bf8 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:50 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:33:50 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:50 devstack sudo[105204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-834c0007-bf8c-4595-9732-a9d5d45e9bf8 Sep 03 14:33:50 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:33:50 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f413a0ab-2263-4d3a-9c13-f6f376420afe tempest-ProjectReaderTests-1337665981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.374s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-f413a0ab-2263-4d3a-9c13-f6f376420afe tempest-ProjectReaderTests-1337665981 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:33:50 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-f413a0ab-2263-4d3a-9c13-f6f376420afe tempest-ProjectReaderTests-1337665981 None] Deleted volume successfully. Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Flow 'volume_create_manager' (c00af3da-bafa-4d23-a517-c5a1922159f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b8ab414-1b31-46e3-ab91-fe5a7ed68423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:50 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b8ab414-1b31-46e3-ab91-fe5a7ed68423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1816928597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=951d4623-3216-4131-8967-3b1c3e60dbd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7def88711b884bf491a7c4f6b37a9622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b3603331-0911-48eb-9973-4f9dc95e246a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:33:50Z,use_quota=True,user_id='e636d32f5518424fa5de1a7d076b0362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d17ce855-b858-4125-a188-32c4f66c41cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d17ce855-b858-4125-a188-32c4f66c41cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00f1ad16-cf24-454b-84f6-d9aaa7d10077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00f1ad16-cf24-454b-84f6-d9aaa7d10077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '951d4623-3216-4131-8967-3b1c3e60dbd6', 'volume_name': 'volume-951d4623-3216-4131-8967-3b1c3e60dbd6', 'volume_size': 1, 'snapshot_id': 'b3603331-0911-48eb-9973-4f9dc95e246a'}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4404cbfe-05d2-477d-b669-752bf21bcc51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4404cbfe-05d2-477d-b669-752bf21bcc51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a46a4795-da2e-4d22-b7e7-9ae2a9a103d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:50 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Volume 951d4623-3216-4131-8967-3b1c3e60dbd6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-951d4623-3216-4131-8967-3b1c3e60dbd6', 'volume_size': 1, 'snapshot_id': 'b3603331-0911-48eb-9973-4f9dc95e246a'} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-f413a0ab-2263-4d3a-9c13-f6f376420afe tempest-ProjectReaderTests-1337665981 None] Lock "cinder-96d910f4-7a96-449e-8f04-04e44a008c2e-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-938ceee5-b969-478e-b55f-646661fb8a73 tempest-CreateVolumesFromImageTest-2104690810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-834c0007-bf8c-4595-9732-a9d5d45e9bf8" returned: 0 in 0.532s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-938ceee5-b969-478e-b55f-646661fb8a73 tempest-CreateVolumesFromImageTest-2104690810 None] <== create_volume: return (1315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-938ceee5-b969-478e-b55f-646661fb8a73 tempest-CreateVolumesFromImageTest-2104690810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.319s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6877c298-7f23-448b-a833-e626cecc169b tempest-CreateVolumesFromImageTest-2104690810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.742s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-6877c298-7f23-448b-a833-e626cecc169b tempest-CreateVolumesFromImageTest-2104690810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-31284842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67042893-2f78-42e0-aed8-a69be4dff5cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b5f0f4bfaee4618898f7b823c820242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:33:50Z,use_quota=True,user_id='2adef300e1164c9a89d2a1a297533963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-6877c298-7f23-448b-a833-e626cecc169b tempest-CreateVolumesFromImageTest-2104690810 None] Creating volume 67042893-2f78-42e0-aed8-a69be4dff5cb {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6877c298-7f23-448b-a833-e626cecc169b tempest-CreateVolumesFromImageTest-2104690810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6877c298-7f23-448b-a833-e626cecc169b tempest-CreateVolumesFromImageTest-2104690810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-6877c298-7f23-448b-a833-e626cecc169b tempest-CreateVolumesFromImageTest-2104690810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-6877c298-7f23-448b-a833-e626cecc169b tempest-CreateVolumesFromImageTest-2104690810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6877c298-7f23-448b-a833-e626cecc169b tempest-CreateVolumesFromImageTest-2104690810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-6877c298-7f23-448b-a833-e626cecc169b tempest-CreateVolumesFromImageTest-2104690810 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:33:50 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-6877c298-7f23-448b-a833-e626cecc169b tempest-CreateVolumesFromImageTest-2104690810 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6877c298-7f23-448b-a833-e626cecc169b tempest-CreateVolumesFromImageTest-2104690810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-67042893-2f78-42e0-aed8-a69be4dff5cb 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-20d8a1c7-0803-4011-93d2-8623fc449dcb tempest-CreateVolumesFromImageTest-2104690810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-20d8a1c7-0803-4011-93d2-8623fc449dcb tempest-CreateVolumesFromImageTest-2104690810 None] Flow 'volume_create_manager' (cb56b15f-fa55-4a0c-bf46-51f83e90d17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-20d8a1c7-0803-4011-93d2-8623fc449dcb tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8e07146-b6cd-480c-8970-b75e9abc31b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:33:50 devstack sudo[105208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-67042893-2f78-42e0-aed8-a69be4dff5cb 1073741824 Sep 03 14:33:50 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-20d8a1c7-0803-4011-93d2-8623fc449dcb tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8e07146-b6cd-480c-8970-b75e9abc31b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1138028109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=368a89e9-3a5a-473e-9a1c-8d31138fb135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b5f0f4bfaee4618898f7b823c820242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:33:50Z,use_quota=True,user_id='2adef300e1164c9a89d2a1a297533963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-20d8a1c7-0803-4011-93d2-8623fc449dcb tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f54265-cdb9-4036-b5ff-3b0f997bca80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-20d8a1c7-0803-4011-93d2-8623fc449dcb tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f54265-cdb9-4036-b5ff-3b0f997bca80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-20d8a1c7-0803-4011-93d2-8623fc449dcb tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9014d325-239c-4888-a6dd-b848cfc4a462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-20d8a1c7-0803-4011-93d2-8623fc449dcb tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9014d325-239c-4888-a6dd-b848cfc4a462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '368a89e9-3a5a-473e-9a1c-8d31138fb135', 'volume_name': 'volume-368a89e9-3a5a-473e-9a1c-8d31138fb135', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-20d8a1c7-0803-4011-93d2-8623fc449dcb tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dcaa8db-bdc8-4318-a865-2a5d11575166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-20d8a1c7-0803-4011-93d2-8623fc449dcb tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dcaa8db-bdc8-4318-a865-2a5d11575166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-20d8a1c7-0803-4011-93d2-8623fc449dcb tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c93d77a6-d413-4882-b8a8-45e993ee5f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:50 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-20d8a1c7-0803-4011-93d2-8623fc449dcb tempest-CreateVolumesFromImageTest-2104690810 None] Volume 368a89e9-3a5a-473e-9a1c-8d31138fb135: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-368a89e9-3a5a-473e-9a1c-8d31138fb135', 'volume_size': 1} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-20d8a1c7-0803-4011-93d2-8623fc449dcb tempest-CreateVolumesFromImageTest-2104690810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-938ceee5-b969-478e-b55f-646661fb8a73 tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (717d66b0-46fc-4475-aba1-c4698ca8576f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-834c0007-bf8c-4595-9732-a9d5d45e9bf8', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-938ceee5-b969-478e-b55f-646661fb8a73 tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67c1a19d-090d-471b-a443-6fea389d94e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:50 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-938ceee5-b969-478e-b55f-646661fb8a73 tempest-CreateVolumesFromImageTest-2104690810 None] Volume volume-834c0007-bf8c-4595-9732-a9d5d45e9bf8 (834c0007-bf8c-4595-9732-a9d5d45e9bf8): created successfully Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-938ceee5-b969-478e-b55f-646661fb8a73 tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67c1a19d-090d-471b-a443-6fea389d94e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-938ceee5-b969-478e-b55f-646661fb8a73 tempest-CreateVolumesFromImageTest-2104690810 None] Flow 'volume_create_manager' (109cdfd8-25ae-4ff1-a20a-36b63a476904) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-af058663-06ba-4e2a-99fd-2b22aa5d5a3f tempest-CreateVolumesFromImageTest-2104690810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-af058663-06ba-4e2a-99fd-2b22aa5d5a3f tempest-CreateVolumesFromImageTest-2104690810 None] Flow 'volume_create_manager' (5e5b0fb5-64e6-40a1-bde0-06435c11050e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-af058663-06ba-4e2a-99fd-2b22aa5d5a3f tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9b01e60-a678-48a7-87fd-865879be00aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:50 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-938ceee5-b969-478e-b55f-646661fb8a73 tempest-CreateVolumesFromImageTest-2104690810 None] Created volume successfully. Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-af058663-06ba-4e2a-99fd-2b22aa5d5a3f tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9b01e60-a678-48a7-87fd-865879be00aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1422420686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2f0ea78-4d0f-42cd-a86a-d4f6423f552b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b5f0f4bfaee4618898f7b823c820242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:33:51Z,use_quota=True,user_id='2adef300e1164c9a89d2a1a297533963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-af058663-06ba-4e2a-99fd-2b22aa5d5a3f tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8fd2ca7-ff93-4c4b-bf9a-0549d3192fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-af058663-06ba-4e2a-99fd-2b22aa5d5a3f tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8fd2ca7-ff93-4c4b-bf9a-0549d3192fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-af058663-06ba-4e2a-99fd-2b22aa5d5a3f tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46ee5393-b82e-446c-ac43-8161e2afe431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-af058663-06ba-4e2a-99fd-2b22aa5d5a3f tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46ee5393-b82e-446c-ac43-8161e2afe431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2f0ea78-4d0f-42cd-a86a-d4f6423f552b', 'volume_name': 'volume-a2f0ea78-4d0f-42cd-a86a-d4f6423f552b', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-af058663-06ba-4e2a-99fd-2b22aa5d5a3f tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63584d9c-1874-4b83-b9b5-601ad45839bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-af058663-06ba-4e2a-99fd-2b22aa5d5a3f tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63584d9c-1874-4b83-b9b5-601ad45839bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-af058663-06ba-4e2a-99fd-2b22aa5d5a3f tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68a5a002-2f07-4dfa-948c-24a23163fe70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:50 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-af058663-06ba-4e2a-99fd-2b22aa5d5a3f tempest-CreateVolumesFromImageTest-2104690810 None] Volume a2f0ea78-4d0f-42cd-a86a-d4f6423f552b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2f0ea78-4d0f-42cd-a86a-d4f6423f552b', 'volume_size': 1} Sep 03 14:33:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-af058663-06ba-4e2a-99fd-2b22aa5d5a3f tempest-CreateVolumesFromImageTest-2104690810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:33:51 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6877c298-7f23-448b-a833-e626cecc169b tempest-CreateVolumesFromImageTest-2104690810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-67042893-2f78-42e0-aed8-a69be4dff5cb 1073741824" returned: 0 in 0.667s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf8017aa-f11d-4f2a-ae5f-536326dab318 tempest-CreateVolumesFromImageTest-2104690810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cf8017aa-f11d-4f2a-ae5f-536326dab318 tempest-CreateVolumesFromImageTest-2104690810 None] Flow 'volume_create_manager' (c9a9f587-16a8-4f09-bf8b-e817837867f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cf8017aa-f11d-4f2a-ae5f-536326dab318 tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca1c8dc7-6dc1-45c0-9960-9ed022fd30db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cf8017aa-f11d-4f2a-ae5f-536326dab318 tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca1c8dc7-6dc1-45c0-9960-9ed022fd30db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1427916490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f16a26c-9a31-4717-81a7-ead752661549,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b5f0f4bfaee4618898f7b823c820242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:33:51Z,use_quota=True,user_id='2adef300e1164c9a89d2a1a297533963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cf8017aa-f11d-4f2a-ae5f-536326dab318 tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1ba0219-9d28-4dbe-9cac-08753eebe17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cf8017aa-f11d-4f2a-ae5f-536326dab318 tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1ba0219-9d28-4dbe-9cac-08753eebe17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cf8017aa-f11d-4f2a-ae5f-536326dab318 tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (835c8934-ada0-4d39-b1f6-7ed90e7027a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cf8017aa-f11d-4f2a-ae5f-536326dab318 tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (835c8934-ada0-4d39-b1f6-7ed90e7027a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f16a26c-9a31-4717-81a7-ead752661549', 'volume_name': 'volume-7f16a26c-9a31-4717-81a7-ead752661549', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cf8017aa-f11d-4f2a-ae5f-536326dab318 tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (533b864d-3049-423b-bbba-9690bfef6f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cf8017aa-f11d-4f2a-ae5f-536326dab318 tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (533b864d-3049-423b-bbba-9690bfef6f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cf8017aa-f11d-4f2a-ae5f-536326dab318 tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1f6bd17-54fa-4458-91e0-08da47af129e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:51 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-cf8017aa-f11d-4f2a-ae5f-536326dab318 tempest-CreateVolumesFromImageTest-2104690810 None] Volume 7f16a26c-9a31-4717-81a7-ead752661549: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f16a26c-9a31-4717-81a7-ead752661549', 'volume_size': 1} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-cf8017aa-f11d-4f2a-ae5f-536326dab318 tempest-CreateVolumesFromImageTest-2104690810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6877c298-7f23-448b-a833-e626cecc169b tempest-CreateVolumesFromImageTest-2104690810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-67042893-2f78-42e0-aed8-a69be4dff5cb {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:51 devstack sudo[105217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-67042893-2f78-42e0-aed8-a69be4dff5cb Sep 03 14:33:51 devstack sudo[105217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG oslo_service.periodic_task [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87007) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:51 devstack sudo[105220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:33:51 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:51 devstack sudo[105217]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6877c298-7f23-448b-a833-e626cecc169b tempest-CreateVolumesFromImageTest-2104690810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-67042893-2f78-42e0-aed8-a69be4dff5cb" returned: 0 in 0.291s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-6877c298-7f23-448b-a833-e626cecc169b tempest-CreateVolumesFromImageTest-2104690810 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6877c298-7f23-448b-a833-e626cecc169b tempest-CreateVolumesFromImageTest-2104690810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.063s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Acquiring lock "cinder-quobyte-b3603331-0911-48eb-9973-4f9dc95e246a-951d4623-3216-4131-8967-3b1c3e60dbd6" by "_create_volume_from_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-b80f5bc5-f9f2-40ef-9137-002e4a562109 tempest-ProjectReaderTests-1337665981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b80f5bc5-f9f2-40ef-9137-002e4a562109 tempest-ProjectReaderTests-1337665981 None] Flow 'volume_create_manager' (902602de-56c1-4655-b6be-45764c0f9d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b80f5bc5-f9f2-40ef-9137-002e4a562109 tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da032998-bb27-4df1-ae08-72ec7c3aac44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6877c298-7f23-448b-a833-e626cecc169b tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c17c8e5-3632-4200-8e79-6894b07b8511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67042893-2f78-42e0-aed8-a69be4dff5cb', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6877c298-7f23-448b-a833-e626cecc169b tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (871a628d-9fe0-49f0-8dcd-59fa4f6a67ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Lock "cinder-quobyte-b3603331-0911-48eb-9973-4f9dc95e246a-951d4623-3216-4131-8967-3b1c3e60dbd6" acquired by "_create_volume_from_snapshot" :: waited 0.071s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Creating volume 951d4623-3216-4131-8967-3b1c3e60dbd6 from snapshot b3603331-0911-48eb-9973-4f9dc95e246a {{(pid=87007) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Acquiring lock "cinder-quobyte-951d4623-3216-4131-8967-3b1c3e60dbd6" by "_copy_volume_from_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b80f5bc5-f9f2-40ef-9137-002e4a562109 tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da032998-bb27-4df1-ae08-72ec7c3aac44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1471183463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=073ee88e-8347-47a8-97cb-5178b7fe39da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04fa2c7a8efb43c9b0d435efadadbf3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:33:52Z,use_quota=True,user_id='989919ea70764178b7cdbe37f93c0695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b80f5bc5-f9f2-40ef-9137-002e4a562109 tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d63b689-dc0d-4a85-86b8-450037172df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b80f5bc5-f9f2-40ef-9137-002e4a562109 tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d63b689-dc0d-4a85-86b8-450037172df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b80f5bc5-f9f2-40ef-9137-002e4a562109 tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (718c7fc3-884e-4b9a-ab6b-1f51814a7984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b80f5bc5-f9f2-40ef-9137-002e4a562109 tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (718c7fc3-884e-4b9a-ab6b-1f51814a7984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '073ee88e-8347-47a8-97cb-5178b7fe39da', 'volume_name': 'volume-073ee88e-8347-47a8-97cb-5178b7fe39da', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b80f5bc5-f9f2-40ef-9137-002e4a562109 tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cb06d95-4013-4c7c-8596-bfec1c342aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b80f5bc5-f9f2-40ef-9137-002e4a562109 tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cb06d95-4013-4c7c-8596-bfec1c342aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b80f5bc5-f9f2-40ef-9137-002e4a562109 tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afd92fa5-a4c6-42f2-b40d-14199bbb0b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:51 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-b80f5bc5-f9f2-40ef-9137-002e4a562109 tempest-ProjectReaderTests-1337665981 None] Volume 073ee88e-8347-47a8-97cb-5178b7fe39da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-073ee88e-8347-47a8-97cb-5178b7fe39da', 'volume_size': 1} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b80f5bc5-f9f2-40ef-9137-002e4a562109 tempest-ProjectReaderTests-1337665981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:33:51 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-6877c298-7f23-448b-a833-e626cecc169b tempest-CreateVolumesFromImageTest-2104690810 None] Volume volume-67042893-2f78-42e0-aed8-a69be4dff5cb (67042893-2f78-42e0-aed8-a69be4dff5cb): created successfully Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6877c298-7f23-448b-a833-e626cecc169b tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (871a628d-9fe0-49f0-8dcd-59fa4f6a67ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6877c298-7f23-448b-a833-e626cecc169b tempest-CreateVolumesFromImageTest-2104690810 None] Flow 'volume_create_manager' (7068bace-1701-457b-85a0-73fbcddc63f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Lock "cinder-quobyte-951d4623-3216-4131-8967-3b1c3e60dbd6" acquired by "_copy_volume_from_snapshot" :: waited 0.068s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] snapshot: b3603331-0911-48eb-9973-4f9dc95e246a, volume: 951d4623-3216-4131-8967-3b1c3e60dbd6, {{(pid=87007) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:33:51 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-6877c298-7f23-448b-a833-e626cecc169b tempest-CreateVolumesFromImageTest-2104690810 None] Created volume successfully. Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc07296-cbd4-4344-9748-2df9a17058c2]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a.b3603331-0911-48eb-9973-4f9dc95e246a {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:51 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.321s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG oslo_service.periodic_task [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running periodic task VolumeManager._thread_info {{(pid=87007) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] thread count: 28 {{(pid=87007) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 14:33:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] thread info: [<_MainThread(MainThread, started 123689171054720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87007) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 14:33:52 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a.b3603331-0911-48eb-9973-4f9dc95e246a Sep 03 14:33:52 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:52 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a.b3603331-0911-48eb-9973-4f9dc95e246a" returned: 0 in 0.408s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:52 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:33:52 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f6e5eb-13f3-40ad-9fb4-5a22bc672dc8]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:33:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:52 devstack sudo[105228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a Sep 03 14:33:52 devstack sudo[105228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:52 devstack sudo[105228]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a" returned: 0 in 0.406s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:52 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a {{(pid=87007) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 14:33:52 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Creating direct copy from snapshot {{(pid=87007) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 14:33:52 devstack cinder-volume[87007]: DEBUG cinder.utils [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Path /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-951d4623-3216-4131-8967-3b1c3e60dbd6 not found in is_blk_device check {{(pid=87007) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 14:33:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-951d4623-3216-4131-8967-3b1c3e60dbd6 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:52 devstack sudo[105233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-951d4623-3216-4131-8967-3b1c3e60dbd6 Sep 03 14:33:52 devstack sudo[105233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:58 devstack sudo[105233]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-951d4623-3216-4131-8967-3b1c3e60dbd6" returned: 0 in 6.080s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:58 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Image conversion details: src /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a, size 1024.00 MB, duration 6.08 sec, destination /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-951d4623-3216-4131-8967-3b1c3e60dbd6 {{(pid=87007) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 14:33:58 devstack cinder-volume[87007]: INFO cinder.image.image_utils [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Converted 1024.00 MB image at 168.40 MB/s Sep 03 14:33:58 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-951d4623-3216-4131-8967-3b1c3e60dbd6 is being set with open permissions: ugo+rw Sep 03 14:33:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-951d4623-3216-4131-8967-3b1c3e60dbd6 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:58 devstack sudo[105265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-951d4623-3216-4131-8967-3b1c3e60dbd6 Sep 03 14:33:58 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:59 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-951d4623-3216-4131-8967-3b1c3e60dbd6" returned: 0 in 0.265s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:59 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Lock "cinder-quobyte-951d4623-3216-4131-8967-3b1c3e60dbd6" released by "_copy_volume_from_snapshot" :: held 7.259s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:33:59 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:SELECT=116,cinder:UPDATE=130,cinder:INSERT=38,cinder:DELETE=10 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:33:59 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:SELECT=111,cinder:UPDATE=135,cinder:INSERT=39,cinder:DELETE=14 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:33:59 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Lock "cinder-quobyte-b3603331-0911-48eb-9973-4f9dc95e246a-951d4623-3216-4131-8967-3b1c3e60dbd6" released by "_create_volume_from_snapshot" :: held 7.413s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:33:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.485s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:33:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-20d8a1c7-0803-4011-93d2-8623fc449dcb tempest-CreateVolumesFromImageTest-2104690810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.464s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:33:59 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-20d8a1c7-0803-4011-93d2-8623fc449dcb tempest-CreateVolumesFromImageTest-2104690810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1138028109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=368a89e9-3a5a-473e-9a1c-8d31138fb135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b5f0f4bfaee4618898f7b823c820242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:33:50Z,use_quota=True,user_id='2adef300e1164c9a89d2a1a297533963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:33:59 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-20d8a1c7-0803-4011-93d2-8623fc449dcb tempest-CreateVolumesFromImageTest-2104690810 None] Creating volume 368a89e9-3a5a-473e-9a1c-8d31138fb135 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:33:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-20d8a1c7-0803-4011-93d2-8623fc449dcb tempest-CreateVolumesFromImageTest-2104690810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:33:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-20d8a1c7-0803-4011-93d2-8623fc449dcb tempest-CreateVolumesFromImageTest-2104690810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:33:59 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-20d8a1c7-0803-4011-93d2-8623fc449dcb tempest-CreateVolumesFromImageTest-2104690810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:33:59 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-20d8a1c7-0803-4011-93d2-8623fc449dcb tempest-CreateVolumesFromImageTest-2104690810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:33:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-20d8a1c7-0803-4011-93d2-8623fc449dcb tempest-CreateVolumesFromImageTest-2104690810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:33:59 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-20d8a1c7-0803-4011-93d2-8623fc449dcb tempest-CreateVolumesFromImageTest-2104690810 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:33:59 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-20d8a1c7-0803-4011-93d2-8623fc449dcb tempest-CreateVolumesFromImageTest-2104690810 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:33:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-20d8a1c7-0803-4011-93d2-8623fc449dcb tempest-CreateVolumesFromImageTest-2104690810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-368a89e9-3a5a-473e-9a1c-8d31138fb135 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:33:59 devstack sudo[105278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-368a89e9-3a5a-473e-9a1c-8d31138fb135 1073741824 Sep 03 14:33:59 devstack sudo[105278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:33:59 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a46a4795-da2e-4d22-b7e7-9ae2a9a103d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-951d4623-3216-4131-8967-3b1c3e60dbd6', 'volume_size': 1, 'snapshot_id': 'b3603331-0911-48eb-9973-4f9dc95e246a'}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:59 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d26dcbf5-4130-413c-95ef-c5298a8b7a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:33:59 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Volume volume-951d4623-3216-4131-8967-3b1c3e60dbd6 (951d4623-3216-4131-8967-3b1c3e60dbd6): created successfully Sep 03 14:33:59 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d26dcbf5-4130-413c-95ef-c5298a8b7a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:33:59 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Flow 'volume_create_manager' (c00af3da-bafa-4d23-a517-c5a1922159f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:33:59 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-908f9441-1939-4a1e-adc9-017055e7436c tempest-TestStampPattern-355266855 None] Created volume successfully. Sep 03 14:33:59 devstack sudo[105278]: pam_unix(sudo:session): session closed for user root Sep 03 14:33:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-20d8a1c7-0803-4011-93d2-8623fc449dcb tempest-CreateVolumesFromImageTest-2104690810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-368a89e9-3a5a-473e-9a1c-8d31138fb135 1073741824" returned: 0 in 0.694s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:33:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-20d8a1c7-0803-4011-93d2-8623fc449dcb tempest-CreateVolumesFromImageTest-2104690810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-368a89e9-3a5a-473e-9a1c-8d31138fb135 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:00 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-368a89e9-3a5a-473e-9a1c-8d31138fb135 Sep 03 14:34:00 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:00 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-20d8a1c7-0803-4011-93d2-8623fc449dcb tempest-CreateVolumesFromImageTest-2104690810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-368a89e9-3a5a-473e-9a1c-8d31138fb135" returned: 0 in 0.534s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:00 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-20d8a1c7-0803-4011-93d2-8623fc449dcb tempest-CreateVolumesFromImageTest-2104690810 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:34:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-20d8a1c7-0803-4011-93d2-8623fc449dcb tempest-CreateVolumesFromImageTest-2104690810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.305s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:34:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-af058663-06ba-4e2a-99fd-2b22aa5d5a3f tempest-CreateVolumesFromImageTest-2104690810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.622s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:34:00 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-af058663-06ba-4e2a-99fd-2b22aa5d5a3f tempest-CreateVolumesFromImageTest-2104690810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1422420686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2f0ea78-4d0f-42cd-a86a-d4f6423f552b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b5f0f4bfaee4618898f7b823c820242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:33:51Z,use_quota=True,user_id='2adef300e1164c9a89d2a1a297533963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:34:00 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-af058663-06ba-4e2a-99fd-2b22aa5d5a3f tempest-CreateVolumesFromImageTest-2104690810 None] Creating volume a2f0ea78-4d0f-42cd-a86a-d4f6423f552b {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:34:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-af058663-06ba-4e2a-99fd-2b22aa5d5a3f tempest-CreateVolumesFromImageTest-2104690810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:34:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-af058663-06ba-4e2a-99fd-2b22aa5d5a3f tempest-CreateVolumesFromImageTest-2104690810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:34:00 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-af058663-06ba-4e2a-99fd-2b22aa5d5a3f tempest-CreateVolumesFromImageTest-2104690810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:34:00 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-af058663-06ba-4e2a-99fd-2b22aa5d5a3f tempest-CreateVolumesFromImageTest-2104690810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:34:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-af058663-06ba-4e2a-99fd-2b22aa5d5a3f tempest-CreateVolumesFromImageTest-2104690810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:34:00 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-af058663-06ba-4e2a-99fd-2b22aa5d5a3f tempest-CreateVolumesFromImageTest-2104690810 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:34:00 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-af058663-06ba-4e2a-99fd-2b22aa5d5a3f tempest-CreateVolumesFromImageTest-2104690810 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:34:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-af058663-06ba-4e2a-99fd-2b22aa5d5a3f tempest-CreateVolumesFromImageTest-2104690810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a2f0ea78-4d0f-42cd-a86a-d4f6423f552b 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:00 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-20d8a1c7-0803-4011-93d2-8623fc449dcb tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c93d77a6-d413-4882-b8a8-45e993ee5f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-368a89e9-3a5a-473e-9a1c-8d31138fb135', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:34:00 devstack sudo[105330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a2f0ea78-4d0f-42cd-a86a-d4f6423f552b 1073741824 Sep 03 14:34:00 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:00 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-20d8a1c7-0803-4011-93d2-8623fc449dcb tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (317c1207-97df-48f5-990f-44f5446b020f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:34:00 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-20d8a1c7-0803-4011-93d2-8623fc449dcb tempest-CreateVolumesFromImageTest-2104690810 None] Volume volume-368a89e9-3a5a-473e-9a1c-8d31138fb135 (368a89e9-3a5a-473e-9a1c-8d31138fb135): created successfully Sep 03 14:34:00 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-20d8a1c7-0803-4011-93d2-8623fc449dcb tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (317c1207-97df-48f5-990f-44f5446b020f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:34:00 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-20d8a1c7-0803-4011-93d2-8623fc449dcb tempest-CreateVolumesFromImageTest-2104690810 None] Flow 'volume_create_manager' (cb56b15f-fa55-4a0c-bf46-51f83e90d17a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:34:00 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-20d8a1c7-0803-4011-93d2-8623fc449dcb tempest-CreateVolumesFromImageTest-2104690810 None] Created volume successfully. Sep 03 14:34:01 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-af058663-06ba-4e2a-99fd-2b22aa5d5a3f tempest-CreateVolumesFromImageTest-2104690810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a2f0ea78-4d0f-42cd-a86a-d4f6423f552b 1073741824" returned: 0 in 0.577s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-af058663-06ba-4e2a-99fd-2b22aa5d5a3f tempest-CreateVolumesFromImageTest-2104690810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a2f0ea78-4d0f-42cd-a86a-d4f6423f552b {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:01 devstack sudo[105339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a2f0ea78-4d0f-42cd-a86a-d4f6423f552b Sep 03 14:34:01 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:01 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-af058663-06ba-4e2a-99fd-2b22aa5d5a3f tempest-CreateVolumesFromImageTest-2104690810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a2f0ea78-4d0f-42cd-a86a-d4f6423f552b" returned: 0 in 0.267s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:01 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-af058663-06ba-4e2a-99fd-2b22aa5d5a3f tempest-CreateVolumesFromImageTest-2104690810 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:34:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-af058663-06ba-4e2a-99fd-2b22aa5d5a3f tempest-CreateVolumesFromImageTest-2104690810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:34:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-cf8017aa-f11d-4f2a-ae5f-536326dab318 tempest-CreateVolumesFromImageTest-2104690810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.025s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:34:01 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-cf8017aa-f11d-4f2a-ae5f-536326dab318 tempest-CreateVolumesFromImageTest-2104690810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1427916490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f16a26c-9a31-4717-81a7-ead752661549,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b5f0f4bfaee4618898f7b823c820242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:33:51Z,use_quota=True,user_id='2adef300e1164c9a89d2a1a297533963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:34:01 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-cf8017aa-f11d-4f2a-ae5f-536326dab318 tempest-CreateVolumesFromImageTest-2104690810 None] Creating volume 7f16a26c-9a31-4717-81a7-ead752661549 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:34:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-cf8017aa-f11d-4f2a-ae5f-536326dab318 tempest-CreateVolumesFromImageTest-2104690810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:34:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-cf8017aa-f11d-4f2a-ae5f-536326dab318 tempest-CreateVolumesFromImageTest-2104690810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:34:01 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-cf8017aa-f11d-4f2a-ae5f-536326dab318 tempest-CreateVolumesFromImageTest-2104690810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:34:01 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-cf8017aa-f11d-4f2a-ae5f-536326dab318 tempest-CreateVolumesFromImageTest-2104690810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:34:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-cf8017aa-f11d-4f2a-ae5f-536326dab318 tempest-CreateVolumesFromImageTest-2104690810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:34:01 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-cf8017aa-f11d-4f2a-ae5f-536326dab318 tempest-CreateVolumesFromImageTest-2104690810 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:34:01 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-cf8017aa-f11d-4f2a-ae5f-536326dab318 tempest-CreateVolumesFromImageTest-2104690810 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:34:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-cf8017aa-f11d-4f2a-ae5f-536326dab318 tempest-CreateVolumesFromImageTest-2104690810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7f16a26c-9a31-4717-81a7-ead752661549 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:01 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-af058663-06ba-4e2a-99fd-2b22aa5d5a3f tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68a5a002-2f07-4dfa-948c-24a23163fe70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2f0ea78-4d0f-42cd-a86a-d4f6423f552b', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:34:01 devstack sudo[105342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7f16a26c-9a31-4717-81a7-ead752661549 1073741824 Sep 03 14:34:01 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-af058663-06ba-4e2a-99fd-2b22aa5d5a3f tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (115b1d48-56f4-4859-ba63-89bd345da220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:34:01 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:01 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-af058663-06ba-4e2a-99fd-2b22aa5d5a3f tempest-CreateVolumesFromImageTest-2104690810 None] Volume volume-a2f0ea78-4d0f-42cd-a86a-d4f6423f552b (a2f0ea78-4d0f-42cd-a86a-d4f6423f552b): created successfully Sep 03 14:34:01 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-af058663-06ba-4e2a-99fd-2b22aa5d5a3f tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (115b1d48-56f4-4859-ba63-89bd345da220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:34:01 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-af058663-06ba-4e2a-99fd-2b22aa5d5a3f tempest-CreateVolumesFromImageTest-2104690810 None] Flow 'volume_create_manager' (5e5b0fb5-64e6-40a1-bde0-06435c11050e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:34:01 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-af058663-06ba-4e2a-99fd-2b22aa5d5a3f tempest-CreateVolumesFromImageTest-2104690810 None] Created volume successfully. Sep 03 14:34:01 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-cf8017aa-f11d-4f2a-ae5f-536326dab318 tempest-CreateVolumesFromImageTest-2104690810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7f16a26c-9a31-4717-81a7-ead752661549 1073741824" returned: 0 in 0.567s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-cf8017aa-f11d-4f2a-ae5f-536326dab318 tempest-CreateVolumesFromImageTest-2104690810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7f16a26c-9a31-4717-81a7-ead752661549 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:02 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7f16a26c-9a31-4717-81a7-ead752661549 Sep 03 14:34:02 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:02 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-cf8017aa-f11d-4f2a-ae5f-536326dab318 tempest-CreateVolumesFromImageTest-2104690810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7f16a26c-9a31-4717-81a7-ead752661549" returned: 0 in 0.313s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:02 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-cf8017aa-f11d-4f2a-ae5f-536326dab318 tempest-CreateVolumesFromImageTest-2104690810 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:34:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-cf8017aa-f11d-4f2a-ae5f-536326dab318 tempest-CreateVolumesFromImageTest-2104690810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:34:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b80f5bc5-f9f2-40ef-9137-002e4a562109 tempest-ProjectReaderTests-1337665981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.529s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:34:02 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b80f5bc5-f9f2-40ef-9137-002e4a562109 tempest-ProjectReaderTests-1337665981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1471183463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=073ee88e-8347-47a8-97cb-5178b7fe39da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04fa2c7a8efb43c9b0d435efadadbf3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:33:52Z,use_quota=True,user_id='989919ea70764178b7cdbe37f93c0695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:34:02 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-b80f5bc5-f9f2-40ef-9137-002e4a562109 tempest-ProjectReaderTests-1337665981 None] Creating volume 073ee88e-8347-47a8-97cb-5178b7fe39da {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:34:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b80f5bc5-f9f2-40ef-9137-002e4a562109 tempest-ProjectReaderTests-1337665981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:34:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b80f5bc5-f9f2-40ef-9137-002e4a562109 tempest-ProjectReaderTests-1337665981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:34:02 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b80f5bc5-f9f2-40ef-9137-002e4a562109 tempest-ProjectReaderTests-1337665981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:34:02 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b80f5bc5-f9f2-40ef-9137-002e4a562109 tempest-ProjectReaderTests-1337665981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:34:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b80f5bc5-f9f2-40ef-9137-002e4a562109 tempest-ProjectReaderTests-1337665981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:34:02 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b80f5bc5-f9f2-40ef-9137-002e4a562109 tempest-ProjectReaderTests-1337665981 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:34:02 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-b80f5bc5-f9f2-40ef-9137-002e4a562109 tempest-ProjectReaderTests-1337665981 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:34:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b80f5bc5-f9f2-40ef-9137-002e4a562109 tempest-ProjectReaderTests-1337665981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-073ee88e-8347-47a8-97cb-5178b7fe39da 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:02 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cf8017aa-f11d-4f2a-ae5f-536326dab318 tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1f6bd17-54fa-4458-91e0-08da47af129e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f16a26c-9a31-4717-81a7-ead752661549', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:34:02 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cf8017aa-f11d-4f2a-ae5f-536326dab318 tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ebb18d5-41fe-443e-9497-6ed328454d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:34:02 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-073ee88e-8347-47a8-97cb-5178b7fe39da 1073741824 Sep 03 14:34:02 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:02 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-cf8017aa-f11d-4f2a-ae5f-536326dab318 tempest-CreateVolumesFromImageTest-2104690810 None] Volume volume-7f16a26c-9a31-4717-81a7-ead752661549 (7f16a26c-9a31-4717-81a7-ead752661549): created successfully Sep 03 14:34:02 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cf8017aa-f11d-4f2a-ae5f-536326dab318 tempest-CreateVolumesFromImageTest-2104690810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ebb18d5-41fe-443e-9497-6ed328454d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:34:02 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cf8017aa-f11d-4f2a-ae5f-536326dab318 tempest-CreateVolumesFromImageTest-2104690810 None] Flow 'volume_create_manager' (c9a9f587-16a8-4f09-bf8b-e817837867f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:34:02 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-cf8017aa-f11d-4f2a-ae5f-536326dab318 tempest-CreateVolumesFromImageTest-2104690810 None] Created volume successfully. Sep 03 14:34:02 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-34b2f3a4-e962-44b7-8099-d8e2d36c4948 tempest-CreateVolumesFromImageTest-2104690810 None] Acquiring lock "cinder-7f16a26c-9a31-4717-81a7-ead752661549-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:34:02 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-34b2f3a4-e962-44b7-8099-d8e2d36c4948 tempest-CreateVolumesFromImageTest-2104690810 None] Lock "cinder-7f16a26c-9a31-4717-81a7-ead752661549-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:34:02 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-34b2f3a4-e962-44b7-8099-d8e2d36c4948 tempest-CreateVolumesFromImageTest-2104690810 None] Acquiring lock "cinder-quobyte-7f16a26c-9a31-4717-81a7-ead752661549" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:34:02 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-34b2f3a4-e962-44b7-8099-d8e2d36c4948 tempest-CreateVolumesFromImageTest-2104690810 None] Lock "cinder-quobyte-7f16a26c-9a31-4717-81a7-ead752661549" acquired by "delete_volume" :: waited 0.033s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:34:02 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddfa25c-ce8f-4c38-aa1c-57417e9d02e6]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:34:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-34b2f3a4-e962-44b7-8099-d8e2d36c4948 tempest-CreateVolumesFromImageTest-2104690810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7f16a26c-9a31-4717-81a7-ead752661549 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:03 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7f16a26c-9a31-4717-81a7-ead752661549 Sep 03 14:34:03 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:03 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b80f5bc5-f9f2-40ef-9137-002e4a562109 tempest-ProjectReaderTests-1337665981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-073ee88e-8347-47a8-97cb-5178b7fe39da 1073741824" returned: 0 in 0.813s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b80f5bc5-f9f2-40ef-9137-002e4a562109 tempest-ProjectReaderTests-1337665981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-073ee88e-8347-47a8-97cb-5178b7fe39da {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:03 devstack sudo[105358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-073ee88e-8347-47a8-97cb-5178b7fe39da Sep 03 14:34:03 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:03 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-34b2f3a4-e962-44b7-8099-d8e2d36c4948 tempest-CreateVolumesFromImageTest-2104690810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7f16a26c-9a31-4717-81a7-ead752661549" returned: 0 in 0.561s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-34b2f3a4-e962-44b7-8099-d8e2d36c4948 tempest-CreateVolumesFromImageTest-2104690810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7f16a26c-9a31-4717-81a7-ead752661549 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:03 devstack sudo[105364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7f16a26c-9a31-4717-81a7-ead752661549 Sep 03 14:34:03 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:03 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b80f5bc5-f9f2-40ef-9137-002e4a562109 tempest-ProjectReaderTests-1337665981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-073ee88e-8347-47a8-97cb-5178b7fe39da" returned: 0 in 0.404s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:03 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b80f5bc5-f9f2-40ef-9137-002e4a562109 tempest-ProjectReaderTests-1337665981 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:34:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b80f5bc5-f9f2-40ef-9137-002e4a562109 tempest-ProjectReaderTests-1337665981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.282s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:34:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b80f5bc5-f9f2-40ef-9137-002e4a562109 tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afd92fa5-a4c6-42f2-b40d-14199bbb0b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-073ee88e-8347-47a8-97cb-5178b7fe39da', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:34:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b80f5bc5-f9f2-40ef-9137-002e4a562109 tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5df47571-5f0c-416f-ac0d-4657a0aea37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:34:03 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-b80f5bc5-f9f2-40ef-9137-002e4a562109 tempest-ProjectReaderTests-1337665981 None] Volume volume-073ee88e-8347-47a8-97cb-5178b7fe39da (073ee88e-8347-47a8-97cb-5178b7fe39da): created successfully Sep 03 14:34:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b80f5bc5-f9f2-40ef-9137-002e4a562109 tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5df47571-5f0c-416f-ac0d-4657a0aea37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:34:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b80f5bc5-f9f2-40ef-9137-002e4a562109 tempest-ProjectReaderTests-1337665981 None] Flow 'volume_create_manager' (902602de-56c1-4655-b6be-45764c0f9d54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:34:03 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-b80f5bc5-f9f2-40ef-9137-002e4a562109 tempest-ProjectReaderTests-1337665981 None] Created volume successfully. Sep 03 14:34:03 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-34b2f3a4-e962-44b7-8099-d8e2d36c4948 tempest-CreateVolumesFromImageTest-2104690810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7f16a26c-9a31-4717-81a7-ead752661549" returned: 0 in 0.293s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:03 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-34b2f3a4-e962-44b7-8099-d8e2d36c4948 tempest-CreateVolumesFromImageTest-2104690810 None] Lock "cinder-quobyte-7f16a26c-9a31-4717-81a7-ead752661549" released by "delete_volume" :: held 0.911s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:34:03 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-34b2f3a4-e962-44b7-8099-d8e2d36c4948 tempest-CreateVolumesFromImageTest-2104690810 None] Created reservations ['0487a2a1-188d-41ba-ac6d-8ba59333036f', '52a3afb4-5a56-4640-8c63-5b26104c02e9', 'd3395df5-63da-4670-9a06-41acb7f3f30e', '4c060872-eed3-4405-9304-fe4a6b69935c'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:34:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-34b2f3a4-e962-44b7-8099-d8e2d36c4948 tempest-CreateVolumesFromImageTest-2104690810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:34:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-34b2f3a4-e962-44b7-8099-d8e2d36c4948 tempest-CreateVolumesFromImageTest-2104690810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:34:04 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-34b2f3a4-e962-44b7-8099-d8e2d36c4948 tempest-CreateVolumesFromImageTest-2104690810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:34:04 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-34b2f3a4-e962-44b7-8099-d8e2d36c4948 tempest-CreateVolumesFromImageTest-2104690810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:34:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-34b2f3a4-e962-44b7-8099-d8e2d36c4948 tempest-CreateVolumesFromImageTest-2104690810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:34:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-34b2f3a4-e962-44b7-8099-d8e2d36c4948 tempest-CreateVolumesFromImageTest-2104690810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:04 devstack sudo[105368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:34:04 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:04 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ec017d4e-1500-407b-99bf-ef5d0cbdbd08 tempest-ProjectReaderTests-1337665981 None] Acquiring lock "cinder-073ee88e-8347-47a8-97cb-5178b7fe39da-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:34:04 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ec017d4e-1500-407b-99bf-ef5d0cbdbd08 tempest-ProjectReaderTests-1337665981 None] Lock "cinder-073ee88e-8347-47a8-97cb-5178b7fe39da-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:34:04 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ec017d4e-1500-407b-99bf-ef5d0cbdbd08 tempest-ProjectReaderTests-1337665981 None] Acquiring lock "cinder-quobyte-073ee88e-8347-47a8-97cb-5178b7fe39da" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:34:04 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ec017d4e-1500-407b-99bf-ef5d0cbdbd08 tempest-ProjectReaderTests-1337665981 None] Lock "cinder-quobyte-073ee88e-8347-47a8-97cb-5178b7fe39da" acquired by "delete_volume" :: waited 0.053s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:34:04 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[12768445-07d8-4dd4-bb5e-7044df823e2a]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:34:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ec017d4e-1500-407b-99bf-ef5d0cbdbd08 tempest-ProjectReaderTests-1337665981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-073ee88e-8347-47a8-97cb-5178b7fe39da {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:04 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-34b2f3a4-e962-44b7-8099-d8e2d36c4948 tempest-CreateVolumesFromImageTest-2104690810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.374s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:04 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-34b2f3a4-e962-44b7-8099-d8e2d36c4948 tempest-CreateVolumesFromImageTest-2104690810 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:34:04 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-34b2f3a4-e962-44b7-8099-d8e2d36c4948 tempest-CreateVolumesFromImageTest-2104690810 None] Deleted volume successfully. Sep 03 14:34:04 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-34b2f3a4-e962-44b7-8099-d8e2d36c4948 tempest-CreateVolumesFromImageTest-2104690810 None] Lock "cinder-7f16a26c-9a31-4717-81a7-ead752661549-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:34:04 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-073ee88e-8347-47a8-97cb-5178b7fe39da Sep 03 14:34:04 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:04 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ec017d4e-1500-407b-99bf-ef5d0cbdbd08 tempest-ProjectReaderTests-1337665981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-073ee88e-8347-47a8-97cb-5178b7fe39da" returned: 0 in 0.410s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ec017d4e-1500-407b-99bf-ef5d0cbdbd08 tempest-ProjectReaderTests-1337665981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-073ee88e-8347-47a8-97cb-5178b7fe39da {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:04 devstack sudo[105378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-073ee88e-8347-47a8-97cb-5178b7fe39da Sep 03 14:34:04 devstack sudo[105378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:05 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1cb2f984-9729-427e-9aec-54de2d9de547 tempest-CreateVolumesFromImageTest-2104690810 None] Acquiring lock "cinder-a2f0ea78-4d0f-42cd-a86a-d4f6423f552b-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:34:05 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1cb2f984-9729-427e-9aec-54de2d9de547 tempest-CreateVolumesFromImageTest-2104690810 None] Lock "cinder-a2f0ea78-4d0f-42cd-a86a-d4f6423f552b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:34:05 devstack sudo[105378]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ec017d4e-1500-407b-99bf-ef5d0cbdbd08 tempest-ProjectReaderTests-1337665981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-073ee88e-8347-47a8-97cb-5178b7fe39da" returned: 0 in 0.343s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:05 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ec017d4e-1500-407b-99bf-ef5d0cbdbd08 tempest-ProjectReaderTests-1337665981 None] Lock "cinder-quobyte-073ee88e-8347-47a8-97cb-5178b7fe39da" released by "delete_volume" :: held 0.812s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:34:05 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1cb2f984-9729-427e-9aec-54de2d9de547 tempest-CreateVolumesFromImageTest-2104690810 None] Acquiring lock "cinder-quobyte-a2f0ea78-4d0f-42cd-a86a-d4f6423f552b" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:34:05 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1cb2f984-9729-427e-9aec-54de2d9de547 tempest-CreateVolumesFromImageTest-2104690810 None] Lock "cinder-quobyte-a2f0ea78-4d0f-42cd-a86a-d4f6423f552b" acquired by "delete_volume" :: waited 0.029s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:34:05 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e698fa70-a665-417d-b385-b1da0413d1a6]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:34:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1cb2f984-9729-427e-9aec-54de2d9de547 tempest-CreateVolumesFromImageTest-2104690810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a2f0ea78-4d0f-42cd-a86a-d4f6423f552b {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:05 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-ec017d4e-1500-407b-99bf-ef5d0cbdbd08 tempest-ProjectReaderTests-1337665981 None] Created reservations ['66f50658-42cf-4ef9-a59d-f61e77971e8c', '462a7761-e4d2-4197-8dba-88438669e03e', 'bc3a69a0-9ef5-4077-8629-84c98e5e67a9', '58bcdd5b-e194-4fee-90e5-c64efa88c5b7'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:34:05 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a2f0ea78-4d0f-42cd-a86a-d4f6423f552b Sep 03 14:34:05 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ec017d4e-1500-407b-99bf-ef5d0cbdbd08 tempest-ProjectReaderTests-1337665981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:34:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ec017d4e-1500-407b-99bf-ef5d0cbdbd08 tempest-ProjectReaderTests-1337665981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:34:05 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ec017d4e-1500-407b-99bf-ef5d0cbdbd08 tempest-ProjectReaderTests-1337665981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:34:05 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ec017d4e-1500-407b-99bf-ef5d0cbdbd08 tempest-ProjectReaderTests-1337665981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:34:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ec017d4e-1500-407b-99bf-ef5d0cbdbd08 tempest-ProjectReaderTests-1337665981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:34:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ec017d4e-1500-407b-99bf-ef5d0cbdbd08 tempest-ProjectReaderTests-1337665981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:05 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:34:05 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:05 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1cb2f984-9729-427e-9aec-54de2d9de547 tempest-CreateVolumesFromImageTest-2104690810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a2f0ea78-4d0f-42cd-a86a-d4f6423f552b" returned: 0 in 0.431s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1cb2f984-9729-427e-9aec-54de2d9de547 tempest-CreateVolumesFromImageTest-2104690810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a2f0ea78-4d0f-42cd-a86a-d4f6423f552b {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:05 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ec017d4e-1500-407b-99bf-ef5d0cbdbd08 tempest-ProjectReaderTests-1337665981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.265s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:05 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-ec017d4e-1500-407b-99bf-ef5d0cbdbd08 tempest-ProjectReaderTests-1337665981 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:34:05 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-ec017d4e-1500-407b-99bf-ef5d0cbdbd08 tempest-ProjectReaderTests-1337665981 None] Deleted volume successfully. Sep 03 14:34:05 devstack sudo[105389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a2f0ea78-4d0f-42cd-a86a-d4f6423f552b Sep 03 14:34:05 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:05 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ec017d4e-1500-407b-99bf-ef5d0cbdbd08 tempest-ProjectReaderTests-1337665981 None] Lock "cinder-073ee88e-8347-47a8-97cb-5178b7fe39da-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:34:05 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1cb2f984-9729-427e-9aec-54de2d9de547 tempest-CreateVolumesFromImageTest-2104690810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a2f0ea78-4d0f-42cd-a86a-d4f6423f552b" returned: 0 in 0.241s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:05 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1cb2f984-9729-427e-9aec-54de2d9de547 tempest-CreateVolumesFromImageTest-2104690810 None] Lock "cinder-quobyte-a2f0ea78-4d0f-42cd-a86a-d4f6423f552b" released by "delete_volume" :: held 0.717s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:34:05 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-1cb2f984-9729-427e-9aec-54de2d9de547 tempest-CreateVolumesFromImageTest-2104690810 None] Created reservations ['27d0ae2d-e529-4eae-b363-02493597d4ba', 'f628bd28-ceec-41e1-ad19-6a94479975a1', 'feff13b6-f7a1-4e9e-9133-ebec939f44c5', 'c8c82f5c-518a-4f35-8ce1-4a617443a4b3'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:34:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1cb2f984-9729-427e-9aec-54de2d9de547 tempest-CreateVolumesFromImageTest-2104690810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:34:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1cb2f984-9729-427e-9aec-54de2d9de547 tempest-CreateVolumesFromImageTest-2104690810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:34:06 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-1cb2f984-9729-427e-9aec-54de2d9de547 tempest-CreateVolumesFromImageTest-2104690810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:34:06 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-1cb2f984-9729-427e-9aec-54de2d9de547 tempest-CreateVolumesFromImageTest-2104690810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:34:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1cb2f984-9729-427e-9aec-54de2d9de547 tempest-CreateVolumesFromImageTest-2104690810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:34:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1cb2f984-9729-427e-9aec-54de2d9de547 tempest-CreateVolumesFromImageTest-2104690810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:06 devstack sudo[105392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:34:06 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:06 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a9eceacb-1654-4619-b801-928aa7d7c6af tempest-CreateVolumesFromImageTest-2104690810 None] Acquiring lock "cinder-368a89e9-3a5a-473e-9a1c-8d31138fb135-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:34:06 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:06 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a9eceacb-1654-4619-b801-928aa7d7c6af tempest-CreateVolumesFromImageTest-2104690810 None] Lock "cinder-368a89e9-3a5a-473e-9a1c-8d31138fb135-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:34:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1cb2f984-9729-427e-9aec-54de2d9de547 tempest-CreateVolumesFromImageTest-2104690810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.268s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:06 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-1cb2f984-9729-427e-9aec-54de2d9de547 tempest-CreateVolumesFromImageTest-2104690810 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:34:06 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-1cb2f984-9729-427e-9aec-54de2d9de547 tempest-CreateVolumesFromImageTest-2104690810 None] Deleted volume successfully. Sep 03 14:34:06 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1cb2f984-9729-427e-9aec-54de2d9de547 tempest-CreateVolumesFromImageTest-2104690810 None] Lock "cinder-a2f0ea78-4d0f-42cd-a86a-d4f6423f552b-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:34:06 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a9eceacb-1654-4619-b801-928aa7d7c6af tempest-CreateVolumesFromImageTest-2104690810 None] Acquiring lock "cinder-quobyte-368a89e9-3a5a-473e-9a1c-8d31138fb135" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:34:06 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a9eceacb-1654-4619-b801-928aa7d7c6af tempest-CreateVolumesFromImageTest-2104690810 None] Lock "cinder-quobyte-368a89e9-3a5a-473e-9a1c-8d31138fb135" acquired by "delete_volume" :: waited 0.025s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:34:06 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[438ddfe3-81b4-4e59-90be-297306c14e5d]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:34:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a9eceacb-1654-4619-b801-928aa7d7c6af tempest-CreateVolumesFromImageTest-2104690810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-368a89e9-3a5a-473e-9a1c-8d31138fb135 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:06 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-368a89e9-3a5a-473e-9a1c-8d31138fb135 Sep 03 14:34:06 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:06 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a9eceacb-1654-4619-b801-928aa7d7c6af tempest-CreateVolumesFromImageTest-2104690810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-368a89e9-3a5a-473e-9a1c-8d31138fb135" returned: 0 in 0.418s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a9eceacb-1654-4619-b801-928aa7d7c6af tempest-CreateVolumesFromImageTest-2104690810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-368a89e9-3a5a-473e-9a1c-8d31138fb135 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:06 devstack sudo[105402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-368a89e9-3a5a-473e-9a1c-8d31138fb135 Sep 03 14:34:06 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:06 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a5e89d6-c782-4f3b-98d9-f366418fac93 tempest-ProjectReaderTests-1337665981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6a5e89d6-c782-4f3b-98d9-f366418fac93 tempest-ProjectReaderTests-1337665981 None] Flow 'volume_create_manager' (09a40324-7c36-461e-a5bd-f4125ad44bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6a5e89d6-c782-4f3b-98d9-f366418fac93 tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e4d14ea-b62a-4988-85ef-ec9f54efc487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6a5e89d6-c782-4f3b-98d9-f366418fac93 tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e4d14ea-b62a-4988-85ef-ec9f54efc487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1049513771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=467c980c-0ecb-44ce-a426-43330e5371ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04fa2c7a8efb43c9b0d435efadadbf3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:34:07Z,use_quota=True,user_id='989919ea70764178b7cdbe37f93c0695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6a5e89d6-c782-4f3b-98d9-f366418fac93 tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9c5ee00-f744-42b6-ac52-41b72784c419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6a5e89d6-c782-4f3b-98d9-f366418fac93 tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9c5ee00-f744-42b6-ac52-41b72784c419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6a5e89d6-c782-4f3b-98d9-f366418fac93 tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (019fdbf7-d288-4719-b0bd-3c8a8d84eae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6a5e89d6-c782-4f3b-98d9-f366418fac93 tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (019fdbf7-d288-4719-b0bd-3c8a8d84eae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '467c980c-0ecb-44ce-a426-43330e5371ba', 'volume_name': 'volume-467c980c-0ecb-44ce-a426-43330e5371ba', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6a5e89d6-c782-4f3b-98d9-f366418fac93 tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ce71d16-0729-4c58-9c41-167a134808b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6a5e89d6-c782-4f3b-98d9-f366418fac93 tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ce71d16-0729-4c58-9c41-167a134808b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6a5e89d6-c782-4f3b-98d9-f366418fac93 tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eccba17b-51c4-455c-b783-a19f87e83a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:34:07 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-6a5e89d6-c782-4f3b-98d9-f366418fac93 tempest-ProjectReaderTests-1337665981 None] Volume 467c980c-0ecb-44ce-a426-43330e5371ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-467c980c-0ecb-44ce-a426-43330e5371ba', 'volume_size': 1} Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6a5e89d6-c782-4f3b-98d9-f366418fac93 tempest-ProjectReaderTests-1337665981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6a5e89d6-c782-4f3b-98d9-f366418fac93 tempest-ProjectReaderTests-1337665981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-6a5e89d6-c782-4f3b-98d9-f366418fac93 tempest-ProjectReaderTests-1337665981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1049513771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=467c980c-0ecb-44ce-a426-43330e5371ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04fa2c7a8efb43c9b0d435efadadbf3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:34:07Z,use_quota=True,user_id='989919ea70764178b7cdbe37f93c0695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-6a5e89d6-c782-4f3b-98d9-f366418fac93 tempest-ProjectReaderTests-1337665981 None] Creating volume 467c980c-0ecb-44ce-a426-43330e5371ba {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6a5e89d6-c782-4f3b-98d9-f366418fac93 tempest-ProjectReaderTests-1337665981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6a5e89d6-c782-4f3b-98d9-f366418fac93 tempest-ProjectReaderTests-1337665981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-6a5e89d6-c782-4f3b-98d9-f366418fac93 tempest-ProjectReaderTests-1337665981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-6a5e89d6-c782-4f3b-98d9-f366418fac93 tempest-ProjectReaderTests-1337665981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6a5e89d6-c782-4f3b-98d9-f366418fac93 tempest-ProjectReaderTests-1337665981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-6a5e89d6-c782-4f3b-98d9-f366418fac93 tempest-ProjectReaderTests-1337665981 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:34:07 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-6a5e89d6-c782-4f3b-98d9-f366418fac93 tempest-ProjectReaderTests-1337665981 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6a5e89d6-c782-4f3b-98d9-f366418fac93 tempest-ProjectReaderTests-1337665981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-467c980c-0ecb-44ce-a426-43330e5371ba 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:07 devstack sudo[105404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-467c980c-0ecb-44ce-a426-43330e5371ba 1073741824 Sep 03 14:34:07 devstack sudo[105404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:07 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a9eceacb-1654-4619-b801-928aa7d7c6af tempest-CreateVolumesFromImageTest-2104690810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-368a89e9-3a5a-473e-9a1c-8d31138fb135" returned: 0 in 0.271s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a9eceacb-1654-4619-b801-928aa7d7c6af tempest-CreateVolumesFromImageTest-2104690810 None] Lock "cinder-quobyte-368a89e9-3a5a-473e-9a1c-8d31138fb135" released by "delete_volume" :: held 0.739s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-a9eceacb-1654-4619-b801-928aa7d7c6af tempest-CreateVolumesFromImageTest-2104690810 None] Created reservations ['5b3d21a7-1b48-4006-8d3d-24674f0d16ca', '5d86bc48-61d4-443e-906c-b91fe4d86ddf', 'baa25aba-766a-433e-ae04-bbfb2abcd830', 'e001d7a2-993c-4901-8156-838bccfe7c6c'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a9eceacb-1654-4619-b801-928aa7d7c6af tempest-CreateVolumesFromImageTest-2104690810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a9eceacb-1654-4619-b801-928aa7d7c6af tempest-CreateVolumesFromImageTest-2104690810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a9eceacb-1654-4619-b801-928aa7d7c6af tempest-CreateVolumesFromImageTest-2104690810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a9eceacb-1654-4619-b801-928aa7d7c6af tempest-CreateVolumesFromImageTest-2104690810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a9eceacb-1654-4619-b801-928aa7d7c6af tempest-CreateVolumesFromImageTest-2104690810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a9eceacb-1654-4619-b801-928aa7d7c6af tempest-CreateVolumesFromImageTest-2104690810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:07 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:34:07 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-91880a66-9f17-4082-9b66-aa671b43bb3d tempest-CreateVolumesFromImageTest-2104690810 None] Acquiring lock "cinder-67042893-2f78-42e0-aed8-a69be4dff5cb-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-91880a66-9f17-4082-9b66-aa671b43bb3d tempest-CreateVolumesFromImageTest-2104690810 None] Lock "cinder-67042893-2f78-42e0-aed8-a69be4dff5cb-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-91880a66-9f17-4082-9b66-aa671b43bb3d tempest-CreateVolumesFromImageTest-2104690810 None] Acquiring lock "cinder-quobyte-67042893-2f78-42e0-aed8-a69be4dff5cb" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:34:07 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a9eceacb-1654-4619-b801-928aa7d7c6af tempest-CreateVolumesFromImageTest-2104690810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.293s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-a9eceacb-1654-4619-b801-928aa7d7c6af tempest-CreateVolumesFromImageTest-2104690810 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:34:07 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-a9eceacb-1654-4619-b801-928aa7d7c6af tempest-CreateVolumesFromImageTest-2104690810 None] Deleted volume successfully. Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-91880a66-9f17-4082-9b66-aa671b43bb3d tempest-CreateVolumesFromImageTest-2104690810 None] Lock "cinder-quobyte-67042893-2f78-42e0-aed8-a69be4dff5cb" acquired by "delete_volume" :: waited 0.026s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:34:07 devstack sudo[105404]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6a5e89d6-c782-4f3b-98d9-f366418fac93 tempest-ProjectReaderTests-1337665981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-467c980c-0ecb-44ce-a426-43330e5371ba 1073741824" returned: 0 in 0.557s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a9eceacb-1654-4619-b801-928aa7d7c6af tempest-CreateVolumesFromImageTest-2104690810 None] Lock "cinder-368a89e9-3a5a-473e-9a1c-8d31138fb135-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[775f50ac-cad3-4c2b-b30d-011f3f001294]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-91880a66-9f17-4082-9b66-aa671b43bb3d tempest-CreateVolumesFromImageTest-2104690810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-67042893-2f78-42e0-aed8-a69be4dff5cb {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6a5e89d6-c782-4f3b-98d9-f366418fac93 tempest-ProjectReaderTests-1337665981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-467c980c-0ecb-44ce-a426-43330e5371ba {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:07 devstack sudo[105415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-467c980c-0ecb-44ce-a426-43330e5371ba Sep 03 14:34:07 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:07 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-67042893-2f78-42e0-aed8-a69be4dff5cb Sep 03 14:34:07 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:07 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6a5e89d6-c782-4f3b-98d9-f366418fac93 tempest-ProjectReaderTests-1337665981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-467c980c-0ecb-44ce-a426-43330e5371ba" returned: 0 in 0.243s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-6a5e89d6-c782-4f3b-98d9-f366418fac93 tempest-ProjectReaderTests-1337665981 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6a5e89d6-c782-4f3b-98d9-f366418fac93 tempest-ProjectReaderTests-1337665981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6a5e89d6-c782-4f3b-98d9-f366418fac93 tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eccba17b-51c4-455c-b783-a19f87e83a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-467c980c-0ecb-44ce-a426-43330e5371ba', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6a5e89d6-c782-4f3b-98d9-f366418fac93 tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df7ba9e0-cf07-4459-9077-affe784a1ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:34:07 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-6a5e89d6-c782-4f3b-98d9-f366418fac93 tempest-ProjectReaderTests-1337665981 None] Volume volume-467c980c-0ecb-44ce-a426-43330e5371ba (467c980c-0ecb-44ce-a426-43330e5371ba): created successfully Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6a5e89d6-c782-4f3b-98d9-f366418fac93 tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df7ba9e0-cf07-4459-9077-affe784a1ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:34:07 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6a5e89d6-c782-4f3b-98d9-f366418fac93 tempest-ProjectReaderTests-1337665981 None] Flow 'volume_create_manager' (09a40324-7c36-461e-a5bd-f4125ad44bdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:34:08 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-6a5e89d6-c782-4f3b-98d9-f366418fac93 tempest-ProjectReaderTests-1337665981 None] Created volume successfully. Sep 03 14:34:08 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-91880a66-9f17-4082-9b66-aa671b43bb3d tempest-CreateVolumesFromImageTest-2104690810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-67042893-2f78-42e0-aed8-a69be4dff5cb" returned: 0 in 0.368s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-91880a66-9f17-4082-9b66-aa671b43bb3d tempest-CreateVolumesFromImageTest-2104690810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-67042893-2f78-42e0-aed8-a69be4dff5cb {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:08 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-67042893-2f78-42e0-aed8-a69be4dff5cb Sep 03 14:34:08 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:08 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-91880a66-9f17-4082-9b66-aa671b43bb3d tempest-CreateVolumesFromImageTest-2104690810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-67042893-2f78-42e0-aed8-a69be4dff5cb" returned: 0 in 0.254s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:08 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-91880a66-9f17-4082-9b66-aa671b43bb3d tempest-CreateVolumesFromImageTest-2104690810 None] Lock "cinder-quobyte-67042893-2f78-42e0-aed8-a69be4dff5cb" released by "delete_volume" :: held 0.681s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:34:08 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-91880a66-9f17-4082-9b66-aa671b43bb3d tempest-CreateVolumesFromImageTest-2104690810 None] Created reservations ['ddf84632-d397-4585-8d64-a20db9acad53', '6a5c0931-6cc1-42b6-b205-2f1062d40864', '590b6439-5a7f-4d85-b7a5-045206e53715', '27a62f24-d72c-437b-9456-b9d015d44282'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:34:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-91880a66-9f17-4082-9b66-aa671b43bb3d tempest-CreateVolumesFromImageTest-2104690810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:34:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-91880a66-9f17-4082-9b66-aa671b43bb3d tempest-CreateVolumesFromImageTest-2104690810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:34:08 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-91880a66-9f17-4082-9b66-aa671b43bb3d tempest-CreateVolumesFromImageTest-2104690810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:34:08 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-91880a66-9f17-4082-9b66-aa671b43bb3d tempest-CreateVolumesFromImageTest-2104690810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:34:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-91880a66-9f17-4082-9b66-aa671b43bb3d tempest-CreateVolumesFromImageTest-2104690810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:34:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-91880a66-9f17-4082-9b66-aa671b43bb3d tempest-CreateVolumesFromImageTest-2104690810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:08 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:34:08 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:08 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-91880a66-9f17-4082-9b66-aa671b43bb3d tempest-CreateVolumesFromImageTest-2104690810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.266s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:08 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-91880a66-9f17-4082-9b66-aa671b43bb3d tempest-CreateVolumesFromImageTest-2104690810 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:34:08 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-91880a66-9f17-4082-9b66-aa671b43bb3d tempest-CreateVolumesFromImageTest-2104690810 None] Deleted volume successfully. Sep 03 14:34:08 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-91880a66-9f17-4082-9b66-aa671b43bb3d tempest-CreateVolumesFromImageTest-2104690810 None] Lock "cinder-67042893-2f78-42e0-aed8-a69be4dff5cb-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:34:08 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-408dc027-db03-4cf1-892c-24f79873ef65 tempest-CreateVolumesFromImageTest-2104690810 None] Acquiring lock "cinder-834c0007-bf8c-4595-9732-a9d5d45e9bf8-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:34:08 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-408dc027-db03-4cf1-892c-24f79873ef65 tempest-CreateVolumesFromImageTest-2104690810 None] Lock "cinder-834c0007-bf8c-4595-9732-a9d5d45e9bf8-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:34:08 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-408dc027-db03-4cf1-892c-24f79873ef65 tempest-CreateVolumesFromImageTest-2104690810 None] Acquiring lock "cinder-quobyte-834c0007-bf8c-4595-9732-a9d5d45e9bf8" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:34:08 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-408dc027-db03-4cf1-892c-24f79873ef65 tempest-CreateVolumesFromImageTest-2104690810 None] Lock "cinder-quobyte-834c0007-bf8c-4595-9732-a9d5d45e9bf8" acquired by "delete_volume" :: waited 0.016s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:34:08 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6d06b9-e66a-4aca-a3e2-d35bd014e3b1]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:34:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-408dc027-db03-4cf1-892c-24f79873ef65 tempest-CreateVolumesFromImageTest-2104690810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-834c0007-bf8c-4595-9732-a9d5d45e9bf8 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:08 devstack sudo[105430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-834c0007-bf8c-4595-9732-a9d5d45e9bf8 Sep 03 14:34:08 devstack sudo[105430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:09 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-3d961554-4c90-42e2-bbf6-775090cdeb9b tempest-ProjectReaderTests-1337665981 None] Acquiring lock "cinder-467c980c-0ecb-44ce-a426-43330e5371ba-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:34:09 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-3d961554-4c90-42e2-bbf6-775090cdeb9b tempest-ProjectReaderTests-1337665981 None] Lock "cinder-467c980c-0ecb-44ce-a426-43330e5371ba-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:34:09 devstack sudo[105430]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-408dc027-db03-4cf1-892c-24f79873ef65 tempest-CreateVolumesFromImageTest-2104690810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-834c0007-bf8c-4595-9732-a9d5d45e9bf8" returned: 0 in 0.420s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-408dc027-db03-4cf1-892c-24f79873ef65 tempest-CreateVolumesFromImageTest-2104690810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-834c0007-bf8c-4595-9732-a9d5d45e9bf8 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:09 devstack sudo[105435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-834c0007-bf8c-4595-9732-a9d5d45e9bf8 Sep 03 14:34:09 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:09 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-3d961554-4c90-42e2-bbf6-775090cdeb9b tempest-ProjectReaderTests-1337665981 None] Acquiring lock "cinder-quobyte-467c980c-0ecb-44ce-a426-43330e5371ba" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:34:09 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-3d961554-4c90-42e2-bbf6-775090cdeb9b tempest-ProjectReaderTests-1337665981 None] Lock "cinder-quobyte-467c980c-0ecb-44ce-a426-43330e5371ba" acquired by "delete_volume" :: waited 0.027s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:34:09 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04c19bb-94d5-474c-9842-5fa5ff5e2f98]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:34:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3d961554-4c90-42e2-bbf6-775090cdeb9b tempest-ProjectReaderTests-1337665981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-467c980c-0ecb-44ce-a426-43330e5371ba {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:09 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-467c980c-0ecb-44ce-a426-43330e5371ba Sep 03 14:34:09 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:09 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-408dc027-db03-4cf1-892c-24f79873ef65 tempest-CreateVolumesFromImageTest-2104690810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-834c0007-bf8c-4595-9732-a9d5d45e9bf8" returned: 0 in 0.268s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:09 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-408dc027-db03-4cf1-892c-24f79873ef65 tempest-CreateVolumesFromImageTest-2104690810 None] Lock "cinder-quobyte-834c0007-bf8c-4595-9732-a9d5d45e9bf8" released by "delete_volume" :: held 0.730s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:34:09 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-408dc027-db03-4cf1-892c-24f79873ef65 tempest-CreateVolumesFromImageTest-2104690810 None] Created reservations ['ac31b20f-d527-49b2-8024-205a22689d2a', '98901f65-6407-46cb-8d90-7534ef34d69a', '0bbe0e6e-0d62-4cf4-a937-0b105c87c000', '2b8279f6-c386-4335-a9ea-d20f8f1334d9'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:34:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-408dc027-db03-4cf1-892c-24f79873ef65 tempest-CreateVolumesFromImageTest-2104690810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:34:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-408dc027-db03-4cf1-892c-24f79873ef65 tempest-CreateVolumesFromImageTest-2104690810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:34:09 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-408dc027-db03-4cf1-892c-24f79873ef65 tempest-CreateVolumesFromImageTest-2104690810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:34:09 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-408dc027-db03-4cf1-892c-24f79873ef65 tempest-CreateVolumesFromImageTest-2104690810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:34:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-408dc027-db03-4cf1-892c-24f79873ef65 tempest-CreateVolumesFromImageTest-2104690810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:34:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-408dc027-db03-4cf1-892c-24f79873ef65 tempest-CreateVolumesFromImageTest-2104690810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:09 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:34:09 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:09 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3d961554-4c90-42e2-bbf6-775090cdeb9b tempest-ProjectReaderTests-1337665981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-467c980c-0ecb-44ce-a426-43330e5371ba" returned: 0 in 0.375s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3d961554-4c90-42e2-bbf6-775090cdeb9b tempest-ProjectReaderTests-1337665981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-467c980c-0ecb-44ce-a426-43330e5371ba {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:09 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-467c980c-0ecb-44ce-a426-43330e5371ba Sep 03 14:34:09 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:09 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-408dc027-db03-4cf1-892c-24f79873ef65 tempest-CreateVolumesFromImageTest-2104690810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.284s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:09 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-408dc027-db03-4cf1-892c-24f79873ef65 tempest-CreateVolumesFromImageTest-2104690810 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:34:09 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-408dc027-db03-4cf1-892c-24f79873ef65 tempest-CreateVolumesFromImageTest-2104690810 None] Deleted volume successfully. Sep 03 14:34:10 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:10 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-408dc027-db03-4cf1-892c-24f79873ef65 tempest-CreateVolumesFromImageTest-2104690810 None] Lock "cinder-834c0007-bf8c-4595-9732-a9d5d45e9bf8-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:34:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3d961554-4c90-42e2-bbf6-775090cdeb9b tempest-ProjectReaderTests-1337665981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-467c980c-0ecb-44ce-a426-43330e5371ba" returned: 0 in 0.282s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:10 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-3d961554-4c90-42e2-bbf6-775090cdeb9b tempest-ProjectReaderTests-1337665981 None] Lock "cinder-quobyte-467c980c-0ecb-44ce-a426-43330e5371ba" released by "delete_volume" :: held 0.701s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:34:10 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-3d961554-4c90-42e2-bbf6-775090cdeb9b tempest-ProjectReaderTests-1337665981 None] Created reservations ['aeadc111-10e1-496e-accb-2f74f1bbbd73', 'a48df4bf-8424-4b5a-a880-4d6f6847a77d', '2d2ee256-cfbf-4f52-84bf-861a8f60ddbf', '516e5e56-d02f-4462-a282-1eeb0af048a9'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:34:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-3d961554-4c90-42e2-bbf6-775090cdeb9b tempest-ProjectReaderTests-1337665981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:34:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-3d961554-4c90-42e2-bbf6-775090cdeb9b tempest-ProjectReaderTests-1337665981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:34:10 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-3d961554-4c90-42e2-bbf6-775090cdeb9b tempest-ProjectReaderTests-1337665981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:34:10 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-3d961554-4c90-42e2-bbf6-775090cdeb9b tempest-ProjectReaderTests-1337665981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:34:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-3d961554-4c90-42e2-bbf6-775090cdeb9b tempest-ProjectReaderTests-1337665981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:34:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3d961554-4c90-42e2-bbf6-775090cdeb9b tempest-ProjectReaderTests-1337665981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:10 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:34:10 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:10 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3d961554-4c90-42e2-bbf6-775090cdeb9b tempest-ProjectReaderTests-1337665981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.487s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:10 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-3d961554-4c90-42e2-bbf6-775090cdeb9b tempest-ProjectReaderTests-1337665981 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:34:10 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-3d961554-4c90-42e2-bbf6-775090cdeb9b tempest-ProjectReaderTests-1337665981 None] Deleted volume successfully. Sep 03 14:34:10 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-3d961554-4c90-42e2-bbf6-775090cdeb9b tempest-ProjectReaderTests-1337665981 None] Lock "cinder-467c980c-0ecb-44ce-a426-43330e5371ba-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:34:11 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfb8bf77-48e3-482a-a9de-7a17faf42a2f tempest-ProjectReaderTests-1337665981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:34:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-dfb8bf77-48e3-482a-a9de-7a17faf42a2f tempest-ProjectReaderTests-1337665981 None] Flow 'volume_create_manager' (2c383592-b4ac-425c-b89c-43c673e082a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:34:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-dfb8bf77-48e3-482a-a9de-7a17faf42a2f tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7e6ee30-2ea6-4dc4-a376-335a5efdf3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:34:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-dfb8bf77-48e3-482a-a9de-7a17faf42a2f tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7e6ee30-2ea6-4dc4-a376-335a5efdf3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-456628052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d68cd48-7e2b-414c-8302-f2cd400af4af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04fa2c7a8efb43c9b0d435efadadbf3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:34:11Z,use_quota=True,user_id='989919ea70764178b7cdbe37f93c0695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:34:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-dfb8bf77-48e3-482a-a9de-7a17faf42a2f tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad1cef43-badd-4a65-8222-4f4c9c5b2bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:34:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-dfb8bf77-48e3-482a-a9de-7a17faf42a2f tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad1cef43-badd-4a65-8222-4f4c9c5b2bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:34:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-dfb8bf77-48e3-482a-a9de-7a17faf42a2f tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a473d4c7-a0b5-4744-9bed-924863f63ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:34:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-dfb8bf77-48e3-482a-a9de-7a17faf42a2f tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a473d4c7-a0b5-4744-9bed-924863f63ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d68cd48-7e2b-414c-8302-f2cd400af4af', 'volume_name': 'volume-3d68cd48-7e2b-414c-8302-f2cd400af4af', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:34:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-dfb8bf77-48e3-482a-a9de-7a17faf42a2f tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f13388b6-eccb-4c52-8ae7-fb6389f817de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:34:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-dfb8bf77-48e3-482a-a9de-7a17faf42a2f tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f13388b6-eccb-4c52-8ae7-fb6389f817de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:34:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-dfb8bf77-48e3-482a-a9de-7a17faf42a2f tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe8893fd-9ec0-4b24-8007-057693d22a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:34:11 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-dfb8bf77-48e3-482a-a9de-7a17faf42a2f tempest-ProjectReaderTests-1337665981 None] Volume 3d68cd48-7e2b-414c-8302-f2cd400af4af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d68cd48-7e2b-414c-8302-f2cd400af4af', 'volume_size': 1} Sep 03 14:34:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-dfb8bf77-48e3-482a-a9de-7a17faf42a2f tempest-ProjectReaderTests-1337665981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:34:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-dfb8bf77-48e3-482a-a9de-7a17faf42a2f tempest-ProjectReaderTests-1337665981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:34:11 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-dfb8bf77-48e3-482a-a9de-7a17faf42a2f tempest-ProjectReaderTests-1337665981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-456628052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d68cd48-7e2b-414c-8302-f2cd400af4af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04fa2c7a8efb43c9b0d435efadadbf3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:34:11Z,use_quota=True,user_id='989919ea70764178b7cdbe37f93c0695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:34:11 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-dfb8bf77-48e3-482a-a9de-7a17faf42a2f tempest-ProjectReaderTests-1337665981 None] Creating volume 3d68cd48-7e2b-414c-8302-f2cd400af4af {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:34:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-dfb8bf77-48e3-482a-a9de-7a17faf42a2f tempest-ProjectReaderTests-1337665981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:34:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-dfb8bf77-48e3-482a-a9de-7a17faf42a2f tempest-ProjectReaderTests-1337665981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:34:11 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-dfb8bf77-48e3-482a-a9de-7a17faf42a2f tempest-ProjectReaderTests-1337665981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:34:11 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-dfb8bf77-48e3-482a-a9de-7a17faf42a2f tempest-ProjectReaderTests-1337665981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:34:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-dfb8bf77-48e3-482a-a9de-7a17faf42a2f tempest-ProjectReaderTests-1337665981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:34:11 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-dfb8bf77-48e3-482a-a9de-7a17faf42a2f tempest-ProjectReaderTests-1337665981 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:34:11 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-dfb8bf77-48e3-482a-a9de-7a17faf42a2f tempest-ProjectReaderTests-1337665981 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:34:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dfb8bf77-48e3-482a-a9de-7a17faf42a2f tempest-ProjectReaderTests-1337665981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3d68cd48-7e2b-414c-8302-f2cd400af4af 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:11 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3d68cd48-7e2b-414c-8302-f2cd400af4af 1073741824 Sep 03 14:34:11 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:11 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dfb8bf77-48e3-482a-a9de-7a17faf42a2f tempest-ProjectReaderTests-1337665981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3d68cd48-7e2b-414c-8302-f2cd400af4af 1073741824" returned: 0 in 0.488s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dfb8bf77-48e3-482a-a9de-7a17faf42a2f tempest-ProjectReaderTests-1337665981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3d68cd48-7e2b-414c-8302-f2cd400af4af {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:11 devstack sudo[105496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3d68cd48-7e2b-414c-8302-f2cd400af4af Sep 03 14:34:11 devstack sudo[105496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:12 devstack sudo[105496]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dfb8bf77-48e3-482a-a9de-7a17faf42a2f tempest-ProjectReaderTests-1337665981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3d68cd48-7e2b-414c-8302-f2cd400af4af" returned: 0 in 0.272s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:12 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-dfb8bf77-48e3-482a-a9de-7a17faf42a2f tempest-ProjectReaderTests-1337665981 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:34:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-dfb8bf77-48e3-482a-a9de-7a17faf42a2f tempest-ProjectReaderTests-1337665981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:34:12 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-dfb8bf77-48e3-482a-a9de-7a17faf42a2f tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe8893fd-9ec0-4b24-8007-057693d22a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d68cd48-7e2b-414c-8302-f2cd400af4af', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:34:12 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-dfb8bf77-48e3-482a-a9de-7a17faf42a2f tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f1a06aa-e771-41ce-825d-a455c4408c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:34:12 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-dfb8bf77-48e3-482a-a9de-7a17faf42a2f tempest-ProjectReaderTests-1337665981 None] Volume volume-3d68cd48-7e2b-414c-8302-f2cd400af4af (3d68cd48-7e2b-414c-8302-f2cd400af4af): created successfully Sep 03 14:34:12 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-dfb8bf77-48e3-482a-a9de-7a17faf42a2f tempest-ProjectReaderTests-1337665981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f1a06aa-e771-41ce-825d-a455c4408c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:34:12 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-dfb8bf77-48e3-482a-a9de-7a17faf42a2f tempest-ProjectReaderTests-1337665981 None] Flow 'volume_create_manager' (2c383592-b4ac-425c-b89c-43c673e082a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:34:12 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-dfb8bf77-48e3-482a-a9de-7a17faf42a2f tempest-ProjectReaderTests-1337665981 None] Created volume successfully. Sep 03 14:34:13 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-6ede980d-5bbb-4175-9861-26965fe9c682 tempest-ProjectReaderTests-1337665981 None] Acquiring lock "cinder-3d68cd48-7e2b-414c-8302-f2cd400af4af-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:34:13 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-6ede980d-5bbb-4175-9861-26965fe9c682 tempest-ProjectReaderTests-1337665981 None] Lock "cinder-3d68cd48-7e2b-414c-8302-f2cd400af4af-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:34:13 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-6ede980d-5bbb-4175-9861-26965fe9c682 tempest-ProjectReaderTests-1337665981 None] Acquiring lock "cinder-quobyte-3d68cd48-7e2b-414c-8302-f2cd400af4af" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:34:13 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-6ede980d-5bbb-4175-9861-26965fe9c682 tempest-ProjectReaderTests-1337665981 None] Lock "cinder-quobyte-3d68cd48-7e2b-414c-8302-f2cd400af4af" acquired by "delete_volume" :: waited 0.026s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:34:13 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[852727a8-5955-4249-ba64-bed9725839de]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:34:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6ede980d-5bbb-4175-9861-26965fe9c682 tempest-ProjectReaderTests-1337665981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3d68cd48-7e2b-414c-8302-f2cd400af4af {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:13 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-055fe444-1bdf-4989-a560-b4d61aacfbdd tempest-VolumeDependencyTests-355909504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:34:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-055fe444-1bdf-4989-a560-b4d61aacfbdd tempest-VolumeDependencyTests-355909504 None] Flow 'volume_create_manager' (99462279-5cfd-4f7c-bdb6-da5198373683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:34:13 devstack sudo[105510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3d68cd48-7e2b-414c-8302-f2cd400af4af Sep 03 14:34:13 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-055fe444-1bdf-4989-a560-b4d61aacfbdd tempest-VolumeDependencyTests-355909504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9de37b3c-045c-4a68-9c52-830616bc05ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:34:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-055fe444-1bdf-4989-a560-b4d61aacfbdd tempest-VolumeDependencyTests-355909504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9de37b3c-045c-4a68-9c52-830616bc05ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2039095627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=850ce90d-c006-4547-ba43-1edf5cd3cf00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0510e10cd01a4b9f8b6c36a7011248a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:34:14Z,use_quota=True,user_id='24acc741cbce4139a39d9b2dba615c20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:34:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-055fe444-1bdf-4989-a560-b4d61aacfbdd tempest-VolumeDependencyTests-355909504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60429f97-74c9-4852-9af5-a37fde2bb126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:34:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-055fe444-1bdf-4989-a560-b4d61aacfbdd tempest-VolumeDependencyTests-355909504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60429f97-74c9-4852-9af5-a37fde2bb126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:34:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-055fe444-1bdf-4989-a560-b4d61aacfbdd tempest-VolumeDependencyTests-355909504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d444161a-ce63-40a1-aff5-7543cbe66347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:34:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-055fe444-1bdf-4989-a560-b4d61aacfbdd tempest-VolumeDependencyTests-355909504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d444161a-ce63-40a1-aff5-7543cbe66347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '850ce90d-c006-4547-ba43-1edf5cd3cf00', 'volume_name': 'volume-850ce90d-c006-4547-ba43-1edf5cd3cf00', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:34:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-055fe444-1bdf-4989-a560-b4d61aacfbdd tempest-VolumeDependencyTests-355909504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83a8092f-b586-4d5e-89eb-33661008f911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:34:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-055fe444-1bdf-4989-a560-b4d61aacfbdd tempest-VolumeDependencyTests-355909504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83a8092f-b586-4d5e-89eb-33661008f911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:34:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-055fe444-1bdf-4989-a560-b4d61aacfbdd tempest-VolumeDependencyTests-355909504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7620ab10-95ca-4f87-b3a8-eed3b6c32e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:34:13 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-055fe444-1bdf-4989-a560-b4d61aacfbdd tempest-VolumeDependencyTests-355909504 None] Volume 850ce90d-c006-4547-ba43-1edf5cd3cf00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-850ce90d-c006-4547-ba43-1edf5cd3cf00', 'volume_size': 1} Sep 03 14:34:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-055fe444-1bdf-4989-a560-b4d61aacfbdd tempest-VolumeDependencyTests-355909504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:34:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-055fe444-1bdf-4989-a560-b4d61aacfbdd tempest-VolumeDependencyTests-355909504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:34:13 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-055fe444-1bdf-4989-a560-b4d61aacfbdd tempest-VolumeDependencyTests-355909504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2039095627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=850ce90d-c006-4547-ba43-1edf5cd3cf00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0510e10cd01a4b9f8b6c36a7011248a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:34:14Z,use_quota=True,user_id='24acc741cbce4139a39d9b2dba615c20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:34:13 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-055fe444-1bdf-4989-a560-b4d61aacfbdd tempest-VolumeDependencyTests-355909504 None] Creating volume 850ce90d-c006-4547-ba43-1edf5cd3cf00 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:34:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-055fe444-1bdf-4989-a560-b4d61aacfbdd tempest-VolumeDependencyTests-355909504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:34:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-055fe444-1bdf-4989-a560-b4d61aacfbdd tempest-VolumeDependencyTests-355909504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:34:13 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-055fe444-1bdf-4989-a560-b4d61aacfbdd tempest-VolumeDependencyTests-355909504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:34:13 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-055fe444-1bdf-4989-a560-b4d61aacfbdd tempest-VolumeDependencyTests-355909504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:34:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-055fe444-1bdf-4989-a560-b4d61aacfbdd tempest-VolumeDependencyTests-355909504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:34:13 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-055fe444-1bdf-4989-a560-b4d61aacfbdd tempest-VolumeDependencyTests-355909504 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:34:13 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-055fe444-1bdf-4989-a560-b4d61aacfbdd tempest-VolumeDependencyTests-355909504 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:34:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-055fe444-1bdf-4989-a560-b4d61aacfbdd tempest-VolumeDependencyTests-355909504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:13 devstack sudo[105512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00 1073741824 Sep 03 14:34:13 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:13 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6ede980d-5bbb-4175-9861-26965fe9c682 tempest-ProjectReaderTests-1337665981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3d68cd48-7e2b-414c-8302-f2cd400af4af" returned: 0 in 0.363s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6ede980d-5bbb-4175-9861-26965fe9c682 tempest-ProjectReaderTests-1337665981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3d68cd48-7e2b-414c-8302-f2cd400af4af {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:13 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3d68cd48-7e2b-414c-8302-f2cd400af4af Sep 03 14:34:13 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:14 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-055fe444-1bdf-4989-a560-b4d61aacfbdd tempest-VolumeDependencyTests-355909504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00 1073741824" returned: 0 in 0.425s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:14 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6ede980d-5bbb-4175-9861-26965fe9c682 tempest-ProjectReaderTests-1337665981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3d68cd48-7e2b-414c-8302-f2cd400af4af" returned: 0 in 0.264s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:14 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-6ede980d-5bbb-4175-9861-26965fe9c682 tempest-ProjectReaderTests-1337665981 None] Lock "cinder-quobyte-3d68cd48-7e2b-414c-8302-f2cd400af4af" released by "delete_volume" :: held 0.677s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:34:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-055fe444-1bdf-4989-a560-b4d61aacfbdd tempest-VolumeDependencyTests-355909504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:14 devstack sudo[105523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00 Sep 03 14:34:14 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:14 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-6ede980d-5bbb-4175-9861-26965fe9c682 tempest-ProjectReaderTests-1337665981 None] Created reservations ['d82b4538-1742-4cbd-bde8-3af38a6b7b1d', 'fb3305b2-cfe8-4e52-bd24-59d78a02e165', 'e8a06d03-b87d-4a98-a546-b3d34218997f', 'c117c0ae-8b3c-4ff5-ab87-2204c6e1471c'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:34:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6ede980d-5bbb-4175-9861-26965fe9c682 tempest-ProjectReaderTests-1337665981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:34:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6ede980d-5bbb-4175-9861-26965fe9c682 tempest-ProjectReaderTests-1337665981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:34:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-6ede980d-5bbb-4175-9861-26965fe9c682 tempest-ProjectReaderTests-1337665981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:34:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-6ede980d-5bbb-4175-9861-26965fe9c682 tempest-ProjectReaderTests-1337665981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:34:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6ede980d-5bbb-4175-9861-26965fe9c682 tempest-ProjectReaderTests-1337665981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:34:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6ede980d-5bbb-4175-9861-26965fe9c682 tempest-ProjectReaderTests-1337665981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:14 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:34:14 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:14 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-055fe444-1bdf-4989-a560-b4d61aacfbdd tempest-VolumeDependencyTests-355909504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00" returned: 0 in 0.261s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-055fe444-1bdf-4989-a560-b4d61aacfbdd tempest-VolumeDependencyTests-355909504 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:34:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-055fe444-1bdf-4989-a560-b4d61aacfbdd tempest-VolumeDependencyTests-355909504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:34:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-055fe444-1bdf-4989-a560-b4d61aacfbdd tempest-VolumeDependencyTests-355909504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7620ab10-95ca-4f87-b3a8-eed3b6c32e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-850ce90d-c006-4547-ba43-1edf5cd3cf00', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:34:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-055fe444-1bdf-4989-a560-b4d61aacfbdd tempest-VolumeDependencyTests-355909504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf5b405-ff18-474b-926a-ea602cc0605c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:34:14 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-055fe444-1bdf-4989-a560-b4d61aacfbdd tempest-VolumeDependencyTests-355909504 None] Volume volume-850ce90d-c006-4547-ba43-1edf5cd3cf00 (850ce90d-c006-4547-ba43-1edf5cd3cf00): created successfully Sep 03 14:34:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-055fe444-1bdf-4989-a560-b4d61aacfbdd tempest-VolumeDependencyTests-355909504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf5b405-ff18-474b-926a-ea602cc0605c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:34:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-055fe444-1bdf-4989-a560-b4d61aacfbdd tempest-VolumeDependencyTests-355909504 None] Flow 'volume_create_manager' (99462279-5cfd-4f7c-bdb6-da5198373683) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:34:14 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-055fe444-1bdf-4989-a560-b4d61aacfbdd tempest-VolumeDependencyTests-355909504 None] Created volume successfully. Sep 03 14:34:14 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6ede980d-5bbb-4175-9861-26965fe9c682 tempest-ProjectReaderTests-1337665981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.268s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:14 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-6ede980d-5bbb-4175-9861-26965fe9c682 tempest-ProjectReaderTests-1337665981 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:34:14 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-6ede980d-5bbb-4175-9861-26965fe9c682 tempest-ProjectReaderTests-1337665981 None] Deleted volume successfully. Sep 03 14:34:14 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-6ede980d-5bbb-4175-9861-26965fe9c682 tempest-ProjectReaderTests-1337665981 None] Lock "cinder-3d68cd48-7e2b-414c-8302-f2cd400af4af-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:34:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-3b1e4202-da72-46e2-afda-e4f6e2820bf6 tempest-VolumeDependencyTests-355909504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:34:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-3b1e4202-da72-46e2-afda-e4f6e2820bf6 tempest-VolumeDependencyTests-355909504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:34:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-3b1e4202-da72-46e2-afda-e4f6e2820bf6 tempest-VolumeDependencyTests-355909504 None] Creating offline snapshot 72c55007-81f7-4be2-b680-21a70a3d933e of volume 850ce90d-c006-4547-ba43-1edf5cd3cf00 {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:34:14 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc273b5c-edbe-47bf-9b7c-619c638d1472]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:34:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3b1e4202-da72-46e2-afda-e4f6e2820bf6 tempest-VolumeDependencyTests-355909504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:14 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00 Sep 03 14:34:14 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:15 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3b1e4202-da72-46e2-afda-e4f6e2820bf6 tempest-VolumeDependencyTests-355909504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00" returned: 0 in 0.374s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3b1e4202-da72-46e2-afda-e4f6e2820bf6 tempest-VolumeDependencyTests-355909504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00.72c55007-81f7-4be2-b680-21a70a3d933e 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:15 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00.72c55007-81f7-4be2-b680-21a70a3d933e 1G Sep 03 14:34:15 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:15 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3b1e4202-da72-46e2-afda-e4f6e2820bf6 tempest-VolumeDependencyTests-355909504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00.72c55007-81f7-4be2-b680-21a70a3d933e 1G" returned: 0 in 0.437s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3b1e4202-da72-46e2-afda-e4f6e2820bf6 tempest-VolumeDependencyTests-355909504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-850ce90d-c006-4547-ba43-1edf5cd3cf00 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00.72c55007-81f7-4be2-b680-21a70a3d933e {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:15 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-850ce90d-c006-4547-ba43-1edf5cd3cf00 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00.72c55007-81f7-4be2-b680-21a70a3d933e Sep 03 14:34:15 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:15 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3b1e4202-da72-46e2-afda-e4f6e2820bf6 tempest-VolumeDependencyTests-355909504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-850ce90d-c006-4547-ba43-1edf5cd3cf00 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00.72c55007-81f7-4be2-b680-21a70a3d933e" returned: 0 in 0.306s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:15 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-3b1e4202-da72-46e2-afda-e4f6e2820bf6 tempest-VolumeDependencyTests-355909504 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00.72c55007-81f7-4be2-b680-21a70a3d933e is being set with open permissions: ugo+rw Sep 03 14:34:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3b1e4202-da72-46e2-afda-e4f6e2820bf6 tempest-VolumeDependencyTests-355909504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00.72c55007-81f7-4be2-b680-21a70a3d933e {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:15 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00.72c55007-81f7-4be2-b680-21a70a3d933e Sep 03 14:34:15 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:16 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3b1e4202-da72-46e2-afda-e4f6e2820bf6 tempest-VolumeDependencyTests-355909504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00.72c55007-81f7-4be2-b680-21a70a3d933e" returned: 0 in 0.264s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3b1e4202-da72-46e2-afda-e4f6e2820bf6 tempest-VolumeDependencyTests-355909504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:16 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00.info Sep 03 14:34:16 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:16 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3b1e4202-da72-46e2-afda-e4f6e2820bf6 tempest-VolumeDependencyTests-355909504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00.info" returned: 0 in 0.251s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:16 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-3b1e4202-da72-46e2-afda-e4f6e2820bf6 tempest-VolumeDependencyTests-355909504 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00.info is being set with open permissions: ugo+rw Sep 03 14:34:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3b1e4202-da72-46e2-afda-e4f6e2820bf6 tempest-VolumeDependencyTests-355909504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:16 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00.info Sep 03 14:34:16 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:16 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3b1e4202-da72-46e2-afda-e4f6e2820bf6 tempest-VolumeDependencyTests-355909504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00.info" returned: 0 in 0.236s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-3b1e4202-da72-46e2-afda-e4f6e2820bf6 tempest-VolumeDependencyTests-355909504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.965s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:34:16 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-3b1e4202-da72-46e2-afda-e4f6e2820bf6 tempest-VolumeDependencyTests-355909504 None] Create snapshot completed successfully Sep 03 14:34:17 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:34:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Flow 'volume_create_manager' (4830e95e-d374-465e-8aea-119e89816111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:34:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efea28a3-80e6-486c-9ed0-f4825d0ffe62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:34:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efea28a3-80e6-486c-9ed0-f4825d0ffe62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2002192726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a0f06e5-6bf8-4098-8705-0eccfcd8641b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0510e10cd01a4b9f8b6c36a7011248a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=72c55007-81f7-4be2-b680-21a70a3d933e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:34:17Z,use_quota=True,user_id='24acc741cbce4139a39d9b2dba615c20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:34:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6311aea4-1c80-4d4c-aecd-551fc59930be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:34:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6311aea4-1c80-4d4c-aecd-551fc59930be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:34:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b65d882-70ae-4092-92cb-84d3dd681829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:34:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b65d882-70ae-4092-92cb-84d3dd681829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5a0f06e5-6bf8-4098-8705-0eccfcd8641b', 'volume_name': 'volume-5a0f06e5-6bf8-4098-8705-0eccfcd8641b', 'volume_size': 1, 'snapshot_id': '72c55007-81f7-4be2-b680-21a70a3d933e'}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:34:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dbe81d4-fa77-4631-b32c-fc4b9e195cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:34:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dbe81d4-fa77-4631-b32c-fc4b9e195cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:34:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53364c87-41be-4a7e-88c1-ae8b8a7ad467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:34:17 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Volume 5a0f06e5-6bf8-4098-8705-0eccfcd8641b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5a0f06e5-6bf8-4098-8705-0eccfcd8641b', 'volume_size': 1, 'snapshot_id': '72c55007-81f7-4be2-b680-21a70a3d933e'} Sep 03 14:34:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:34:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:34:17 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Acquiring lock "cinder-quobyte-72c55007-81f7-4be2-b680-21a70a3d933e-5a0f06e5-6bf8-4098-8705-0eccfcd8641b" by "_create_volume_from_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:34:17 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Lock "cinder-quobyte-72c55007-81f7-4be2-b680-21a70a3d933e-5a0f06e5-6bf8-4098-8705-0eccfcd8641b" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:34:17 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Creating volume 5a0f06e5-6bf8-4098-8705-0eccfcd8641b from snapshot 72c55007-81f7-4be2-b680-21a70a3d933e {{(pid=87007) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 14:34:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:34:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:34:17 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:34:17 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:34:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:34:17 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:34:17 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Acquiring lock "cinder-quobyte-5a0f06e5-6bf8-4098-8705-0eccfcd8641b" by "_copy_volume_from_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:34:17 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Lock "cinder-quobyte-5a0f06e5-6bf8-4098-8705-0eccfcd8641b" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:34:17 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] snapshot: 72c55007-81f7-4be2-b680-21a70a3d933e, volume: 5a0f06e5-6bf8-4098-8705-0eccfcd8641b, {{(pid=87007) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 14:34:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:34:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:34:17 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:34:17 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:34:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:34:17 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d51aef-cd4c-4900-8bc2-6c415af3de9b]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:34:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00.72c55007-81f7-4be2-b680-21a70a3d933e {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:17 devstack sudo[105555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00.72c55007-81f7-4be2-b680-21a70a3d933e Sep 03 14:34:17 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:17 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00.72c55007-81f7-4be2-b680-21a70a3d933e" returned: 0 in 0.338s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:17 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-850ce90d-c006-4547-ba43-1edf5cd3cf00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:34:17 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b70785-f2d0-4779-95ad-29d4400c5f49]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:34:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:18 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00 Sep 03 14:34:18 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:18 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00" returned: 0 in 0.344s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:18 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00 {{(pid=87007) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 14:34:18 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Creating direct copy from snapshot {{(pid=87007) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 14:34:18 devstack cinder-volume[87007]: DEBUG cinder.utils [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Path /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5a0f06e5-6bf8-4098-8705-0eccfcd8641b not found in is_blk_device check {{(pid=87007) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 14:34:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5a0f06e5-6bf8-4098-8705-0eccfcd8641b {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:18 devstack sudo[105565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5a0f06e5-6bf8-4098-8705-0eccfcd8641b Sep 03 14:34:18 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:22 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5a0f06e5-6bf8-4098-8705-0eccfcd8641b" returned: 0 in 4.124s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:22 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Image conversion details: src /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00, size 1024.00 MB, duration 4.13 sec, destination /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5a0f06e5-6bf8-4098-8705-0eccfcd8641b {{(pid=87007) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 14:34:22 devstack cinder-volume[87007]: INFO cinder.image.image_utils [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Converted 1024.00 MB image at 248.23 MB/s Sep 03 14:34:22 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5a0f06e5-6bf8-4098-8705-0eccfcd8641b is being set with open permissions: ugo+rw Sep 03 14:34:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5a0f06e5-6bf8-4098-8705-0eccfcd8641b {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:22 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5a0f06e5-6bf8-4098-8705-0eccfcd8641b Sep 03 14:34:22 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:22 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5a0f06e5-6bf8-4098-8705-0eccfcd8641b" returned: 0 in 0.242s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Lock "cinder-quobyte-5a0f06e5-6bf8-4098-8705-0eccfcd8641b" released by "_copy_volume_from_snapshot" :: held 5.118s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:34:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Lock "cinder-quobyte-72c55007-81f7-4be2-b680-21a70a3d933e-5a0f06e5-6bf8-4098-8705-0eccfcd8641b" released by "_create_volume_from_snapshot" :: held 5.174s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:34:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.190s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:34:22 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53364c87-41be-4a7e-88c1-ae8b8a7ad467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a0f06e5-6bf8-4098-8705-0eccfcd8641b', 'volume_size': 1, 'snapshot_id': '72c55007-81f7-4be2-b680-21a70a3d933e'}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:34:22 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (657cb2fc-699d-4a87-9511-aa41bd9c0ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:34:22 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Volume volume-5a0f06e5-6bf8-4098-8705-0eccfcd8641b (5a0f06e5-6bf8-4098-8705-0eccfcd8641b): created successfully Sep 03 14:34:22 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (657cb2fc-699d-4a87-9511-aa41bd9c0ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:34:22 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Flow 'volume_create_manager' (4830e95e-d374-465e-8aea-119e89816111) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:34:22 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-bc538dcf-28fa-4eb4-a444-7b06e96671b1 tempest-VolumeDependencyTests-355909504 None] Created volume successfully. Sep 03 14:34:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-e290ebc4-0c2a-45e2-9d19-5b40c10e080e tempest-VolumeDependencyTests-355909504 None] Acquiring lock "cinder-72c55007-81f7-4be2-b680-21a70a3d933e-delete_snapshot" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:34:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-e290ebc4-0c2a-45e2-9d19-5b40c10e080e tempest-VolumeDependencyTests-355909504 None] Lock "cinder-72c55007-81f7-4be2-b680-21a70a3d933e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:34:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-e290ebc4-0c2a-45e2-9d19-5b40c10e080e tempest-VolumeDependencyTests-355909504 None] Acquiring lock "cinder-quobyte-850ce90d-c006-4547-ba43-1edf5cd3cf00" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:34:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-e290ebc4-0c2a-45e2-9d19-5b40c10e080e tempest-VolumeDependencyTests-355909504 None] Lock "cinder-quobyte-850ce90d-c006-4547-ba43-1edf5cd3cf00" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:34:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-e290ebc4-0c2a-45e2-9d19-5b40c10e080e tempest-VolumeDependencyTests-355909504 None] Acquiring lock "cinder-quobyte-72c55007-81f7-4be2-b680-21a70a3d933e" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:34:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-e290ebc4-0c2a-45e2-9d19-5b40c10e080e tempest-VolumeDependencyTests-355909504 None] Lock "cinder-quobyte-72c55007-81f7-4be2-b680-21a70a3d933e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:34:22 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-e290ebc4-0c2a-45e2-9d19-5b40c10e080e tempest-VolumeDependencyTests-355909504 None] Deleting offline snapshot 72c55007-81f7-4be2-b680-21a70a3d933e of volume 850ce90d-c006-4547-ba43-1edf5cd3cf00 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:34:22 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-e290ebc4-0c2a-45e2-9d19-5b40c10e080e tempest-VolumeDependencyTests-355909504 None] snapshot_file for this snap is: volume-850ce90d-c006-4547-ba43-1edf5cd3cf00.72c55007-81f7-4be2-b680-21a70a3d933e {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:34:22 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8061418-5774-4abf-a53c-33d54e851eb8]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:34:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e290ebc4-0c2a-45e2-9d19-5b40c10e080e tempest-VolumeDependencyTests-355909504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00.72c55007-81f7-4be2-b680-21a70a3d933e {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:23 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00.72c55007-81f7-4be2-b680-21a70a3d933e Sep 03 14:34:23 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:23 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e290ebc4-0c2a-45e2-9d19-5b40c10e080e tempest-VolumeDependencyTests-355909504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00.72c55007-81f7-4be2-b680-21a70a3d933e" returned: 0 in 0.349s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:23 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-e290ebc4-0c2a-45e2-9d19-5b40c10e080e tempest-VolumeDependencyTests-355909504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-850ce90d-c006-4547-ba43-1edf5cd3cf00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:34:23 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2135e0-29b1-45e4-bad8-8f34ac85bcb1]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:34:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e290ebc4-0c2a-45e2-9d19-5b40c10e080e tempest-VolumeDependencyTests-355909504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:23 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00 Sep 03 14:34:23 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:23 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e290ebc4-0c2a-45e2-9d19-5b40c10e080e tempest-VolumeDependencyTests-355909504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00" returned: 0 in 0.497s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e290ebc4-0c2a-45e2-9d19-5b40c10e080e tempest-VolumeDependencyTests-355909504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00.72c55007-81f7-4be2-b680-21a70a3d933e {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:23 devstack sudo[105592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00.72c55007-81f7-4be2-b680-21a70a3d933e Sep 03 14:34:23 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:24 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e290ebc4-0c2a-45e2-9d19-5b40c10e080e tempest-VolumeDependencyTests-355909504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00.72c55007-81f7-4be2-b680-21a70a3d933e" returned: 0 in 0.338s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e290ebc4-0c2a-45e2-9d19-5b40c10e080e tempest-VolumeDependencyTests-355909504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00.72c55007-81f7-4be2-b680-21a70a3d933e {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:24 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00.72c55007-81f7-4be2-b680-21a70a3d933e Sep 03 14:34:24 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:24 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-e290ebc4-0c2a-45e2-9d19-5b40c10e080e tempest-VolumeDependencyTests-355909504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00.72c55007-81f7-4be2-b680-21a70a3d933e" returned: 0 in 0.255s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:24 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-e290ebc4-0c2a-45e2-9d19-5b40c10e080e tempest-VolumeDependencyTests-355909504 None] Lock "cinder-quobyte-72c55007-81f7-4be2-b680-21a70a3d933e" released by "_delete_snapshot" :: held 1.532s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:34:24 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-e290ebc4-0c2a-45e2-9d19-5b40c10e080e tempest-VolumeDependencyTests-355909504 None] Lock "cinder-quobyte-850ce90d-c006-4547-ba43-1edf5cd3cf00" released by "delete_snapshot" :: held 1.554s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:34:24 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-e290ebc4-0c2a-45e2-9d19-5b40c10e080e tempest-VolumeDependencyTests-355909504 None] Created reservations ['44514565-1ae3-4771-b0db-b6caf97fd1ff', '58774205-5222-4174-90e1-886c5f79634f', '4d5b7ee6-e058-4d43-8a4a-68c66aa94bdd', 'ce5499f8-8094-4798-8147-5f65fe873275'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:34:24 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-e290ebc4-0c2a-45e2-9d19-5b40c10e080e tempest-VolumeDependencyTests-355909504 None] Delete snapshot completed successfully. Sep 03 14:34:24 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-e290ebc4-0c2a-45e2-9d19-5b40c10e080e tempest-VolumeDependencyTests-355909504 None] Lock "cinder-72c55007-81f7-4be2-b680-21a70a3d933e-delete_snapshot" released by "delete_snapshot" :: held 1.704s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:34:24 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-62169434-52e9-45bf-b331-e655e67f7cf9 tempest-VolumeDependencyTests-355909504 None] Acquiring lock "cinder-850ce90d-c006-4547-ba43-1edf5cd3cf00-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:34:25 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-62169434-52e9-45bf-b331-e655e67f7cf9 tempest-VolumeDependencyTests-355909504 None] Lock "cinder-850ce90d-c006-4547-ba43-1edf5cd3cf00-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:34:25 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-62169434-52e9-45bf-b331-e655e67f7cf9 tempest-VolumeDependencyTests-355909504 None] Acquiring lock "cinder-quobyte-850ce90d-c006-4547-ba43-1edf5cd3cf00" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:34:25 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-62169434-52e9-45bf-b331-e655e67f7cf9 tempest-VolumeDependencyTests-355909504 None] Lock "cinder-quobyte-850ce90d-c006-4547-ba43-1edf5cd3cf00" acquired by "delete_volume" :: waited 0.015s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:34:25 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce92ed7-0c42-4c7f-ac81-8854b1025716]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:34:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-62169434-52e9-45bf-b331-e655e67f7cf9 tempest-VolumeDependencyTests-355909504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:25 devstack sudo[105617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00 Sep 03 14:34:25 devstack sudo[105617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:25 devstack sudo[105617]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-62169434-52e9-45bf-b331-e655e67f7cf9 tempest-VolumeDependencyTests-355909504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00" returned: 0 in 0.372s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-62169434-52e9-45bf-b331-e655e67f7cf9 tempest-VolumeDependencyTests-355909504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:25 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00 Sep 03 14:34:25 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:25 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-62169434-52e9-45bf-b331-e655e67f7cf9 tempest-VolumeDependencyTests-355909504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-850ce90d-c006-4547-ba43-1edf5cd3cf00" returned: 0 in 0.241s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:25 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-62169434-52e9-45bf-b331-e655e67f7cf9 tempest-VolumeDependencyTests-355909504 None] Lock "cinder-quobyte-850ce90d-c006-4547-ba43-1edf5cd3cf00" released by "delete_volume" :: held 0.677s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:34:25 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-62169434-52e9-45bf-b331-e655e67f7cf9 tempest-VolumeDependencyTests-355909504 None] Created reservations ['3658fdcb-0b0c-4fd7-a97e-35c577b27ff9', '8c54025f-cc19-4c40-aed8-f8a1de79ac13', '0037e951-65f8-42f4-b548-618396d56a7d', '50a37f1b-efa4-40ff-a9be-74a1e51ee60c'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:34:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-62169434-52e9-45bf-b331-e655e67f7cf9 tempest-VolumeDependencyTests-355909504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:34:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-62169434-52e9-45bf-b331-e655e67f7cf9 tempest-VolumeDependencyTests-355909504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:34:25 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-62169434-52e9-45bf-b331-e655e67f7cf9 tempest-VolumeDependencyTests-355909504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:34:25 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-62169434-52e9-45bf-b331-e655e67f7cf9 tempest-VolumeDependencyTests-355909504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:34:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-62169434-52e9-45bf-b331-e655e67f7cf9 tempest-VolumeDependencyTests-355909504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:34:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-62169434-52e9-45bf-b331-e655e67f7cf9 tempest-VolumeDependencyTests-355909504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:25 devstack sudo[105628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:34:25 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:26 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-62169434-52e9-45bf-b331-e655e67f7cf9 tempest-VolumeDependencyTests-355909504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.289s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:26 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-62169434-52e9-45bf-b331-e655e67f7cf9 tempest-VolumeDependencyTests-355909504 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:34:26 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-62169434-52e9-45bf-b331-e655e67f7cf9 tempest-VolumeDependencyTests-355909504 None] Deleted volume successfully. Sep 03 14:34:26 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c94819ce-7b75-4359-bac7-977f167cb8be tempest-VolumeDependencyTests-355909504 None] Acquiring lock "cinder-5a0f06e5-6bf8-4098-8705-0eccfcd8641b-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:34:26 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-62169434-52e9-45bf-b331-e655e67f7cf9 tempest-VolumeDependencyTests-355909504 None] Lock "cinder-850ce90d-c006-4547-ba43-1edf5cd3cf00-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:34:26 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c94819ce-7b75-4359-bac7-977f167cb8be tempest-VolumeDependencyTests-355909504 None] Lock "cinder-5a0f06e5-6bf8-4098-8705-0eccfcd8641b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:34:26 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c94819ce-7b75-4359-bac7-977f167cb8be tempest-VolumeDependencyTests-355909504 None] Acquiring lock "cinder-quobyte-5a0f06e5-6bf8-4098-8705-0eccfcd8641b" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:34:26 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c94819ce-7b75-4359-bac7-977f167cb8be tempest-VolumeDependencyTests-355909504 None] Lock "cinder-quobyte-5a0f06e5-6bf8-4098-8705-0eccfcd8641b" acquired by "delete_volume" :: waited 0.017s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:34:26 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8446a93-e1ea-48aa-9563-5bfe51dd4903]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:34:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c94819ce-7b75-4359-bac7-977f167cb8be tempest-VolumeDependencyTests-355909504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5a0f06e5-6bf8-4098-8705-0eccfcd8641b {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:26 devstack sudo[105631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5a0f06e5-6bf8-4098-8705-0eccfcd8641b Sep 03 14:34:26 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:26 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c94819ce-7b75-4359-bac7-977f167cb8be tempest-VolumeDependencyTests-355909504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5a0f06e5-6bf8-4098-8705-0eccfcd8641b" returned: 0 in 0.342s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c94819ce-7b75-4359-bac7-977f167cb8be tempest-VolumeDependencyTests-355909504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5a0f06e5-6bf8-4098-8705-0eccfcd8641b {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:26 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5a0f06e5-6bf8-4098-8705-0eccfcd8641b Sep 03 14:34:26 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:26 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c94819ce-7b75-4359-bac7-977f167cb8be tempest-VolumeDependencyTests-355909504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5a0f06e5-6bf8-4098-8705-0eccfcd8641b" returned: 0 in 0.248s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:26 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c94819ce-7b75-4359-bac7-977f167cb8be tempest-VolumeDependencyTests-355909504 None] Lock "cinder-quobyte-5a0f06e5-6bf8-4098-8705-0eccfcd8641b" released by "delete_volume" :: held 0.632s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:34:26 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-c94819ce-7b75-4359-bac7-977f167cb8be tempest-VolumeDependencyTests-355909504 None] Created reservations ['f99597e1-52b5-4f76-81d7-feb02f9f910f', '024823ab-5871-4a9e-96e3-8548f23a2689', 'cbd62375-760e-4d39-96d5-cacc1d450edd', 'ff0edad3-540b-40db-8314-894c1b18c029'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:34:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c94819ce-7b75-4359-bac7-977f167cb8be tempest-VolumeDependencyTests-355909504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:34:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c94819ce-7b75-4359-bac7-977f167cb8be tempest-VolumeDependencyTests-355909504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:34:26 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-c94819ce-7b75-4359-bac7-977f167cb8be tempest-VolumeDependencyTests-355909504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:34:27 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-c94819ce-7b75-4359-bac7-977f167cb8be tempest-VolumeDependencyTests-355909504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:34:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c94819ce-7b75-4359-bac7-977f167cb8be tempest-VolumeDependencyTests-355909504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:34:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c94819ce-7b75-4359-bac7-977f167cb8be tempest-VolumeDependencyTests-355909504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:27 devstack sudo[105640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:34:27 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:27 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c94819ce-7b75-4359-bac7-977f167cb8be tempest-VolumeDependencyTests-355909504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.239s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:27 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-c94819ce-7b75-4359-bac7-977f167cb8be tempest-VolumeDependencyTests-355909504 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:34:27 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-c94819ce-7b75-4359-bac7-977f167cb8be tempest-VolumeDependencyTests-355909504 None] Deleted volume successfully. Sep 03 14:34:27 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c94819ce-7b75-4359-bac7-977f167cb8be tempest-VolumeDependencyTests-355909504 None] Lock "cinder-5a0f06e5-6bf8-4098-8705-0eccfcd8641b-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:34:30 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-34b67efe-711b-4ddc-9ec4-70ab1e5e79f3 tempest-CinderUnicodeTest-597512762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:34:30 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-34b67efe-711b-4ddc-9ec4-70ab1e5e79f3 tempest-CinderUnicodeTest-597512762 None] Flow 'volume_create_manager' (e5102f97-c8d8-47b1-a0c6-02f3209c3fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:34:30 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-34b67efe-711b-4ddc-9ec4-70ab1e5e79f3 tempest-CinderUnicodeTest-597512762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c0584a2-bf7c-4e57-9a32-cc14bd6a4888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:34:30 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-34b67efe-711b-4ddc-9ec4-70ab1e5e79f3 tempest-CinderUnicodeTest-597512762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c0584a2-bf7c-4e57-9a32-cc14bd6a4888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65eb8de1-0814-441e-b2c5-e6acec494b97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22ca917c9eb8453a955fcfb155fc9f45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:34:30Z,use_quota=True,user_id='faf9bb6d3c524ed988cb2f6138ed1afe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:34:30 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-34b67efe-711b-4ddc-9ec4-70ab1e5e79f3 tempest-CinderUnicodeTest-597512762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c79bacab-865d-48b4-a7ec-a57fd16e68ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:34:30 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-34b67efe-711b-4ddc-9ec4-70ab1e5e79f3 tempest-CinderUnicodeTest-597512762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c79bacab-865d-48b4-a7ec-a57fd16e68ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:34:30 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-34b67efe-711b-4ddc-9ec4-70ab1e5e79f3 tempest-CinderUnicodeTest-597512762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (685b65c6-f119-4ca5-974a-2df46d0f38c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:34:30 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-34b67efe-711b-4ddc-9ec4-70ab1e5e79f3 tempest-CinderUnicodeTest-597512762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (685b65c6-f119-4ca5-974a-2df46d0f38c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65eb8de1-0814-441e-b2c5-e6acec494b97', 'volume_name': 'volume-65eb8de1-0814-441e-b2c5-e6acec494b97', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:34:30 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-34b67efe-711b-4ddc-9ec4-70ab1e5e79f3 tempest-CinderUnicodeTest-597512762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c807a65-e4a5-45a7-ba3f-a4ffc5ec8ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:34:30 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-34b67efe-711b-4ddc-9ec4-70ab1e5e79f3 tempest-CinderUnicodeTest-597512762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c807a65-e4a5-45a7-ba3f-a4ffc5ec8ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:34:30 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-34b67efe-711b-4ddc-9ec4-70ab1e5e79f3 tempest-CinderUnicodeTest-597512762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c89d65-b25e-46fe-a75b-ac1cb9884d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:34:30 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-34b67efe-711b-4ddc-9ec4-70ab1e5e79f3 tempest-CinderUnicodeTest-597512762 None] Volume 65eb8de1-0814-441e-b2c5-e6acec494b97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65eb8de1-0814-441e-b2c5-e6acec494b97', 'volume_size': 1} Sep 03 14:34:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-34b67efe-711b-4ddc-9ec4-70ab1e5e79f3 tempest-CinderUnicodeTest-597512762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:34:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-34b67efe-711b-4ddc-9ec4-70ab1e5e79f3 tempest-CinderUnicodeTest-597512762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:34:30 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-34b67efe-711b-4ddc-9ec4-70ab1e5e79f3 tempest-CinderUnicodeTest-597512762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65eb8de1-0814-441e-b2c5-e6acec494b97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22ca917c9eb8453a955fcfb155fc9f45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:34:30Z,use_quota=True,user_id='faf9bb6d3c524ed988cb2f6138ed1afe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:34:30 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-34b67efe-711b-4ddc-9ec4-70ab1e5e79f3 tempest-CinderUnicodeTest-597512762 None] Creating volume 65eb8de1-0814-441e-b2c5-e6acec494b97 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:34:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-34b67efe-711b-4ddc-9ec4-70ab1e5e79f3 tempest-CinderUnicodeTest-597512762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:34:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-34b67efe-711b-4ddc-9ec4-70ab1e5e79f3 tempest-CinderUnicodeTest-597512762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:34:30 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-34b67efe-711b-4ddc-9ec4-70ab1e5e79f3 tempest-CinderUnicodeTest-597512762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:34:30 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-34b67efe-711b-4ddc-9ec4-70ab1e5e79f3 tempest-CinderUnicodeTest-597512762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:34:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-34b67efe-711b-4ddc-9ec4-70ab1e5e79f3 tempest-CinderUnicodeTest-597512762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:34:30 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-34b67efe-711b-4ddc-9ec4-70ab1e5e79f3 tempest-CinderUnicodeTest-597512762 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:34:30 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-34b67efe-711b-4ddc-9ec4-70ab1e5e79f3 tempest-CinderUnicodeTest-597512762 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:34:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-34b67efe-711b-4ddc-9ec4-70ab1e5e79f3 tempest-CinderUnicodeTest-597512762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-65eb8de1-0814-441e-b2c5-e6acec494b97 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:30 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-65eb8de1-0814-441e-b2c5-e6acec494b97 1073741824 Sep 03 14:34:30 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:30 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-34b67efe-711b-4ddc-9ec4-70ab1e5e79f3 tempest-CinderUnicodeTest-597512762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-65eb8de1-0814-441e-b2c5-e6acec494b97 1073741824" returned: 0 in 0.400s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-34b67efe-711b-4ddc-9ec4-70ab1e5e79f3 tempest-CinderUnicodeTest-597512762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-65eb8de1-0814-441e-b2c5-e6acec494b97 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:30 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-65eb8de1-0814-441e-b2c5-e6acec494b97 Sep 03 14:34:30 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:30 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-34b67efe-711b-4ddc-9ec4-70ab1e5e79f3 tempest-CinderUnicodeTest-597512762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-65eb8de1-0814-441e-b2c5-e6acec494b97" returned: 0 in 0.242s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:30 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-34b67efe-711b-4ddc-9ec4-70ab1e5e79f3 tempest-CinderUnicodeTest-597512762 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:34:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-34b67efe-711b-4ddc-9ec4-70ab1e5e79f3 tempest-CinderUnicodeTest-597512762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:34:30 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-34b67efe-711b-4ddc-9ec4-70ab1e5e79f3 tempest-CinderUnicodeTest-597512762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c89d65-b25e-46fe-a75b-ac1cb9884d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65eb8de1-0814-441e-b2c5-e6acec494b97', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:34:30 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-34b67efe-711b-4ddc-9ec4-70ab1e5e79f3 tempest-CinderUnicodeTest-597512762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd216157-8d13-4973-89ef-08f810378aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:34:30 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-34b67efe-711b-4ddc-9ec4-70ab1e5e79f3 tempest-CinderUnicodeTest-597512762 None] Volume volume-65eb8de1-0814-441e-b2c5-e6acec494b97 (65eb8de1-0814-441e-b2c5-e6acec494b97): created successfully Sep 03 14:34:30 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-34b67efe-711b-4ddc-9ec4-70ab1e5e79f3 tempest-CinderUnicodeTest-597512762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd216157-8d13-4973-89ef-08f810378aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:34:30 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-34b67efe-711b-4ddc-9ec4-70ab1e5e79f3 tempest-CinderUnicodeTest-597512762 None] Flow 'volume_create_manager' (e5102f97-c8d8-47b1-a0c6-02f3209c3fb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:34:30 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-34b67efe-711b-4ddc-9ec4-70ab1e5e79f3 tempest-CinderUnicodeTest-597512762 None] Created volume successfully. Sep 03 14:34:31 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1380c8f-1d46-4f5a-aeec-7c06b4c6dcf5 tempest-CinderUnicodeTest-597512762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:34:31 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f1380c8f-1d46-4f5a-aeec-7c06b4c6dcf5 tempest-CinderUnicodeTest-597512762 None] Flow 'volume_create_manager' (cbfe4e9d-0b1b-48a0-9295-8f1ccd9c91e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:34:31 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f1380c8f-1d46-4f5a-aeec-7c06b4c6dcf5 tempest-CinderUnicodeTest-597512762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f9d20a4-bc1d-4fd8-b838-a80db1d0abf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:34:31 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f1380c8f-1d46-4f5a-aeec-7c06b4c6dcf5 tempest-CinderUnicodeTest-597512762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f9d20a4-bc1d-4fd8-b838-a80db1d0abf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:34:31Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2074769922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97134657-c215-4b3d-8223-fbbef89479d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22ca917c9eb8453a955fcfb155fc9f45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:34:32Z,use_quota=True,user_id='faf9bb6d3c524ed988cb2f6138ed1afe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:34:31 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f1380c8f-1d46-4f5a-aeec-7c06b4c6dcf5 tempest-CinderUnicodeTest-597512762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb0e2978-bd96-4fe4-9692-ffe8a1f7917a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:34:31 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f1380c8f-1d46-4f5a-aeec-7c06b4c6dcf5 tempest-CinderUnicodeTest-597512762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb0e2978-bd96-4fe4-9692-ffe8a1f7917a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:34:31 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f1380c8f-1d46-4f5a-aeec-7c06b4c6dcf5 tempest-CinderUnicodeTest-597512762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0e5ed54-28f5-4967-8f11-df61c087d8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:34:31 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f1380c8f-1d46-4f5a-aeec-7c06b4c6dcf5 tempest-CinderUnicodeTest-597512762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0e5ed54-28f5-4967-8f11-df61c087d8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97134657-c215-4b3d-8223-fbbef89479d2', 'volume_name': 'volume-97134657-c215-4b3d-8223-fbbef89479d2', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:34:31 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f1380c8f-1d46-4f5a-aeec-7c06b4c6dcf5 tempest-CinderUnicodeTest-597512762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d25443c2-7f28-4ed5-8eec-8b891c557c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:34:31 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f1380c8f-1d46-4f5a-aeec-7c06b4c6dcf5 tempest-CinderUnicodeTest-597512762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d25443c2-7f28-4ed5-8eec-8b891c557c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:34:31 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f1380c8f-1d46-4f5a-aeec-7c06b4c6dcf5 tempest-CinderUnicodeTest-597512762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40fa6b03-34ef-4e78-afb4-9484f6e15748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:34:31 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-f1380c8f-1d46-4f5a-aeec-7c06b4c6dcf5 tempest-CinderUnicodeTest-597512762 None] Volume 97134657-c215-4b3d-8223-fbbef89479d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97134657-c215-4b3d-8223-fbbef89479d2', 'volume_size': 1} Sep 03 14:34:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f1380c8f-1d46-4f5a-aeec-7c06b4c6dcf5 tempest-CinderUnicodeTest-597512762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:34:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f1380c8f-1d46-4f5a-aeec-7c06b4c6dcf5 tempest-CinderUnicodeTest-597512762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:34:31 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f1380c8f-1d46-4f5a-aeec-7c06b4c6dcf5 tempest-CinderUnicodeTest-597512762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:34:31Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2074769922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97134657-c215-4b3d-8223-fbbef89479d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22ca917c9eb8453a955fcfb155fc9f45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:34:32Z,use_quota=True,user_id='faf9bb6d3c524ed988cb2f6138ed1afe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:34:31 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-f1380c8f-1d46-4f5a-aeec-7c06b4c6dcf5 tempest-CinderUnicodeTest-597512762 None] Creating volume 97134657-c215-4b3d-8223-fbbef89479d2 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:34:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f1380c8f-1d46-4f5a-aeec-7c06b4c6dcf5 tempest-CinderUnicodeTest-597512762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:34:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f1380c8f-1d46-4f5a-aeec-7c06b4c6dcf5 tempest-CinderUnicodeTest-597512762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:34:31 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f1380c8f-1d46-4f5a-aeec-7c06b4c6dcf5 tempest-CinderUnicodeTest-597512762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:34:31 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f1380c8f-1d46-4f5a-aeec-7c06b4c6dcf5 tempest-CinderUnicodeTest-597512762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:34:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f1380c8f-1d46-4f5a-aeec-7c06b4c6dcf5 tempest-CinderUnicodeTest-597512762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:34:31 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f1380c8f-1d46-4f5a-aeec-7c06b4c6dcf5 tempest-CinderUnicodeTest-597512762 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:34:31 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-f1380c8f-1d46-4f5a-aeec-7c06b4c6dcf5 tempest-CinderUnicodeTest-597512762 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:34:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f1380c8f-1d46-4f5a-aeec-7c06b4c6dcf5 tempest-CinderUnicodeTest-597512762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97134657-c215-4b3d-8223-fbbef89479d2 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:31 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97134657-c215-4b3d-8223-fbbef89479d2 1073741824 Sep 03 14:34:31 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:32 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f1380c8f-1d46-4f5a-aeec-7c06b4c6dcf5 tempest-CinderUnicodeTest-597512762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97134657-c215-4b3d-8223-fbbef89479d2 1073741824" returned: 0 in 0.395s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f1380c8f-1d46-4f5a-aeec-7c06b4c6dcf5 tempest-CinderUnicodeTest-597512762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97134657-c215-4b3d-8223-fbbef89479d2 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:32 devstack sudo[105658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97134657-c215-4b3d-8223-fbbef89479d2 Sep 03 14:34:32 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:32 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f1380c8f-1d46-4f5a-aeec-7c06b4c6dcf5 tempest-CinderUnicodeTest-597512762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97134657-c215-4b3d-8223-fbbef89479d2" returned: 0 in 0.240s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:32 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f1380c8f-1d46-4f5a-aeec-7c06b4c6dcf5 tempest-CinderUnicodeTest-597512762 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:34:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f1380c8f-1d46-4f5a-aeec-7c06b4c6dcf5 tempest-CinderUnicodeTest-597512762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:34:32 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f1380c8f-1d46-4f5a-aeec-7c06b4c6dcf5 tempest-CinderUnicodeTest-597512762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40fa6b03-34ef-4e78-afb4-9484f6e15748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97134657-c215-4b3d-8223-fbbef89479d2', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:34:32 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f1380c8f-1d46-4f5a-aeec-7c06b4c6dcf5 tempest-CinderUnicodeTest-597512762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4133d51-e078-4fbf-b750-0d57edb27e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:34:32 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-f1380c8f-1d46-4f5a-aeec-7c06b4c6dcf5 tempest-CinderUnicodeTest-597512762 None] Volume volume-97134657-c215-4b3d-8223-fbbef89479d2 (97134657-c215-4b3d-8223-fbbef89479d2): created successfully Sep 03 14:34:32 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f1380c8f-1d46-4f5a-aeec-7c06b4c6dcf5 tempest-CinderUnicodeTest-597512762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4133d51-e078-4fbf-b750-0d57edb27e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:34:32 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f1380c8f-1d46-4f5a-aeec-7c06b4c6dcf5 tempest-CinderUnicodeTest-597512762 None] Flow 'volume_create_manager' (cbfe4e9d-0b1b-48a0-9295-8f1ccd9c91e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:34:32 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-f1380c8f-1d46-4f5a-aeec-7c06b4c6dcf5 tempest-CinderUnicodeTest-597512762 None] Created volume successfully. Sep 03 14:34:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-aaa9e246-764d-4ca5-abfd-1287607c4a60 tempest-CinderUnicodeTest-597512762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:34:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-aaa9e246-764d-4ca5-abfd-1287607c4a60 tempest-CinderUnicodeTest-597512762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:34:32 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-aaa9e246-764d-4ca5-abfd-1287607c4a60 tempest-CinderUnicodeTest-597512762 None] Creating offline snapshot c86f48ee-f0b4-4b9f-9eca-0edfcbd4f25f of volume 97134657-c215-4b3d-8223-fbbef89479d2 {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:34:32 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f4b410-7ff0-4331-9e5d-c143b1682861]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:34:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-aaa9e246-764d-4ca5-abfd-1287607c4a60 tempest-CinderUnicodeTest-597512762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97134657-c215-4b3d-8223-fbbef89479d2 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:33 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97134657-c215-4b3d-8223-fbbef89479d2 Sep 03 14:34:33 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:33 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:33 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-aaa9e246-764d-4ca5-abfd-1287607c4a60 tempest-CinderUnicodeTest-597512762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97134657-c215-4b3d-8223-fbbef89479d2" returned: 0 in 0.361s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:33 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-aaa9e246-764d-4ca5-abfd-1287607c4a60 tempest-CinderUnicodeTest-597512762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97134657-c215-4b3d-8223-fbbef89479d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97134657-c215-4b3d-8223-fbbef89479d2.c86f48ee-f0b4-4b9f-9eca-0edfcbd4f25f 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:33 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97134657-c215-4b3d-8223-fbbef89479d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97134657-c215-4b3d-8223-fbbef89479d2.c86f48ee-f0b4-4b9f-9eca-0edfcbd4f25f 1G Sep 03 14:34:33 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:33 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:33 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-aaa9e246-764d-4ca5-abfd-1287607c4a60 tempest-CinderUnicodeTest-597512762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97134657-c215-4b3d-8223-fbbef89479d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97134657-c215-4b3d-8223-fbbef89479d2.c86f48ee-f0b4-4b9f-9eca-0edfcbd4f25f 1G" returned: 0 in 0.383s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:33 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-aaa9e246-764d-4ca5-abfd-1287607c4a60 tempest-CinderUnicodeTest-597512762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97134657-c215-4b3d-8223-fbbef89479d2 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97134657-c215-4b3d-8223-fbbef89479d2.c86f48ee-f0b4-4b9f-9eca-0edfcbd4f25f {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:33 devstack sudo[105672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97134657-c215-4b3d-8223-fbbef89479d2 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97134657-c215-4b3d-8223-fbbef89479d2.c86f48ee-f0b4-4b9f-9eca-0edfcbd4f25f Sep 03 14:34:33 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:34 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-aaa9e246-764d-4ca5-abfd-1287607c4a60 tempest-CinderUnicodeTest-597512762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97134657-c215-4b3d-8223-fbbef89479d2 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97134657-c215-4b3d-8223-fbbef89479d2.c86f48ee-f0b4-4b9f-9eca-0edfcbd4f25f" returned: 0 in 0.280s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:34 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-aaa9e246-764d-4ca5-abfd-1287607c4a60 tempest-CinderUnicodeTest-597512762 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97134657-c215-4b3d-8223-fbbef89479d2.c86f48ee-f0b4-4b9f-9eca-0edfcbd4f25f is being set with open permissions: ugo+rw Sep 03 14:34:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-aaa9e246-764d-4ca5-abfd-1287607c4a60 tempest-CinderUnicodeTest-597512762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97134657-c215-4b3d-8223-fbbef89479d2.c86f48ee-f0b4-4b9f-9eca-0edfcbd4f25f {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:34 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97134657-c215-4b3d-8223-fbbef89479d2.c86f48ee-f0b4-4b9f-9eca-0edfcbd4f25f Sep 03 14:34:34 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:34 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-aaa9e246-764d-4ca5-abfd-1287607c4a60 tempest-CinderUnicodeTest-597512762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97134657-c215-4b3d-8223-fbbef89479d2.c86f48ee-f0b4-4b9f-9eca-0edfcbd4f25f" returned: 0 in 0.244s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-aaa9e246-764d-4ca5-abfd-1287607c4a60 tempest-CinderUnicodeTest-597512762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97134657-c215-4b3d-8223-fbbef89479d2.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:34 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97134657-c215-4b3d-8223-fbbef89479d2.info Sep 03 14:34:34 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:34 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-aaa9e246-764d-4ca5-abfd-1287607c4a60 tempest-CinderUnicodeTest-597512762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97134657-c215-4b3d-8223-fbbef89479d2.info" returned: 0 in 0.244s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:34 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-aaa9e246-764d-4ca5-abfd-1287607c4a60 tempest-CinderUnicodeTest-597512762 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97134657-c215-4b3d-8223-fbbef89479d2.info is being set with open permissions: ugo+rw Sep 03 14:34:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-aaa9e246-764d-4ca5-abfd-1287607c4a60 tempest-CinderUnicodeTest-597512762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97134657-c215-4b3d-8223-fbbef89479d2.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:34 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97134657-c215-4b3d-8223-fbbef89479d2.info Sep 03 14:34:34 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:34 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-aaa9e246-764d-4ca5-abfd-1287607c4a60 tempest-CinderUnicodeTest-597512762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97134657-c215-4b3d-8223-fbbef89479d2.info" returned: 0 in 0.242s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-aaa9e246-764d-4ca5-abfd-1287607c4a60 tempest-CinderUnicodeTest-597512762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.835s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:34:34 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-aaa9e246-764d-4ca5-abfd-1287607c4a60 tempest-CinderUnicodeTest-597512762 None] Create snapshot completed successfully Sep 03 14:34:35 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-742b0124-5e6d-4542-9ec0-69acea653687 tempest-CinderUnicodeTest-597512762 None] Acquiring lock "cinder-c86f48ee-f0b4-4b9f-9eca-0edfcbd4f25f-delete_snapshot" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:34:35 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-742b0124-5e6d-4542-9ec0-69acea653687 tempest-CinderUnicodeTest-597512762 None] Lock "cinder-c86f48ee-f0b4-4b9f-9eca-0edfcbd4f25f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:34:35 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-742b0124-5e6d-4542-9ec0-69acea653687 tempest-CinderUnicodeTest-597512762 None] Acquiring lock "cinder-quobyte-97134657-c215-4b3d-8223-fbbef89479d2" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:34:35 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-742b0124-5e6d-4542-9ec0-69acea653687 tempest-CinderUnicodeTest-597512762 None] Lock "cinder-quobyte-97134657-c215-4b3d-8223-fbbef89479d2" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:34:35 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-742b0124-5e6d-4542-9ec0-69acea653687 tempest-CinderUnicodeTest-597512762 None] Acquiring lock "cinder-quobyte-c86f48ee-f0b4-4b9f-9eca-0edfcbd4f25f" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:34:35 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-742b0124-5e6d-4542-9ec0-69acea653687 tempest-CinderUnicodeTest-597512762 None] Lock "cinder-quobyte-c86f48ee-f0b4-4b9f-9eca-0edfcbd4f25f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:34:35 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-742b0124-5e6d-4542-9ec0-69acea653687 tempest-CinderUnicodeTest-597512762 None] Deleting offline snapshot c86f48ee-f0b4-4b9f-9eca-0edfcbd4f25f of volume 97134657-c215-4b3d-8223-fbbef89479d2 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:34:35 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-742b0124-5e6d-4542-9ec0-69acea653687 tempest-CinderUnicodeTest-597512762 None] snapshot_file for this snap is: volume-97134657-c215-4b3d-8223-fbbef89479d2.c86f48ee-f0b4-4b9f-9eca-0edfcbd4f25f {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:34:35 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe591112-0ff6-4762-b7be-5c98b89ebeb2]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:34:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-742b0124-5e6d-4542-9ec0-69acea653687 tempest-CinderUnicodeTest-597512762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97134657-c215-4b3d-8223-fbbef89479d2.c86f48ee-f0b4-4b9f-9eca-0edfcbd4f25f {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:35 devstack sudo[105687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97134657-c215-4b3d-8223-fbbef89479d2.c86f48ee-f0b4-4b9f-9eca-0edfcbd4f25f Sep 03 14:34:35 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:35 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-742b0124-5e6d-4542-9ec0-69acea653687 tempest-CinderUnicodeTest-597512762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97134657-c215-4b3d-8223-fbbef89479d2.c86f48ee-f0b4-4b9f-9eca-0edfcbd4f25f" returned: 0 in 0.349s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:35 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-742b0124-5e6d-4542-9ec0-69acea653687 tempest-CinderUnicodeTest-597512762 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97134657-c215-4b3d-8223-fbbef89479d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:34:35 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e93e21c-7b97-4992-b845-55b7dba23b25]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:34:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-742b0124-5e6d-4542-9ec0-69acea653687 tempest-CinderUnicodeTest-597512762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97134657-c215-4b3d-8223-fbbef89479d2 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:35 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97134657-c215-4b3d-8223-fbbef89479d2 Sep 03 14:34:35 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:35 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-742b0124-5e6d-4542-9ec0-69acea653687 tempest-CinderUnicodeTest-597512762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97134657-c215-4b3d-8223-fbbef89479d2" returned: 0 in 0.344s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-742b0124-5e6d-4542-9ec0-69acea653687 tempest-CinderUnicodeTest-597512762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97134657-c215-4b3d-8223-fbbef89479d2.c86f48ee-f0b4-4b9f-9eca-0edfcbd4f25f {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:35 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97134657-c215-4b3d-8223-fbbef89479d2.c86f48ee-f0b4-4b9f-9eca-0edfcbd4f25f Sep 03 14:34:35 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:36 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-742b0124-5e6d-4542-9ec0-69acea653687 tempest-CinderUnicodeTest-597512762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97134657-c215-4b3d-8223-fbbef89479d2.c86f48ee-f0b4-4b9f-9eca-0edfcbd4f25f" returned: 0 in 0.329s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-742b0124-5e6d-4542-9ec0-69acea653687 tempest-CinderUnicodeTest-597512762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97134657-c215-4b3d-8223-fbbef89479d2.c86f48ee-f0b4-4b9f-9eca-0edfcbd4f25f {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:36 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97134657-c215-4b3d-8223-fbbef89479d2.c86f48ee-f0b4-4b9f-9eca-0edfcbd4f25f Sep 03 14:34:36 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:36 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-742b0124-5e6d-4542-9ec0-69acea653687 tempest-CinderUnicodeTest-597512762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97134657-c215-4b3d-8223-fbbef89479d2.c86f48ee-f0b4-4b9f-9eca-0edfcbd4f25f" returned: 0 in 0.247s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:36 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-742b0124-5e6d-4542-9ec0-69acea653687 tempest-CinderUnicodeTest-597512762 None] Lock "cinder-quobyte-c86f48ee-f0b4-4b9f-9eca-0edfcbd4f25f" released by "_delete_snapshot" :: held 1.367s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:34:36 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-742b0124-5e6d-4542-9ec0-69acea653687 tempest-CinderUnicodeTest-597512762 None] Lock "cinder-quobyte-97134657-c215-4b3d-8223-fbbef89479d2" released by "delete_snapshot" :: held 1.393s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:34:36 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-742b0124-5e6d-4542-9ec0-69acea653687 tempest-CinderUnicodeTest-597512762 None] Created reservations ['c77a4d79-56e7-4440-8be4-769f4b6b6df5', 'b508ba4c-0fe0-4be4-a2c3-cda9720c6722', 'd54a9178-6af5-4fcd-abf7-7fe29a0a8419', 'e4d93ad4-fbfa-44f9-9bb8-23290a7ca884'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:34:36 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-742b0124-5e6d-4542-9ec0-69acea653687 tempest-CinderUnicodeTest-597512762 None] Delete snapshot completed successfully. Sep 03 14:34:36 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-742b0124-5e6d-4542-9ec0-69acea653687 tempest-CinderUnicodeTest-597512762 None] Lock "cinder-c86f48ee-f0b4-4b9f-9eca-0edfcbd4f25f-delete_snapshot" released by "delete_snapshot" :: held 1.513s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:34:37 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-bd38ac66-9062-4aa0-bddf-3a9f4e92c0a9 tempest-CinderUnicodeTest-597512762 None] Acquiring lock "cinder-97134657-c215-4b3d-8223-fbbef89479d2-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:34:37 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-bd38ac66-9062-4aa0-bddf-3a9f4e92c0a9 tempest-CinderUnicodeTest-597512762 None] Lock "cinder-97134657-c215-4b3d-8223-fbbef89479d2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:34:37 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-bd38ac66-9062-4aa0-bddf-3a9f4e92c0a9 tempest-CinderUnicodeTest-597512762 None] Acquiring lock "cinder-quobyte-97134657-c215-4b3d-8223-fbbef89479d2" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:34:37 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-bd38ac66-9062-4aa0-bddf-3a9f4e92c0a9 tempest-CinderUnicodeTest-597512762 None] Lock "cinder-quobyte-97134657-c215-4b3d-8223-fbbef89479d2" acquired by "delete_volume" :: waited 0.015s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:34:37 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c0f494-3b0c-443c-9ab2-13ed3776bd34]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:34:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bd38ac66-9062-4aa0-bddf-3a9f4e92c0a9 tempest-CinderUnicodeTest-597512762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97134657-c215-4b3d-8223-fbbef89479d2 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:37 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97134657-c215-4b3d-8223-fbbef89479d2 Sep 03 14:34:37 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:37 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bd38ac66-9062-4aa0-bddf-3a9f4e92c0a9 tempest-CinderUnicodeTest-597512762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97134657-c215-4b3d-8223-fbbef89479d2" returned: 0 in 0.347s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bd38ac66-9062-4aa0-bddf-3a9f4e92c0a9 tempest-CinderUnicodeTest-597512762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97134657-c215-4b3d-8223-fbbef89479d2 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:37 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97134657-c215-4b3d-8223-fbbef89479d2 Sep 03 14:34:37 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:37 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bd38ac66-9062-4aa0-bddf-3a9f4e92c0a9 tempest-CinderUnicodeTest-597512762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97134657-c215-4b3d-8223-fbbef89479d2" returned: 0 in 0.245s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:37 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-bd38ac66-9062-4aa0-bddf-3a9f4e92c0a9 tempest-CinderUnicodeTest-597512762 None] Lock "cinder-quobyte-97134657-c215-4b3d-8223-fbbef89479d2" released by "delete_volume" :: held 0.644s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:34:37 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-bd38ac66-9062-4aa0-bddf-3a9f4e92c0a9 tempest-CinderUnicodeTest-597512762 None] Created reservations ['3c63ee74-fba0-4228-8f51-005d4961b573', '0becd9f4-610e-4d42-8d0c-57c737a5bcd6', '738ecc58-324a-417b-ad0e-6dce958d0bd6', '4f6e9336-990b-4640-9420-9d81b3d770b5'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:34:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-bd38ac66-9062-4aa0-bddf-3a9f4e92c0a9 tempest-CinderUnicodeTest-597512762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:34:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-bd38ac66-9062-4aa0-bddf-3a9f4e92c0a9 tempest-CinderUnicodeTest-597512762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:34:38 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-bd38ac66-9062-4aa0-bddf-3a9f4e92c0a9 tempest-CinderUnicodeTest-597512762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:34:38 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-bd38ac66-9062-4aa0-bddf-3a9f4e92c0a9 tempest-CinderUnicodeTest-597512762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:34:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-bd38ac66-9062-4aa0-bddf-3a9f4e92c0a9 tempest-CinderUnicodeTest-597512762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:34:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bd38ac66-9062-4aa0-bddf-3a9f4e92c0a9 tempest-CinderUnicodeTest-597512762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:38 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:34:38 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:38 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bd38ac66-9062-4aa0-bddf-3a9f4e92c0a9 tempest-CinderUnicodeTest-597512762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.241s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:38 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-bd38ac66-9062-4aa0-bddf-3a9f4e92c0a9 tempest-CinderUnicodeTest-597512762 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:34:38 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-bd38ac66-9062-4aa0-bddf-3a9f4e92c0a9 tempest-CinderUnicodeTest-597512762 None] Deleted volume successfully. Sep 03 14:34:38 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-bd38ac66-9062-4aa0-bddf-3a9f4e92c0a9 tempest-CinderUnicodeTest-597512762 None] Lock "cinder-97134657-c215-4b3d-8223-fbbef89479d2-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:34:38 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7f019913-7481-4abe-a3c5-d9164ccd65eb tempest-CinderUnicodeTest-597512762 None] Acquiring lock "cinder-65eb8de1-0814-441e-b2c5-e6acec494b97-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:34:38 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7f019913-7481-4abe-a3c5-d9164ccd65eb tempest-CinderUnicodeTest-597512762 None] Lock "cinder-65eb8de1-0814-441e-b2c5-e6acec494b97-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:34:38 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7f019913-7481-4abe-a3c5-d9164ccd65eb tempest-CinderUnicodeTest-597512762 None] Acquiring lock "cinder-quobyte-65eb8de1-0814-441e-b2c5-e6acec494b97" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:34:38 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7f019913-7481-4abe-a3c5-d9164ccd65eb tempest-CinderUnicodeTest-597512762 None] Lock "cinder-quobyte-65eb8de1-0814-441e-b2c5-e6acec494b97" acquired by "delete_volume" :: waited 0.014s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:34:38 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[082de8d5-0dd2-4bb1-834b-bb75e7f8ebf6]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:34:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7f019913-7481-4abe-a3c5-d9164ccd65eb tempest-CinderUnicodeTest-597512762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-65eb8de1-0814-441e-b2c5-e6acec494b97 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:38 devstack sudo[105718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-65eb8de1-0814-441e-b2c5-e6acec494b97 Sep 03 14:34:38 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:38 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7f019913-7481-4abe-a3c5-d9164ccd65eb tempest-CinderUnicodeTest-597512762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-65eb8de1-0814-441e-b2c5-e6acec494b97" returned: 0 in 0.357s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7f019913-7481-4abe-a3c5-d9164ccd65eb tempest-CinderUnicodeTest-597512762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-65eb8de1-0814-441e-b2c5-e6acec494b97 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:38 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-65eb8de1-0814-441e-b2c5-e6acec494b97 Sep 03 14:34:38 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:39 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7f019913-7481-4abe-a3c5-d9164ccd65eb tempest-CinderUnicodeTest-597512762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-65eb8de1-0814-441e-b2c5-e6acec494b97" returned: 0 in 0.241s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:39 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7f019913-7481-4abe-a3c5-d9164ccd65eb tempest-CinderUnicodeTest-597512762 None] Lock "cinder-quobyte-65eb8de1-0814-441e-b2c5-e6acec494b97" released by "delete_volume" :: held 0.635s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:34:39 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-7f019913-7481-4abe-a3c5-d9164ccd65eb tempest-CinderUnicodeTest-597512762 None] Created reservations ['16130662-ab6b-479e-8872-88568284087e', 'e7062ce6-008e-40e2-b1e1-855b6c3684f7', '8d1e87ad-72c5-4a70-a025-af0dbb3667e9', 'f480de1c-8c86-4b42-930d-55f394deb275'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:34:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7f019913-7481-4abe-a3c5-d9164ccd65eb tempest-CinderUnicodeTest-597512762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:34:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7f019913-7481-4abe-a3c5-d9164ccd65eb tempest-CinderUnicodeTest-597512762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:34:39 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-7f019913-7481-4abe-a3c5-d9164ccd65eb tempest-CinderUnicodeTest-597512762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:34:39 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-7f019913-7481-4abe-a3c5-d9164ccd65eb tempest-CinderUnicodeTest-597512762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:34:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7f019913-7481-4abe-a3c5-d9164ccd65eb tempest-CinderUnicodeTest-597512762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:34:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7f019913-7481-4abe-a3c5-d9164ccd65eb tempest-CinderUnicodeTest-597512762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:39 devstack sudo[105726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:34:39 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:39 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7f019913-7481-4abe-a3c5-d9164ccd65eb tempest-CinderUnicodeTest-597512762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.246s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:39 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-7f019913-7481-4abe-a3c5-d9164ccd65eb tempest-CinderUnicodeTest-597512762 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:34:39 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-7f019913-7481-4abe-a3c5-d9164ccd65eb tempest-CinderUnicodeTest-597512762 None] Deleted volume successfully. Sep 03 14:34:39 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7f019913-7481-4abe-a3c5-d9164ccd65eb tempest-CinderUnicodeTest-597512762 None] Lock "cinder-65eb8de1-0814-441e-b2c5-e6acec494b97-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:34:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-1007b44f-8dda-494a-8557-61747fdb9799 req-a1b700df-b360-4966-b185-77b32244ab74 tempest-TestStampPattern-355266855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:34:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-1007b44f-8dda-494a-8557-61747fdb9799 req-a1b700df-b360-4966-b185-77b32244ab74 tempest-TestStampPattern-355266855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:34:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [req-1007b44f-8dda-494a-8557-61747fdb9799 req-a1b700df-b360-4966-b185-77b32244ab74 tempest-TestStampPattern-355266855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:34:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-1007b44f-8dda-494a-8557-61747fdb9799 req-a1b700df-b360-4966-b185-77b32244ab74 tempest-TestStampPattern-355266855 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713', 'name': 'volume-951d4623-3216-4131-8967-3b1c3e60dbd6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3f9d4d80-459f-4dba-b154-4ca2f818ddde', 'enforce_multipath': True} {{(pid=87007) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 14:34:42 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-1007b44f-8dda-494a-8557-61747fdb9799 req-a1b700df-b360-4966-b185-77b32244ab74 tempest-TestStampPattern-355266855 None] attachment_update completed successfully. Sep 03 14:34:45 devstack cinder-volume[87007]: INFO cinder.volume.manager [req-00475f0c-2b10-4a9e-adc3-d465e32d3ef5 req-327c03f1-feff-45fc-9029-d1e3c2da41b1 tempest-TestStampPattern-355266855 None] Terminate volume connection completed successfully. Sep 03 14:34:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [req-00475f0c-2b10-4a9e-adc3-d465e32d3ef5 req-327c03f1-feff-45fc-9029-d1e3c2da41b1 tempest-TestStampPattern-355266855 None] Deleting attachment 3f9d4d80-459f-4dba-b154-4ca2f818ddde. {{(pid=87007) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 14:34:51 devstack cinder-volume[87007]: DEBUG oslo_service.periodic_task [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87007) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 14:34:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:34:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:34:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:34:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:34:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:34:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:51 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-866cbf24-a132-4c85-ae5b-73da20a3004c tempest-TestStampPattern-355266855 None] Acquiring lock "cinder-951d4623-3216-4131-8967-3b1c3e60dbd6-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:34:51 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-866cbf24-a132-4c85-ae5b-73da20a3004c tempest-TestStampPattern-355266855 None] Lock "cinder-951d4623-3216-4131-8967-3b1c3e60dbd6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:34:51 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:34:51 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:51 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-866cbf24-a132-4c85-ae5b-73da20a3004c tempest-TestStampPattern-355266855 None] Acquiring lock "cinder-quobyte-951d4623-3216-4131-8967-3b1c3e60dbd6" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:34:51 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-866cbf24-a132-4c85-ae5b-73da20a3004c tempest-TestStampPattern-355266855 None] Lock "cinder-quobyte-951d4623-3216-4131-8967-3b1c3e60dbd6" acquired by "delete_volume" :: waited 0.017s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:34:51 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c4a6db-2c29-4f8b-9ca5-781fc46c0680]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:34:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-866cbf24-a132-4c85-ae5b-73da20a3004c tempest-TestStampPattern-355266855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-951d4623-3216-4131-8967-3b1c3e60dbd6 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:51 devstack sudo[106201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-951d4623-3216-4131-8967-3b1c3e60dbd6 Sep 03 14:34:51 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:51 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.332s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:51 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:34:51 devstack cinder-volume[87007]: DEBUG oslo_service.periodic_task [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running periodic task VolumeManager._thread_info {{(pid=87007) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 14:34:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] thread count: 28 {{(pid=87007) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 14:34:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] thread info: [<_MainThread(MainThread, started 123689171054720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87007) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 14:34:52 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-866cbf24-a132-4c85-ae5b-73da20a3004c tempest-TestStampPattern-355266855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-951d4623-3216-4131-8967-3b1c3e60dbd6" returned: 0 in 0.411s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-866cbf24-a132-4c85-ae5b-73da20a3004c tempest-TestStampPattern-355266855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-951d4623-3216-4131-8967-3b1c3e60dbd6 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:52 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-951d4623-3216-4131-8967-3b1c3e60dbd6 Sep 03 14:34:52 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:52 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-866cbf24-a132-4c85-ae5b-73da20a3004c tempest-TestStampPattern-355266855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-951d4623-3216-4131-8967-3b1c3e60dbd6" returned: 0 in 0.256s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:52 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-866cbf24-a132-4c85-ae5b-73da20a3004c tempest-TestStampPattern-355266855 None] Lock "cinder-quobyte-951d4623-3216-4131-8967-3b1c3e60dbd6" released by "delete_volume" :: held 0.732s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:34:52 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-866cbf24-a132-4c85-ae5b-73da20a3004c tempest-TestStampPattern-355266855 None] Created reservations ['12173839-3e38-4794-bd1a-b8b9c8967c45', 'a01ce85b-33b5-4446-911a-114c706cd3b5', '9f8d2ad3-fb95-4b98-9035-f9ed10273143', 'bb58710e-afef-4ea3-8824-cfe65a8f653b'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:34:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-866cbf24-a132-4c85-ae5b-73da20a3004c tempest-TestStampPattern-355266855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:34:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-866cbf24-a132-4c85-ae5b-73da20a3004c tempest-TestStampPattern-355266855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:34:52 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-866cbf24-a132-4c85-ae5b-73da20a3004c tempest-TestStampPattern-355266855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:34:52 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-866cbf24-a132-4c85-ae5b-73da20a3004c tempest-TestStampPattern-355266855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:34:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-866cbf24-a132-4c85-ae5b-73da20a3004c tempest-TestStampPattern-355266855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:34:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-866cbf24-a132-4c85-ae5b-73da20a3004c tempest-TestStampPattern-355266855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:52 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:34:52 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:52 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-866cbf24-a132-4c85-ae5b-73da20a3004c tempest-TestStampPattern-355266855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.267s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:52 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-866cbf24-a132-4c85-ae5b-73da20a3004c tempest-TestStampPattern-355266855 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:34:52 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-866cbf24-a132-4c85-ae5b-73da20a3004c tempest-TestStampPattern-355266855 None] Deleted volume successfully. Sep 03 14:34:52 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-866cbf24-a132-4c85-ae5b-73da20a3004c tempest-TestStampPattern-355266855 None] Lock "cinder-951d4623-3216-4131-8967-3b1c3e60dbd6-delete_volume" released by "delete_volume" :: held 1.250s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:34:53 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-4e1a1304-24a0-4650-9ce6-a815e84d0f8f tempest-TestStampPattern-355266855 None] Acquiring lock "cinder-b3603331-0911-48eb-9973-4f9dc95e246a-delete_snapshot" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:34:53 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-4e1a1304-24a0-4650-9ce6-a815e84d0f8f tempest-TestStampPattern-355266855 None] Lock "cinder-b3603331-0911-48eb-9973-4f9dc95e246a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:34:53 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-4e1a1304-24a0-4650-9ce6-a815e84d0f8f tempest-TestStampPattern-355266855 None] Acquiring lock "cinder-quobyte-7c76b755-3a86-4b29-8abc-4cc21e32df6a" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:34:53 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-4e1a1304-24a0-4650-9ce6-a815e84d0f8f tempest-TestStampPattern-355266855 None] Lock "cinder-quobyte-7c76b755-3a86-4b29-8abc-4cc21e32df6a" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:34:53 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-4e1a1304-24a0-4650-9ce6-a815e84d0f8f tempest-TestStampPattern-355266855 None] Acquiring lock "cinder-quobyte-b3603331-0911-48eb-9973-4f9dc95e246a" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:34:53 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-4e1a1304-24a0-4650-9ce6-a815e84d0f8f tempest-TestStampPattern-355266855 None] Lock "cinder-quobyte-b3603331-0911-48eb-9973-4f9dc95e246a" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:34:53 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-4e1a1304-24a0-4650-9ce6-a815e84d0f8f tempest-TestStampPattern-355266855 None] Deleting offline snapshot b3603331-0911-48eb-9973-4f9dc95e246a of volume 7c76b755-3a86-4b29-8abc-4cc21e32df6a {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:34:53 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-4e1a1304-24a0-4650-9ce6-a815e84d0f8f tempest-TestStampPattern-355266855 None] snapshot_file for this snap is: volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a.b3603331-0911-48eb-9973-4f9dc95e246a {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:34:53 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3eedd6c-108a-4e70-ba07-c1d390fa43fc]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:34:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4e1a1304-24a0-4650-9ce6-a815e84d0f8f tempest-TestStampPattern-355266855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a.b3603331-0911-48eb-9973-4f9dc95e246a {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:53 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a.b3603331-0911-48eb-9973-4f9dc95e246a Sep 03 14:34:53 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:53 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4e1a1304-24a0-4650-9ce6-a815e84d0f8f tempest-TestStampPattern-355266855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a.b3603331-0911-48eb-9973-4f9dc95e246a" returned: 0 in 0.370s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:53 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-4e1a1304-24a0-4650-9ce6-a815e84d0f8f tempest-TestStampPattern-355266855 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:34:53 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1639299-e444-403c-9672-c9537d0b2e70]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:34:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4e1a1304-24a0-4650-9ce6-a815e84d0f8f tempest-TestStampPattern-355266855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:53 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a Sep 03 14:34:53 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:54 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4e1a1304-24a0-4650-9ce6-a815e84d0f8f tempest-TestStampPattern-355266855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a" returned: 0 in 0.580s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4e1a1304-24a0-4650-9ce6-a815e84d0f8f tempest-TestStampPattern-355266855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a.b3603331-0911-48eb-9973-4f9dc95e246a {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:54 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a.b3603331-0911-48eb-9973-4f9dc95e246a Sep 03 14:34:54 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:54 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4e1a1304-24a0-4650-9ce6-a815e84d0f8f tempest-TestStampPattern-355266855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a.b3603331-0911-48eb-9973-4f9dc95e246a" returned: 0 in 0.337s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4e1a1304-24a0-4650-9ce6-a815e84d0f8f tempest-TestStampPattern-355266855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a.b3603331-0911-48eb-9973-4f9dc95e246a {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:54 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a.b3603331-0911-48eb-9973-4f9dc95e246a Sep 03 14:34:54 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:54 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4e1a1304-24a0-4650-9ce6-a815e84d0f8f tempest-TestStampPattern-355266855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a.b3603331-0911-48eb-9973-4f9dc95e246a" returned: 0 in 0.254s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:54 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-4e1a1304-24a0-4650-9ce6-a815e84d0f8f tempest-TestStampPattern-355266855 None] Lock "cinder-quobyte-b3603331-0911-48eb-9973-4f9dc95e246a" released by "_delete_snapshot" :: held 1.658s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:34:54 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-4e1a1304-24a0-4650-9ce6-a815e84d0f8f tempest-TestStampPattern-355266855 None] Lock "cinder-quobyte-7c76b755-3a86-4b29-8abc-4cc21e32df6a" released by "delete_snapshot" :: held 1.690s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:34:54 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-4e1a1304-24a0-4650-9ce6-a815e84d0f8f tempest-TestStampPattern-355266855 None] Created reservations ['aaf6b2cb-6a1d-42b8-bf1c-f23bb1e00a97', '8bd49c73-1c19-4b39-8a9b-37b5408696cf', '64f1eb4a-bb14-4820-8ce0-a015447dd5f9', '2f838b7c-1fca-4435-b587-c75ef215b0ea'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:34:54 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-4e1a1304-24a0-4650-9ce6-a815e84d0f8f tempest-TestStampPattern-355266855 None] Delete snapshot completed successfully. Sep 03 14:34:54 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-4e1a1304-24a0-4650-9ce6-a815e84d0f8f tempest-TestStampPattern-355266855 None] Lock "cinder-b3603331-0911-48eb-9973-4f9dc95e246a-delete_snapshot" released by "delete_snapshot" :: held 1.835s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:34:59 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ed598af0-4602-4246-bb12-a515126a40b0 tempest-TestStampPattern-355266855 None] Acquiring lock "cinder-7c76b755-3a86-4b29-8abc-4cc21e32df6a-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:34:59 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ed598af0-4602-4246-bb12-a515126a40b0 tempest-TestStampPattern-355266855 None] Lock "cinder-7c76b755-3a86-4b29-8abc-4cc21e32df6a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:34:59 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:SELECT=117,cinder:UPDATE=141,cinder:DELETE=15,cinder:INSERT=40 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:34:59 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:SELECT=113,cinder:INSERT=37,cinder:UPDATE=170,cinder:DELETE=11 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:34:59 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ed598af0-4602-4246-bb12-a515126a40b0 tempest-TestStampPattern-355266855 None] Acquiring lock "cinder-quobyte-7c76b755-3a86-4b29-8abc-4cc21e32df6a" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:34:59 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ed598af0-4602-4246-bb12-a515126a40b0 tempest-TestStampPattern-355266855 None] Lock "cinder-quobyte-7c76b755-3a86-4b29-8abc-4cc21e32df6a" acquired by "delete_volume" :: waited 0.027s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:34:59 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf8b608-8f8f-43e5-997d-44755103c7f1]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:34:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ed598af0-4602-4246-bb12-a515126a40b0 tempest-TestStampPattern-355266855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:59 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a Sep 03 14:34:59 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:34:59 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Sep 03 14:34:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ed598af0-4602-4246-bb12-a515126a40b0 tempest-TestStampPattern-355266855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a" returned: 0 in 0.404s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:34:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ed598af0-4602-4246-bb12-a515126a40b0 tempest-TestStampPattern-355266855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:34:59 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a Sep 03 14:34:59 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:00 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ed598af0-4602-4246-bb12-a515126a40b0 tempest-TestStampPattern-355266855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7c76b755-3a86-4b29-8abc-4cc21e32df6a" returned: 0 in 0.306s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:00 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ed598af0-4602-4246-bb12-a515126a40b0 tempest-TestStampPattern-355266855 None] Lock "cinder-quobyte-7c76b755-3a86-4b29-8abc-4cc21e32df6a" released by "delete_volume" :: held 0.808s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:35:00 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-ed598af0-4602-4246-bb12-a515126a40b0 tempest-TestStampPattern-355266855 None] Created reservations ['8eafe9b3-0286-4fe9-add8-dd8e6188bffa', '68c9785e-cfd5-430d-901a-a2f48f45fdba', 'd5d51c0f-2599-44f5-8380-e1f0c743b8bf', '761b4e65-512a-4b86-94bb-ff9df33e320d'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:35:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ed598af0-4602-4246-bb12-a515126a40b0 tempest-TestStampPattern-355266855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ed598af0-4602-4246-bb12-a515126a40b0 tempest-TestStampPattern-355266855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:00 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ed598af0-4602-4246-bb12-a515126a40b0 tempest-TestStampPattern-355266855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:35:00 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ed598af0-4602-4246-bb12-a515126a40b0 tempest-TestStampPattern-355266855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:35:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ed598af0-4602-4246-bb12-a515126a40b0 tempest-TestStampPattern-355266855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:35:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ed598af0-4602-4246-bb12-a515126a40b0 tempest-TestStampPattern-355266855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:00 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:35:00 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:00 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ed598af0-4602-4246-bb12-a515126a40b0 tempest-TestStampPattern-355266855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.267s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:00 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-ed598af0-4602-4246-bb12-a515126a40b0 tempest-TestStampPattern-355266855 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:35:00 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-ed598af0-4602-4246-bb12-a515126a40b0 tempest-TestStampPattern-355266855 None] Deleted volume successfully. Sep 03 14:35:00 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ed598af0-4602-4246-bb12-a515126a40b0 tempest-TestStampPattern-355266855 None] Lock "cinder-7c76b755-3a86-4b29-8abc-4cc21e32df6a-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:35:02 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cf329a5-a37a-4f7e-afd8-f09ae9371bb6 tempest-SnapshotDependencyTests-636871709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:35:02 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2cf329a5-a37a-4f7e-afd8-f09ae9371bb6 tempest-SnapshotDependencyTests-636871709 None] Flow 'volume_create_manager' (7efc2351-27db-40f9-a279-f62162ce90c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:35:02 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2cf329a5-a37a-4f7e-afd8-f09ae9371bb6 tempest-SnapshotDependencyTests-636871709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ce4486-adc8-4f0a-8cbe-088d497ea0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:02 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2cf329a5-a37a-4f7e-afd8-f09ae9371bb6 tempest-SnapshotDependencyTests-636871709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ce4486-adc8-4f0a-8cbe-088d497ea0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-847425184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cdb32dd-0d4d-439d-a326-25e91f8b5923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65d1892b32464721a47359c2872cfa09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:35:03Z,use_quota=True,user_id='adfb6953964a44418c58db1e31683f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:02 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2cf329a5-a37a-4f7e-afd8-f09ae9371bb6 tempest-SnapshotDependencyTests-636871709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b54da3bc-2876-4619-8807-e96a9eabc6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:02 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2cf329a5-a37a-4f7e-afd8-f09ae9371bb6 tempest-SnapshotDependencyTests-636871709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b54da3bc-2876-4619-8807-e96a9eabc6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:02 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2cf329a5-a37a-4f7e-afd8-f09ae9371bb6 tempest-SnapshotDependencyTests-636871709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea932fa7-c79a-42e3-8b68-0fe71fcfbe65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:02 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2cf329a5-a37a-4f7e-afd8-f09ae9371bb6 tempest-SnapshotDependencyTests-636871709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea932fa7-c79a-42e3-8b68-0fe71fcfbe65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cdb32dd-0d4d-439d-a326-25e91f8b5923', 'volume_name': 'volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2cf329a5-a37a-4f7e-afd8-f09ae9371bb6 tempest-SnapshotDependencyTests-636871709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17240f42-3aeb-4d6b-8308-f2adebe6663e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2cf329a5-a37a-4f7e-afd8-f09ae9371bb6 tempest-SnapshotDependencyTests-636871709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17240f42-3aeb-4d6b-8308-f2adebe6663e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2cf329a5-a37a-4f7e-afd8-f09ae9371bb6 tempest-SnapshotDependencyTests-636871709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1130e9e1-b61f-47d7-a933-219bc1facfab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:03 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-2cf329a5-a37a-4f7e-afd8-f09ae9371bb6 tempest-SnapshotDependencyTests-636871709 None] Volume 7cdb32dd-0d4d-439d-a326-25e91f8b5923: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923', 'volume_size': 1} Sep 03 14:35:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2cf329a5-a37a-4f7e-afd8-f09ae9371bb6 tempest-SnapshotDependencyTests-636871709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2cf329a5-a37a-4f7e-afd8-f09ae9371bb6 tempest-SnapshotDependencyTests-636871709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:03 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2cf329a5-a37a-4f7e-afd8-f09ae9371bb6 tempest-SnapshotDependencyTests-636871709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-847425184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cdb32dd-0d4d-439d-a326-25e91f8b5923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65d1892b32464721a47359c2872cfa09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:35:03Z,use_quota=True,user_id='adfb6953964a44418c58db1e31683f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:35:03 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-2cf329a5-a37a-4f7e-afd8-f09ae9371bb6 tempest-SnapshotDependencyTests-636871709 None] Creating volume 7cdb32dd-0d4d-439d-a326-25e91f8b5923 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:35:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2cf329a5-a37a-4f7e-afd8-f09ae9371bb6 tempest-SnapshotDependencyTests-636871709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2cf329a5-a37a-4f7e-afd8-f09ae9371bb6 tempest-SnapshotDependencyTests-636871709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:03 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2cf329a5-a37a-4f7e-afd8-f09ae9371bb6 tempest-SnapshotDependencyTests-636871709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:35:03 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2cf329a5-a37a-4f7e-afd8-f09ae9371bb6 tempest-SnapshotDependencyTests-636871709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:35:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2cf329a5-a37a-4f7e-afd8-f09ae9371bb6 tempest-SnapshotDependencyTests-636871709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:35:03 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2cf329a5-a37a-4f7e-afd8-f09ae9371bb6 tempest-SnapshotDependencyTests-636871709 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:35:03 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-2cf329a5-a37a-4f7e-afd8-f09ae9371bb6 tempest-SnapshotDependencyTests-636871709 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:35:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2cf329a5-a37a-4f7e-afd8-f09ae9371bb6 tempest-SnapshotDependencyTests-636871709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:03 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923 1073741824 Sep 03 14:35:03 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:03 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2cf329a5-a37a-4f7e-afd8-f09ae9371bb6 tempest-SnapshotDependencyTests-636871709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923 1073741824" returned: 0 in 0.496s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2cf329a5-a37a-4f7e-afd8-f09ae9371bb6 tempest-SnapshotDependencyTests-636871709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:03 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923 Sep 03 14:35:03 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:03 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2cf329a5-a37a-4f7e-afd8-f09ae9371bb6 tempest-SnapshotDependencyTests-636871709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923" returned: 0 in 0.255s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:03 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2cf329a5-a37a-4f7e-afd8-f09ae9371bb6 tempest-SnapshotDependencyTests-636871709 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:35:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2cf329a5-a37a-4f7e-afd8-f09ae9371bb6 tempest-SnapshotDependencyTests-636871709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:35:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2cf329a5-a37a-4f7e-afd8-f09ae9371bb6 tempest-SnapshotDependencyTests-636871709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1130e9e1-b61f-47d7-a933-219bc1facfab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2cf329a5-a37a-4f7e-afd8-f09ae9371bb6 tempest-SnapshotDependencyTests-636871709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df742422-4aa1-4e7e-8dc6-49773d8d434d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:03 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-2cf329a5-a37a-4f7e-afd8-f09ae9371bb6 tempest-SnapshotDependencyTests-636871709 None] Volume volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923 (7cdb32dd-0d4d-439d-a326-25e91f8b5923): created successfully Sep 03 14:35:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2cf329a5-a37a-4f7e-afd8-f09ae9371bb6 tempest-SnapshotDependencyTests-636871709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df742422-4aa1-4e7e-8dc6-49773d8d434d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2cf329a5-a37a-4f7e-afd8-f09ae9371bb6 tempest-SnapshotDependencyTests-636871709 None] Flow 'volume_create_manager' (7efc2351-27db-40f9-a279-f62162ce90c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:35:03 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-2cf329a5-a37a-4f7e-afd8-f09ae9371bb6 tempest-SnapshotDependencyTests-636871709 None] Created volume successfully. Sep 03 14:35:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-fc19a601-7757-493c-ae01-ab07b6d5499a tempest-SnapshotDependencyTests-636871709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-fc19a601-7757-493c-ae01-ab07b6d5499a tempest-SnapshotDependencyTests-636871709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:05 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-fc19a601-7757-493c-ae01-ab07b6d5499a tempest-SnapshotDependencyTests-636871709 None] Creating offline snapshot 12064128-89d7-408f-9478-8098aa272276 of volume 7cdb32dd-0d4d-439d-a326-25e91f8b5923 {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:35:05 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcda47c-231e-4a81-8d20-4f8c8e12432e]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:35:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fc19a601-7757-493c-ae01-ab07b6d5499a tempest-SnapshotDependencyTests-636871709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:05 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923 Sep 03 14:35:05 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:05 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fc19a601-7757-493c-ae01-ab07b6d5499a tempest-SnapshotDependencyTests-636871709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923" returned: 0 in 0.370s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fc19a601-7757-493c-ae01-ab07b6d5499a tempest-SnapshotDependencyTests-636871709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923.12064128-89d7-408f-9478-8098aa272276 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:05 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923.12064128-89d7-408f-9478-8098aa272276 1G Sep 03 14:35:05 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:06 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fc19a601-7757-493c-ae01-ab07b6d5499a tempest-SnapshotDependencyTests-636871709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923.12064128-89d7-408f-9478-8098aa272276 1G" returned: 0 in 0.468s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fc19a601-7757-493c-ae01-ab07b6d5499a tempest-SnapshotDependencyTests-636871709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923.12064128-89d7-408f-9478-8098aa272276 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:06 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923.12064128-89d7-408f-9478-8098aa272276 Sep 03 14:35:06 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:06 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fc19a601-7757-493c-ae01-ab07b6d5499a tempest-SnapshotDependencyTests-636871709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923.12064128-89d7-408f-9478-8098aa272276" returned: 0 in 0.304s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:06 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-fc19a601-7757-493c-ae01-ab07b6d5499a tempest-SnapshotDependencyTests-636871709 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923.12064128-89d7-408f-9478-8098aa272276 is being set with open permissions: ugo+rw Sep 03 14:35:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fc19a601-7757-493c-ae01-ab07b6d5499a tempest-SnapshotDependencyTests-636871709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923.12064128-89d7-408f-9478-8098aa272276 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:06 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923.12064128-89d7-408f-9478-8098aa272276 Sep 03 14:35:06 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:06 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fc19a601-7757-493c-ae01-ab07b6d5499a tempest-SnapshotDependencyTests-636871709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923.12064128-89d7-408f-9478-8098aa272276" returned: 0 in 0.284s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fc19a601-7757-493c-ae01-ab07b6d5499a tempest-SnapshotDependencyTests-636871709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:06 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923.info Sep 03 14:35:06 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:06 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fc19a601-7757-493c-ae01-ab07b6d5499a tempest-SnapshotDependencyTests-636871709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923.info" returned: 0 in 0.273s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:06 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-fc19a601-7757-493c-ae01-ab07b6d5499a tempest-SnapshotDependencyTests-636871709 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923.info is being set with open permissions: ugo+rw Sep 03 14:35:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fc19a601-7757-493c-ae01-ab07b6d5499a tempest-SnapshotDependencyTests-636871709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:06 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923.info Sep 03 14:35:06 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:07 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fc19a601-7757-493c-ae01-ab07b6d5499a tempest-SnapshotDependencyTests-636871709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923.info" returned: 0 in 0.262s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-fc19a601-7757-493c-ae01-ab07b6d5499a tempest-SnapshotDependencyTests-636871709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.055s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:35:07 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-fc19a601-7757-493c-ae01-ab07b6d5499a tempest-SnapshotDependencyTests-636871709 None] Create snapshot completed successfully Sep 03 14:35:08 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:35:09 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Flow 'volume_create_manager' (3d053700-ed04-4e2d-bef9-750a155271f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:35:09 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95b2a808-0942-44d7-b7d0-f30f8e2288f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:09 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95b2a808-0942-44d7-b7d0-f30f8e2288f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:35:09Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b96a19b2-246a-4e8d-a69a-1a279729b326,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65d1892b32464721a47359c2872cfa09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:35:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=12064128-89d7-408f-9478-8098aa272276,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:35:09Z,use_quota=True,user_id='adfb6953964a44418c58db1e31683f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:09 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eddd1da9-0f5c-472d-a562-02423f7c9cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:09 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eddd1da9-0f5c-472d-a562-02423f7c9cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:09 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77e22db9-1fb8-431b-8bf9-8af23f26c139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:09 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77e22db9-1fb8-431b-8bf9-8af23f26c139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b96a19b2-246a-4e8d-a69a-1a279729b326', 'volume_name': 'volume-b96a19b2-246a-4e8d-a69a-1a279729b326', 'volume_size': 1, 'snapshot_id': '12064128-89d7-408f-9478-8098aa272276'}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:09 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2571a4b-6a36-4c9f-87be-2e257bd42ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:09 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2571a4b-6a36-4c9f-87be-2e257bd42ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:09 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (644b7b14-6701-479b-a3a9-a53c3d8f9b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:09 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Volume b96a19b2-246a-4e8d-a69a-1a279729b326: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b96a19b2-246a-4e8d-a69a-1a279729b326', 'volume_size': 1, 'snapshot_id': '12064128-89d7-408f-9478-8098aa272276'} Sep 03 14:35:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:09 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Acquiring lock "cinder-quobyte-12064128-89d7-408f-9478-8098aa272276-b96a19b2-246a-4e8d-a69a-1a279729b326" by "_create_volume_from_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:35:09 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Lock "cinder-quobyte-12064128-89d7-408f-9478-8098aa272276-b96a19b2-246a-4e8d-a69a-1a279729b326" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:35:09 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Creating volume b96a19b2-246a-4e8d-a69a-1a279729b326 from snapshot 12064128-89d7-408f-9478-8098aa272276 {{(pid=87007) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 14:35:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:09 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:35:09 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:35:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:35:09 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:35:09 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Acquiring lock "cinder-quobyte-b96a19b2-246a-4e8d-a69a-1a279729b326" by "_copy_volume_from_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:35:09 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Lock "cinder-quobyte-b96a19b2-246a-4e8d-a69a-1a279729b326" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:35:09 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] snapshot: 12064128-89d7-408f-9478-8098aa272276, volume: b96a19b2-246a-4e8d-a69a-1a279729b326, {{(pid=87007) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 14:35:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:09 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:35:09 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:35:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:35:09 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3e9a5c-510d-487c-90dd-e0ae04045115]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:35:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923.12064128-89d7-408f-9478-8098aa272276 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:09 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923.12064128-89d7-408f-9478-8098aa272276 Sep 03 14:35:09 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:09 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923.12064128-89d7-408f-9478-8098aa272276" returned: 0 in 0.348s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:09 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:35:09 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[77acbc52-af71-4872-b83c-0265698825e2]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:35:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:09 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923 Sep 03 14:35:09 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:09 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923" returned: 0 in 0.400s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:09 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923 {{(pid=87007) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 14:35:09 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Creating direct copy from snapshot {{(pid=87007) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 14:35:09 devstack cinder-volume[87007]: DEBUG cinder.utils [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Path /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b96a19b2-246a-4e8d-a69a-1a279729b326 not found in is_blk_device check {{(pid=87007) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 14:35:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b96a19b2-246a-4e8d-a69a-1a279729b326 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:09 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b96a19b2-246a-4e8d-a69a-1a279729b326 Sep 03 14:35:09 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:15 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b96a19b2-246a-4e8d-a69a-1a279729b326" returned: 0 in 5.096s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:15 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Image conversion details: src /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923, size 1024.00 MB, duration 5.10 sec, destination /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b96a19b2-246a-4e8d-a69a-1a279729b326 {{(pid=87007) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 14:35:15 devstack cinder-volume[87007]: INFO cinder.image.image_utils [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Converted 1024.00 MB image at 200.91 MB/s Sep 03 14:35:15 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b96a19b2-246a-4e8d-a69a-1a279729b326 is being set with open permissions: ugo+rw Sep 03 14:35:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b96a19b2-246a-4e8d-a69a-1a279729b326 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:15 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b96a19b2-246a-4e8d-a69a-1a279729b326 Sep 03 14:35:15 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:15 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b96a19b2-246a-4e8d-a69a-1a279729b326" returned: 0 in 0.255s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:15 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Lock "cinder-quobyte-b96a19b2-246a-4e8d-a69a-1a279729b326" released by "_copy_volume_from_snapshot" :: held 6.185s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:35:15 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Lock "cinder-quobyte-12064128-89d7-408f-9478-8098aa272276-b96a19b2-246a-4e8d-a69a-1a279729b326" released by "_create_volume_from_snapshot" :: held 6.253s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:35:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.276s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:35:15 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (644b7b14-6701-479b-a3a9-a53c3d8f9b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b96a19b2-246a-4e8d-a69a-1a279729b326', 'volume_size': 1, 'snapshot_id': '12064128-89d7-408f-9478-8098aa272276'}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:15 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab9c0ccb-57f6-48f7-8de5-34a00d310654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:15 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Volume volume-b96a19b2-246a-4e8d-a69a-1a279729b326 (b96a19b2-246a-4e8d-a69a-1a279729b326): created successfully Sep 03 14:35:15 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab9c0ccb-57f6-48f7-8de5-34a00d310654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:15 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Flow 'volume_create_manager' (3d053700-ed04-4e2d-bef9-750a155271f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:35:15 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-cf01816b-91c6-484a-8186-5f1a50d5e92c tempest-SnapshotDependencyTests-636871709 None] Created volume successfully. Sep 03 14:35:15 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7a1074f9-a540-4d3a-aba5-96ca2fd5faca tempest-SnapshotDependencyTests-636871709 None] Acquiring lock "cinder-12064128-89d7-408f-9478-8098aa272276-delete_snapshot" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:35:15 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7a1074f9-a540-4d3a-aba5-96ca2fd5faca tempest-SnapshotDependencyTests-636871709 None] Lock "cinder-12064128-89d7-408f-9478-8098aa272276-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:35:15 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7a1074f9-a540-4d3a-aba5-96ca2fd5faca tempest-SnapshotDependencyTests-636871709 None] Acquiring lock "cinder-quobyte-7cdb32dd-0d4d-439d-a326-25e91f8b5923" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:35:15 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7a1074f9-a540-4d3a-aba5-96ca2fd5faca tempest-SnapshotDependencyTests-636871709 None] Lock "cinder-quobyte-7cdb32dd-0d4d-439d-a326-25e91f8b5923" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:35:15 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7a1074f9-a540-4d3a-aba5-96ca2fd5faca tempest-SnapshotDependencyTests-636871709 None] Acquiring lock "cinder-quobyte-12064128-89d7-408f-9478-8098aa272276" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:35:15 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7a1074f9-a540-4d3a-aba5-96ca2fd5faca tempest-SnapshotDependencyTests-636871709 None] Lock "cinder-quobyte-12064128-89d7-408f-9478-8098aa272276" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:35:15 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-7a1074f9-a540-4d3a-aba5-96ca2fd5faca tempest-SnapshotDependencyTests-636871709 None] Deleting offline snapshot 12064128-89d7-408f-9478-8098aa272276 of volume 7cdb32dd-0d4d-439d-a326-25e91f8b5923 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:35:15 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-7a1074f9-a540-4d3a-aba5-96ca2fd5faca tempest-SnapshotDependencyTests-636871709 None] snapshot_file for this snap is: volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923.12064128-89d7-408f-9478-8098aa272276 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:35:15 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd60196-1624-4c56-8d45-96a61dfade9a]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:35:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7a1074f9-a540-4d3a-aba5-96ca2fd5faca tempest-SnapshotDependencyTests-636871709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923.12064128-89d7-408f-9478-8098aa272276 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:15 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923.12064128-89d7-408f-9478-8098aa272276 Sep 03 14:35:15 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:16 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7a1074f9-a540-4d3a-aba5-96ca2fd5faca tempest-SnapshotDependencyTests-636871709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923.12064128-89d7-408f-9478-8098aa272276" returned: 0 in 0.360s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:16 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-7a1074f9-a540-4d3a-aba5-96ca2fd5faca tempest-SnapshotDependencyTests-636871709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:35:16 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2670e8-9c9b-4d9d-990d-485f09afdf0d]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:35:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7a1074f9-a540-4d3a-aba5-96ca2fd5faca tempest-SnapshotDependencyTests-636871709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:16 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923 Sep 03 14:35:16 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:16 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7a1074f9-a540-4d3a-aba5-96ca2fd5faca tempest-SnapshotDependencyTests-636871709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923" returned: 0 in 0.546s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7a1074f9-a540-4d3a-aba5-96ca2fd5faca tempest-SnapshotDependencyTests-636871709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923.12064128-89d7-408f-9478-8098aa272276 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:16 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923.12064128-89d7-408f-9478-8098aa272276 Sep 03 14:35:16 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:17 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7a1074f9-a540-4d3a-aba5-96ca2fd5faca tempest-SnapshotDependencyTests-636871709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923.12064128-89d7-408f-9478-8098aa272276" returned: 0 in 0.358s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7a1074f9-a540-4d3a-aba5-96ca2fd5faca tempest-SnapshotDependencyTests-636871709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923.12064128-89d7-408f-9478-8098aa272276 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:17 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923.12064128-89d7-408f-9478-8098aa272276 Sep 03 14:35:17 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:17 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7a1074f9-a540-4d3a-aba5-96ca2fd5faca tempest-SnapshotDependencyTests-636871709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923.12064128-89d7-408f-9478-8098aa272276" returned: 0 in 0.264s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:17 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7a1074f9-a540-4d3a-aba5-96ca2fd5faca tempest-SnapshotDependencyTests-636871709 None] Lock "cinder-quobyte-12064128-89d7-408f-9478-8098aa272276" released by "_delete_snapshot" :: held 1.634s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:35:17 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7a1074f9-a540-4d3a-aba5-96ca2fd5faca tempest-SnapshotDependencyTests-636871709 None] Lock "cinder-quobyte-7cdb32dd-0d4d-439d-a326-25e91f8b5923" released by "delete_snapshot" :: held 1.658s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:35:17 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-7a1074f9-a540-4d3a-aba5-96ca2fd5faca tempest-SnapshotDependencyTests-636871709 None] Created reservations ['8db21a7e-b88a-4ea4-9a23-e48770696d87', 'fe083179-fb30-47e4-811b-6f18d952a77c', '77de57b9-1db9-400a-8996-e36387a2636c', 'f6e24736-e479-4169-acc5-4adfa07e7748'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:35:17 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-7a1074f9-a540-4d3a-aba5-96ca2fd5faca tempest-SnapshotDependencyTests-636871709 None] Delete snapshot completed successfully. Sep 03 14:35:17 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7a1074f9-a540-4d3a-aba5-96ca2fd5faca tempest-SnapshotDependencyTests-636871709 None] Lock "cinder-12064128-89d7-408f-9478-8098aa272276-delete_snapshot" released by "delete_snapshot" :: held 1.802s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:35:17 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-79b0b161-c89d-4124-b241-b6ace53fd07b tempest-SnapshotDependencyTests-636871709 None] Acquiring lock "cinder-7cdb32dd-0d4d-439d-a326-25e91f8b5923-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:35:17 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-79b0b161-c89d-4124-b241-b6ace53fd07b tempest-SnapshotDependencyTests-636871709 None] Lock "cinder-7cdb32dd-0d4d-439d-a326-25e91f8b5923-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:35:17 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-79b0b161-c89d-4124-b241-b6ace53fd07b tempest-SnapshotDependencyTests-636871709 None] Acquiring lock "cinder-quobyte-7cdb32dd-0d4d-439d-a326-25e91f8b5923" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:35:17 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-79b0b161-c89d-4124-b241-b6ace53fd07b tempest-SnapshotDependencyTests-636871709 None] Lock "cinder-quobyte-7cdb32dd-0d4d-439d-a326-25e91f8b5923" acquired by "delete_volume" :: waited 0.023s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:35:18 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ececda-bb1f-427a-91be-b6a910f8b906]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:35:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-79b0b161-c89d-4124-b241-b6ace53fd07b tempest-SnapshotDependencyTests-636871709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:18 devstack sudo[106401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923 Sep 03 14:35:18 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:18 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-79b0b161-c89d-4124-b241-b6ace53fd07b tempest-SnapshotDependencyTests-636871709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923" returned: 0 in 0.377s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-79b0b161-c89d-4124-b241-b6ace53fd07b tempest-SnapshotDependencyTests-636871709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:18 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923 Sep 03 14:35:18 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:18 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-79b0b161-c89d-4124-b241-b6ace53fd07b tempest-SnapshotDependencyTests-636871709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-7cdb32dd-0d4d-439d-a326-25e91f8b5923" returned: 0 in 0.254s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:18 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-79b0b161-c89d-4124-b241-b6ace53fd07b tempest-SnapshotDependencyTests-636871709 None] Lock "cinder-quobyte-7cdb32dd-0d4d-439d-a326-25e91f8b5923" released by "delete_volume" :: held 0.700s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:35:18 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-79b0b161-c89d-4124-b241-b6ace53fd07b tempest-SnapshotDependencyTests-636871709 None] Created reservations ['7b5c39c2-a321-4466-81b5-9ce5542b204c', '4f885647-adc9-4432-a90c-29868f09ea5e', '648abf88-fc3f-44db-bf7e-3659042a479f', '2c25cefb-1bec-479b-a4c0-93102ef68821'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:35:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-79b0b161-c89d-4124-b241-b6ace53fd07b tempest-SnapshotDependencyTests-636871709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-79b0b161-c89d-4124-b241-b6ace53fd07b tempest-SnapshotDependencyTests-636871709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:18 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-79b0b161-c89d-4124-b241-b6ace53fd07b tempest-SnapshotDependencyTests-636871709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:35:18 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-79b0b161-c89d-4124-b241-b6ace53fd07b tempest-SnapshotDependencyTests-636871709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:35:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-79b0b161-c89d-4124-b241-b6ace53fd07b tempest-SnapshotDependencyTests-636871709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:35:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-79b0b161-c89d-4124-b241-b6ace53fd07b tempest-SnapshotDependencyTests-636871709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:18 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:35:18 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:19 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-da8b93ca-2f19-4160-b03b-d0a81ff1ab5a tempest-SnapshotDependencyTests-636871709 None] Acquiring lock "cinder-b96a19b2-246a-4e8d-a69a-1a279729b326-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:35:19 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-da8b93ca-2f19-4160-b03b-d0a81ff1ab5a tempest-SnapshotDependencyTests-636871709 None] Lock "cinder-b96a19b2-246a-4e8d-a69a-1a279729b326-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:35:19 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-79b0b161-c89d-4124-b241-b6ace53fd07b tempest-SnapshotDependencyTests-636871709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.303s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:19 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-79b0b161-c89d-4124-b241-b6ace53fd07b tempest-SnapshotDependencyTests-636871709 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:35:19 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-79b0b161-c89d-4124-b241-b6ace53fd07b tempest-SnapshotDependencyTests-636871709 None] Deleted volume successfully. Sep 03 14:35:19 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-79b0b161-c89d-4124-b241-b6ace53fd07b tempest-SnapshotDependencyTests-636871709 None] Lock "cinder-7cdb32dd-0d4d-439d-a326-25e91f8b5923-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:35:19 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-da8b93ca-2f19-4160-b03b-d0a81ff1ab5a tempest-SnapshotDependencyTests-636871709 None] Acquiring lock "cinder-quobyte-b96a19b2-246a-4e8d-a69a-1a279729b326" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:35:19 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-da8b93ca-2f19-4160-b03b-d0a81ff1ab5a tempest-SnapshotDependencyTests-636871709 None] Lock "cinder-quobyte-b96a19b2-246a-4e8d-a69a-1a279729b326" acquired by "delete_volume" :: waited 0.018s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:35:19 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9ec5e1-539e-4685-9333-61be5b3606cc]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:35:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-da8b93ca-2f19-4160-b03b-d0a81ff1ab5a tempest-SnapshotDependencyTests-636871709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b96a19b2-246a-4e8d-a69a-1a279729b326 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:19 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b96a19b2-246a-4e8d-a69a-1a279729b326 Sep 03 14:35:19 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:19 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-da8b93ca-2f19-4160-b03b-d0a81ff1ab5a tempest-SnapshotDependencyTests-636871709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b96a19b2-246a-4e8d-a69a-1a279729b326" returned: 0 in 0.384s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-da8b93ca-2f19-4160-b03b-d0a81ff1ab5a tempest-SnapshotDependencyTests-636871709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b96a19b2-246a-4e8d-a69a-1a279729b326 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:19 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b96a19b2-246a-4e8d-a69a-1a279729b326 Sep 03 14:35:19 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:19 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-da8b93ca-2f19-4160-b03b-d0a81ff1ab5a tempest-SnapshotDependencyTests-636871709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b96a19b2-246a-4e8d-a69a-1a279729b326" returned: 0 in 0.256s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:19 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-da8b93ca-2f19-4160-b03b-d0a81ff1ab5a tempest-SnapshotDependencyTests-636871709 None] Lock "cinder-quobyte-b96a19b2-246a-4e8d-a69a-1a279729b326" released by "delete_volume" :: held 0.682s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:35:19 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-da8b93ca-2f19-4160-b03b-d0a81ff1ab5a tempest-SnapshotDependencyTests-636871709 None] Created reservations ['581d42ff-98ee-48d1-bb01-08eed20e3ef4', '5e5f787b-54c1-4e7e-af97-6af6663d3db1', 'fb14089e-7d90-4c5f-aa75-86e3aede7ca4', '2754e5fd-198e-466e-b8b8-11a40ae9768d'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:35:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-da8b93ca-2f19-4160-b03b-d0a81ff1ab5a tempest-SnapshotDependencyTests-636871709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-da8b93ca-2f19-4160-b03b-d0a81ff1ab5a tempest-SnapshotDependencyTests-636871709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:19 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-da8b93ca-2f19-4160-b03b-d0a81ff1ab5a tempest-SnapshotDependencyTests-636871709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:35:19 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-da8b93ca-2f19-4160-b03b-d0a81ff1ab5a tempest-SnapshotDependencyTests-636871709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:35:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-da8b93ca-2f19-4160-b03b-d0a81ff1ab5a tempest-SnapshotDependencyTests-636871709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:35:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-da8b93ca-2f19-4160-b03b-d0a81ff1ab5a tempest-SnapshotDependencyTests-636871709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:19 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:35:19 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:20 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-da8b93ca-2f19-4160-b03b-d0a81ff1ab5a tempest-SnapshotDependencyTests-636871709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.252s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:20 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-da8b93ca-2f19-4160-b03b-d0a81ff1ab5a tempest-SnapshotDependencyTests-636871709 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:35:20 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-da8b93ca-2f19-4160-b03b-d0a81ff1ab5a tempest-SnapshotDependencyTests-636871709 None] Deleted volume successfully. Sep 03 14:35:20 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-da8b93ca-2f19-4160-b03b-d0a81ff1ab5a tempest-SnapshotDependencyTests-636871709 None] Lock "cinder-b96a19b2-246a-4e8d-a69a-1a279729b326-delete_volume" released by "delete_volume" :: held 1.162s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:35:29 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:SELECT=35,cinder:INSERT=10,cinder:UPDATE=37,cinder:DELETE=1 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:35:30 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:SELECT=24,cinder:INSERT=9,cinder:UPDATE=37,cinder:DELETE=5 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:35:40 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-5645348b-3af5-4730-8cd3-e683f2490ba6 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:35:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5645348b-3af5-4730-8cd3-e683f2490ba6 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Flow 'volume_create_manager' (a9edadc9-191a-464a-a1e2-5ae8a34fcba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:35:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5645348b-3af5-4730-8cd3-e683f2490ba6 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc21eb69-249f-4699-ad6e-ca9efcdc5030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:40 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a8a8778-63c0-45d7-a248-66ae8f5cf86b tempest-VolumeDependencyTests-868207421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:35:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0a8a8778-63c0-45d7-a248-66ae8f5cf86b tempest-VolumeDependencyTests-868207421 None] Flow 'volume_create_manager' (9664316c-ff24-4867-a5e4-12fb221398e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:35:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0a8a8778-63c0-45d7-a248-66ae8f5cf86b tempest-VolumeDependencyTests-868207421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c5aceb3-ce8e-4ab9-ba73-8c78462b211a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5645348b-3af5-4730-8cd3-e683f2490ba6 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc21eb69-249f-4699-ad6e-ca9efcdc5030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:35:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-633464838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b56d3bb1-a5b2-49c3-b653-b38bd464a538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b45c494de63b41b5a5f043d222605cf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:35:41Z,use_quota=True,user_id='cfe18c2eff8c4880bd9241eaead5957a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5645348b-3af5-4730-8cd3-e683f2490ba6 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01726aac-5bb2-49a5-8c0a-f72e79d399ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5645348b-3af5-4730-8cd3-e683f2490ba6 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01726aac-5bb2-49a5-8c0a-f72e79d399ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5645348b-3af5-4730-8cd3-e683f2490ba6 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (209ad0e0-016a-4458-9747-95fa6268736b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5645348b-3af5-4730-8cd3-e683f2490ba6 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (209ad0e0-016a-4458-9747-95fa6268736b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b56d3bb1-a5b2-49c3-b653-b38bd464a538', 'volume_name': 'volume-b56d3bb1-a5b2-49c3-b653-b38bd464a538', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5645348b-3af5-4730-8cd3-e683f2490ba6 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (299c2fc8-0169-4006-8139-d1c1975a5861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5645348b-3af5-4730-8cd3-e683f2490ba6 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (299c2fc8-0169-4006-8139-d1c1975a5861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5645348b-3af5-4730-8cd3-e683f2490ba6 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e81c91b-dab0-47a5-998a-af0aa950d31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:40 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-5645348b-3af5-4730-8cd3-e683f2490ba6 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Volume b56d3bb1-a5b2-49c3-b653-b38bd464a538: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b56d3bb1-a5b2-49c3-b653-b38bd464a538', 'volume_size': 1} Sep 03 14:35:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-5645348b-3af5-4730-8cd3-e683f2490ba6 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-5645348b-3af5-4730-8cd3-e683f2490ba6 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:40 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-5645348b-3af5-4730-8cd3-e683f2490ba6 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:35:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-633464838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b56d3bb1-a5b2-49c3-b653-b38bd464a538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b45c494de63b41b5a5f043d222605cf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:35:41Z,use_quota=True,user_id='cfe18c2eff8c4880bd9241eaead5957a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:35:40 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-5645348b-3af5-4730-8cd3-e683f2490ba6 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Creating volume b56d3bb1-a5b2-49c3-b653-b38bd464a538 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:35:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-5645348b-3af5-4730-8cd3-e683f2490ba6 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-5645348b-3af5-4730-8cd3-e683f2490ba6 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:40 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-5645348b-3af5-4730-8cd3-e683f2490ba6 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:35:40 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-5645348b-3af5-4730-8cd3-e683f2490ba6 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:35:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-5645348b-3af5-4730-8cd3-e683f2490ba6 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:35:40 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-5645348b-3af5-4730-8cd3-e683f2490ba6 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:35:40 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-5645348b-3af5-4730-8cd3-e683f2490ba6 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:35:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5645348b-3af5-4730-8cd3-e683f2490ba6 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b56d3bb1-a5b2-49c3-b653-b38bd464a538 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0a8a8778-63c0-45d7-a248-66ae8f5cf86b tempest-VolumeDependencyTests-868207421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c5aceb3-ce8e-4ab9-ba73-8c78462b211a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:35:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-186655037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ca6a53f-4580-4fb2-ad42-85386e9b1dff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98d1833b12e740fb82e9257ec92fe5d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:35:41Z,use_quota=True,user_id='b675a50c2cd3431ebc9b98882b788856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0a8a8778-63c0-45d7-a248-66ae8f5cf86b tempest-VolumeDependencyTests-868207421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7203fda0-45bb-4a6c-bcbb-f6a037c4b2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:40 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b56d3bb1-a5b2-49c3-b653-b38bd464a538 1073741824 Sep 03 14:35:40 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0a8a8778-63c0-45d7-a248-66ae8f5cf86b tempest-VolumeDependencyTests-868207421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7203fda0-45bb-4a6c-bcbb-f6a037c4b2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0a8a8778-63c0-45d7-a248-66ae8f5cf86b tempest-VolumeDependencyTests-868207421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1e2cfaa-5706-4e71-a233-7c10f4710946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0a8a8778-63c0-45d7-a248-66ae8f5cf86b tempest-VolumeDependencyTests-868207421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1e2cfaa-5706-4e71-a233-7c10f4710946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ca6a53f-4580-4fb2-ad42-85386e9b1dff', 'volume_name': 'volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0a8a8778-63c0-45d7-a248-66ae8f5cf86b tempest-VolumeDependencyTests-868207421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2880b45c-e920-4155-bdef-d0bd98059ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0a8a8778-63c0-45d7-a248-66ae8f5cf86b tempest-VolumeDependencyTests-868207421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2880b45c-e920-4155-bdef-d0bd98059ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:40 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0a8a8778-63c0-45d7-a248-66ae8f5cf86b tempest-VolumeDependencyTests-868207421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a1e3798-e34e-4918-9957-5f7c05414f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:40 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-0a8a8778-63c0-45d7-a248-66ae8f5cf86b tempest-VolumeDependencyTests-868207421 None] Volume 8ca6a53f-4580-4fb2-ad42-85386e9b1dff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff', 'volume_size': 1} Sep 03 14:35:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-0a8a8778-63c0-45d7-a248-66ae8f5cf86b tempest-VolumeDependencyTests-868207421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:41 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9515bb6-0499-48a0-a22f-7bf0e92ddb07 tempest-CreateVolumesFromImageTest-1435429064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:35:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c9515bb6-0499-48a0-a22f-7bf0e92ddb07 tempest-CreateVolumesFromImageTest-1435429064 None] Flow 'volume_create_manager' (b922254e-9245-4066-875b-4462a76e2ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:35:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c9515bb6-0499-48a0-a22f-7bf0e92ddb07 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (379cc227-4ba6-4c6b-bc25-8f5213b9eaca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c9515bb6-0499-48a0-a22f-7bf0e92ddb07 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (379cc227-4ba6-4c6b-bc25-8f5213b9eaca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1040622791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5a20647-0ff1-4fea-a697-fc51e1ccd4d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71500195ab8c417eb106ac0b2b2543ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:35:41Z,use_quota=True,user_id='a98e7ed993b8454baa4de42532e94fc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c9515bb6-0499-48a0-a22f-7bf0e92ddb07 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1650b78a-5f50-4e4e-bcaf-d8b61ddffba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c9515bb6-0499-48a0-a22f-7bf0e92ddb07 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1650b78a-5f50-4e4e-bcaf-d8b61ddffba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c9515bb6-0499-48a0-a22f-7bf0e92ddb07 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eded47e7-ab06-49f3-b6d4-c0bdf8f96ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c9515bb6-0499-48a0-a22f-7bf0e92ddb07 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eded47e7-ab06-49f3-b6d4-c0bdf8f96ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5a20647-0ff1-4fea-a697-fc51e1ccd4d3', 'volume_name': 'volume-c5a20647-0ff1-4fea-a697-fc51e1ccd4d3', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c9515bb6-0499-48a0-a22f-7bf0e92ddb07 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88c2802c-5f95-4d36-9d9f-5d8076f78046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c9515bb6-0499-48a0-a22f-7bf0e92ddb07 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88c2802c-5f95-4d36-9d9f-5d8076f78046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c9515bb6-0499-48a0-a22f-7bf0e92ddb07 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (370dd73b-b6fa-40a2-9f7d-3dd1a9473ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:41 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-c9515bb6-0499-48a0-a22f-7bf0e92ddb07 tempest-CreateVolumesFromImageTest-1435429064 None] Volume c5a20647-0ff1-4fea-a697-fc51e1ccd4d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5a20647-0ff1-4fea-a697-fc51e1ccd4d3', 'volume_size': 1} Sep 03 14:35:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c9515bb6-0499-48a0-a22f-7bf0e92ddb07 tempest-CreateVolumesFromImageTest-1435429064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:41 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5645348b-3af5-4730-8cd3-e683f2490ba6 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b56d3bb1-a5b2-49c3-b653-b38bd464a538 1073741824" returned: 0 in 0.607s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5645348b-3af5-4730-8cd3-e683f2490ba6 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b56d3bb1-a5b2-49c3-b653-b38bd464a538 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:41 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b56d3bb1-a5b2-49c3-b653-b38bd464a538 Sep 03 14:35:41 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:41 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9e1e39b-7750-4abb-be8b-4ce893ff7bd8 tempest-CreateVolumesFromImageTest-1435429064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:35:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d9e1e39b-7750-4abb-be8b-4ce893ff7bd8 tempest-CreateVolumesFromImageTest-1435429064 None] Flow 'volume_create_manager' (453904f9-209c-4616-a635-31198f687f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:35:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d9e1e39b-7750-4abb-be8b-4ce893ff7bd8 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bac2d23-fd3d-4277-a419-6c6da863c770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d9e1e39b-7750-4abb-be8b-4ce893ff7bd8 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bac2d23-fd3d-4277-a419-6c6da863c770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-311999079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41d88077-d8c3-4859-9def-f73abe7e8999,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71500195ab8c417eb106ac0b2b2543ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:35:42Z,use_quota=True,user_id='a98e7ed993b8454baa4de42532e94fc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d9e1e39b-7750-4abb-be8b-4ce893ff7bd8 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4bc2e7c-c697-4786-a80f-ea0bb15e722d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d9e1e39b-7750-4abb-be8b-4ce893ff7bd8 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4bc2e7c-c697-4786-a80f-ea0bb15e722d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d9e1e39b-7750-4abb-be8b-4ce893ff7bd8 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebe9565e-e365-441b-be8c-af27dc54889f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d9e1e39b-7750-4abb-be8b-4ce893ff7bd8 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebe9565e-e365-441b-be8c-af27dc54889f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41d88077-d8c3-4859-9def-f73abe7e8999', 'volume_name': 'volume-41d88077-d8c3-4859-9def-f73abe7e8999', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d9e1e39b-7750-4abb-be8b-4ce893ff7bd8 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (372039c6-2a82-4d89-b61d-afa5763b3797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d9e1e39b-7750-4abb-be8b-4ce893ff7bd8 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (372039c6-2a82-4d89-b61d-afa5763b3797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d9e1e39b-7750-4abb-be8b-4ce893ff7bd8 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (634e853f-804c-4cc0-a16c-01a214d45064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:41 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-d9e1e39b-7750-4abb-be8b-4ce893ff7bd8 tempest-CreateVolumesFromImageTest-1435429064 None] Volume 41d88077-d8c3-4859-9def-f73abe7e8999: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41d88077-d8c3-4859-9def-f73abe7e8999', 'volume_size': 1} Sep 03 14:35:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d9e1e39b-7750-4abb-be8b-4ce893ff7bd8 tempest-CreateVolumesFromImageTest-1435429064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:41 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5645348b-3af5-4730-8cd3-e683f2490ba6 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b56d3bb1-a5b2-49c3-b653-b38bd464a538" returned: 0 in 0.318s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-5645348b-3af5-4730-8cd3-e683f2490ba6 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:35:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-5645348b-3af5-4730-8cd3-e683f2490ba6 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:35:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-0a8a8778-63c0-45d7-a248-66ae8f5cf86b tempest-VolumeDependencyTests-868207421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.916s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-0a8a8778-63c0-45d7-a248-66ae8f5cf86b tempest-VolumeDependencyTests-868207421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:35:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-186655037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ca6a53f-4580-4fb2-ad42-85386e9b1dff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98d1833b12e740fb82e9257ec92fe5d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:35:41Z,use_quota=True,user_id='b675a50c2cd3431ebc9b98882b788856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:35:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-0a8a8778-63c0-45d7-a248-66ae8f5cf86b tempest-VolumeDependencyTests-868207421 None] Creating volume 8ca6a53f-4580-4fb2-ad42-85386e9b1dff {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:35:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-0a8a8778-63c0-45d7-a248-66ae8f5cf86b tempest-VolumeDependencyTests-868207421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-0a8a8778-63c0-45d7-a248-66ae8f5cf86b tempest-VolumeDependencyTests-868207421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-0a8a8778-63c0-45d7-a248-66ae8f5cf86b tempest-VolumeDependencyTests-868207421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:35:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-0a8a8778-63c0-45d7-a248-66ae8f5cf86b tempest-VolumeDependencyTests-868207421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:35:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-0a8a8778-63c0-45d7-a248-66ae8f5cf86b tempest-VolumeDependencyTests-868207421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:35:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-0a8a8778-63c0-45d7-a248-66ae8f5cf86b tempest-VolumeDependencyTests-868207421 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:35:41 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-0a8a8778-63c0-45d7-a248-66ae8f5cf86b tempest-VolumeDependencyTests-868207421 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:35:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0a8a8778-63c0-45d7-a248-66ae8f5cf86b tempest-VolumeDependencyTests-868207421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5645348b-3af5-4730-8cd3-e683f2490ba6 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e81c91b-dab0-47a5-998a-af0aa950d31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b56d3bb1-a5b2-49c3-b653-b38bd464a538', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5645348b-3af5-4730-8cd3-e683f2490ba6 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc6afbbf-b4bc-4c69-8921-c3bdc9c769e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:41 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff 1073741824 Sep 03 14:35:41 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:41 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-5645348b-3af5-4730-8cd3-e683f2490ba6 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Volume volume-b56d3bb1-a5b2-49c3-b653-b38bd464a538 (b56d3bb1-a5b2-49c3-b653-b38bd464a538): created successfully Sep 03 14:35:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5645348b-3af5-4730-8cd3-e683f2490ba6 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc6afbbf-b4bc-4c69-8921-c3bdc9c769e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5645348b-3af5-4730-8cd3-e683f2490ba6 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Flow 'volume_create_manager' (a9edadc9-191a-464a-a1e2-5ae8a34fcba1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:35:42 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-5645348b-3af5-4730-8cd3-e683f2490ba6 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Created volume successfully. Sep 03 14:35:42 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-aca68a18-c536-4fcd-a540-893e9aaad101 tempest-CreateVolumesFromImageTest-1435429064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:35:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-aca68a18-c536-4fcd-a540-893e9aaad101 tempest-CreateVolumesFromImageTest-1435429064 None] Flow 'volume_create_manager' (aa275198-8725-4b91-a850-150f75788a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:35:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-aca68a18-c536-4fcd-a540-893e9aaad101 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (764f900f-53dd-4b00-bd0d-7221fa6061dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-aca68a18-c536-4fcd-a540-893e9aaad101 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (764f900f-53dd-4b00-bd0d-7221fa6061dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1983466581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2acababe-9076-48ab-a81a-ae90e9a35b99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71500195ab8c417eb106ac0b2b2543ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:35:42Z,use_quota=True,user_id='a98e7ed993b8454baa4de42532e94fc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-aca68a18-c536-4fcd-a540-893e9aaad101 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7b444fd-b470-4f72-89e5-2da51dfa96d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-aca68a18-c536-4fcd-a540-893e9aaad101 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7b444fd-b470-4f72-89e5-2da51dfa96d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-aca68a18-c536-4fcd-a540-893e9aaad101 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bad2d24d-ca6a-4af3-ab81-0f8edcdd4c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-aca68a18-c536-4fcd-a540-893e9aaad101 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bad2d24d-ca6a-4af3-ab81-0f8edcdd4c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2acababe-9076-48ab-a81a-ae90e9a35b99', 'volume_name': 'volume-2acababe-9076-48ab-a81a-ae90e9a35b99', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-aca68a18-c536-4fcd-a540-893e9aaad101 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aa40736-3ac8-4469-b6a8-772431af9843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-aca68a18-c536-4fcd-a540-893e9aaad101 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aa40736-3ac8-4469-b6a8-772431af9843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-aca68a18-c536-4fcd-a540-893e9aaad101 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fbf775e-f5f9-43f8-9c7f-9a31e339a9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:42 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-aca68a18-c536-4fcd-a540-893e9aaad101 tempest-CreateVolumesFromImageTest-1435429064 None] Volume 2acababe-9076-48ab-a81a-ae90e9a35b99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2acababe-9076-48ab-a81a-ae90e9a35b99', 'volume_size': 1} Sep 03 14:35:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-aca68a18-c536-4fcd-a540-893e9aaad101 tempest-CreateVolumesFromImageTest-1435429064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:42 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:42 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-113c762e-525d-47dd-be3a-89ccc72c3957 tempest-CreateVolumesFromImageTest-1435429064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:35:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-113c762e-525d-47dd-be3a-89ccc72c3957 tempest-CreateVolumesFromImageTest-1435429064 None] Flow 'volume_create_manager' (485168f3-c290-40d6-acda-3ac10e8bb24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:35:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-113c762e-525d-47dd-be3a-89ccc72c3957 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38968587-4cab-47c5-87c2-7bb62be304f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0a8a8778-63c0-45d7-a248-66ae8f5cf86b tempest-VolumeDependencyTests-868207421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff 1073741824" returned: 0 in 0.697s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-113c762e-525d-47dd-be3a-89ccc72c3957 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38968587-4cab-47c5-87c2-7bb62be304f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-337573763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cf07fec-5611-4c7e-a0a9-9b9bc5108988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71500195ab8c417eb106ac0b2b2543ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:35:42Z,use_quota=True,user_id='a98e7ed993b8454baa4de42532e94fc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-113c762e-525d-47dd-be3a-89ccc72c3957 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8a46581-a27e-40a9-8ce9-a7c4f78eb337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-113c762e-525d-47dd-be3a-89ccc72c3957 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8a46581-a27e-40a9-8ce9-a7c4f78eb337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-113c762e-525d-47dd-be3a-89ccc72c3957 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4680ca17-39ea-4591-aa81-c46ec375403c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-113c762e-525d-47dd-be3a-89ccc72c3957 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4680ca17-39ea-4591-aa81-c46ec375403c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cf07fec-5611-4c7e-a0a9-9b9bc5108988', 'volume_name': 'volume-9cf07fec-5611-4c7e-a0a9-9b9bc5108988', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-113c762e-525d-47dd-be3a-89ccc72c3957 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f40cc9a3-e23f-49c8-8ce9-a4fa89b84a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-113c762e-525d-47dd-be3a-89ccc72c3957 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f40cc9a3-e23f-49c8-8ce9-a4fa89b84a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-113c762e-525d-47dd-be3a-89ccc72c3957 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6433d0ba-2d8a-4569-8515-900065bf8784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:42 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-113c762e-525d-47dd-be3a-89ccc72c3957 tempest-CreateVolumesFromImageTest-1435429064 None] Volume 9cf07fec-5611-4c7e-a0a9-9b9bc5108988: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cf07fec-5611-4c7e-a0a9-9b9bc5108988', 'volume_size': 1} Sep 03 14:35:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-113c762e-525d-47dd-be3a-89ccc72c3957 tempest-CreateVolumesFromImageTest-1435429064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0a8a8778-63c0-45d7-a248-66ae8f5cf86b tempest-VolumeDependencyTests-868207421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:42 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff Sep 03 14:35:42 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:43 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0a8a8778-63c0-45d7-a248-66ae8f5cf86b tempest-VolumeDependencyTests-868207421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff" returned: 0 in 0.335s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-0a8a8778-63c0-45d7-a248-66ae8f5cf86b tempest-VolumeDependencyTests-868207421 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-0a8a8778-63c0-45d7-a248-66ae8f5cf86b tempest-VolumeDependencyTests-868207421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c9515bb6-0499-48a0-a22f-7bf0e92ddb07 tempest-CreateVolumesFromImageTest-1435429064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.643s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-c9515bb6-0499-48a0-a22f-7bf0e92ddb07 tempest-CreateVolumesFromImageTest-1435429064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1040622791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5a20647-0ff1-4fea-a697-fc51e1ccd4d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71500195ab8c417eb106ac0b2b2543ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:35:41Z,use_quota=True,user_id='a98e7ed993b8454baa4de42532e94fc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-c9515bb6-0499-48a0-a22f-7bf0e92ddb07 tempest-CreateVolumesFromImageTest-1435429064 None] Creating volume c5a20647-0ff1-4fea-a697-fc51e1ccd4d3 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c9515bb6-0499-48a0-a22f-7bf0e92ddb07 tempest-CreateVolumesFromImageTest-1435429064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c9515bb6-0499-48a0-a22f-7bf0e92ddb07 tempest-CreateVolumesFromImageTest-1435429064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-c9515bb6-0499-48a0-a22f-7bf0e92ddb07 tempest-CreateVolumesFromImageTest-1435429064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-c9515bb6-0499-48a0-a22f-7bf0e92ddb07 tempest-CreateVolumesFromImageTest-1435429064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c9515bb6-0499-48a0-a22f-7bf0e92ddb07 tempest-CreateVolumesFromImageTest-1435429064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-c9515bb6-0499-48a0-a22f-7bf0e92ddb07 tempest-CreateVolumesFromImageTest-1435429064 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:35:43 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-c9515bb6-0499-48a0-a22f-7bf0e92ddb07 tempest-CreateVolumesFromImageTest-1435429064 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c9515bb6-0499-48a0-a22f-7bf0e92ddb07 tempest-CreateVolumesFromImageTest-1435429064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c5a20647-0ff1-4fea-a697-fc51e1ccd4d3 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1360d30-1937-4254-a4c0-740fb05f56bc tempest-CreateVolumesFromImageTest-1435429064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:35:43 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c5a20647-0ff1-4fea-a697-fc51e1ccd4d3 1073741824 Sep 03 14:35:43 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d1360d30-1937-4254-a4c0-740fb05f56bc tempest-CreateVolumesFromImageTest-1435429064 None] Flow 'volume_create_manager' (0c8e5a55-c653-4dc0-983a-94163a1a2a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d1360d30-1937-4254-a4c0-740fb05f56bc tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (802ded5a-9abf-4ef9-a837-be558c7f54f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0a8a8778-63c0-45d7-a248-66ae8f5cf86b tempest-VolumeDependencyTests-868207421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a1e3798-e34e-4918-9957-5f7c05414f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0a8a8778-63c0-45d7-a248-66ae8f5cf86b tempest-VolumeDependencyTests-868207421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11dfc3b2-62ca-4f36-9491-ef810f1283d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d1360d30-1937-4254-a4c0-740fb05f56bc tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (802ded5a-9abf-4ef9-a837-be558c7f54f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-749839487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=808e7bbf-fbfe-4136-8939-3510a397b345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71500195ab8c417eb106ac0b2b2543ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:35:43Z,use_quota=True,user_id='a98e7ed993b8454baa4de42532e94fc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d1360d30-1937-4254-a4c0-740fb05f56bc tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41accfc6-f36a-4f38-b1c9-5eaf189cb744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d1360d30-1937-4254-a4c0-740fb05f56bc tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41accfc6-f36a-4f38-b1c9-5eaf189cb744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d1360d30-1937-4254-a4c0-740fb05f56bc tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f83cb8a0-2a0c-4b46-8e7e-e4a9795c27c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d1360d30-1937-4254-a4c0-740fb05f56bc tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f83cb8a0-2a0c-4b46-8e7e-e4a9795c27c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '808e7bbf-fbfe-4136-8939-3510a397b345', 'volume_name': 'volume-808e7bbf-fbfe-4136-8939-3510a397b345', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d1360d30-1937-4254-a4c0-740fb05f56bc tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (780ab587-927b-4de6-9ad6-9b697d3ed38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d1360d30-1937-4254-a4c0-740fb05f56bc tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (780ab587-927b-4de6-9ad6-9b697d3ed38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d1360d30-1937-4254-a4c0-740fb05f56bc tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bb64bfa-4477-479e-a5a9-3b05f0215311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:43 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-d1360d30-1937-4254-a4c0-740fb05f56bc tempest-CreateVolumesFromImageTest-1435429064 None] Volume 808e7bbf-fbfe-4136-8939-3510a397b345: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-808e7bbf-fbfe-4136-8939-3510a397b345', 'volume_size': 1} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d1360d30-1937-4254-a4c0-740fb05f56bc tempest-CreateVolumesFromImageTest-1435429064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:43 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-0a8a8778-63c0-45d7-a248-66ae8f5cf86b tempest-VolumeDependencyTests-868207421 None] Volume volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff (8ca6a53f-4580-4fb2-ad42-85386e9b1dff): created successfully Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0a8a8778-63c0-45d7-a248-66ae8f5cf86b tempest-VolumeDependencyTests-868207421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11dfc3b2-62ca-4f36-9491-ef810f1283d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0a8a8778-63c0-45d7-a248-66ae8f5cf86b tempest-VolumeDependencyTests-868207421 None] Flow 'volume_create_manager' (9664316c-ff24-4867-a5e4-12fb221398e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:35:43 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-0a8a8778-63c0-45d7-a248-66ae8f5cf86b tempest-VolumeDependencyTests-868207421 None] Created volume successfully. Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-83aff773-be60-4a2f-8279-e7648008afa2 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-83aff773-be60-4a2f-8279-e7648008afa2 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Flow 'volume_create_manager' (7e26f29f-219c-4bef-8ba7-6d83dff08501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-83aff773-be60-4a2f-8279-e7648008afa2 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb259e1a-2458-47d8-94a2-6c1fa7ce8d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-83aff773-be60-4a2f-8279-e7648008afa2 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb259e1a-2458-47d8-94a2-6c1fa7ce8d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1973371271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce1c303-b012-4350-b4fa-6ce8e179c2c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b45c494de63b41b5a5f043d222605cf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:35:43Z,use_quota=True,user_id='cfe18c2eff8c4880bd9241eaead5957a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-83aff773-be60-4a2f-8279-e7648008afa2 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9c4bb4d-8ca8-4bd2-95b0-0d88682cf95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-83aff773-be60-4a2f-8279-e7648008afa2 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9c4bb4d-8ca8-4bd2-95b0-0d88682cf95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-83aff773-be60-4a2f-8279-e7648008afa2 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eecb045a-35d0-4762-9d83-9af992bf620c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-83aff773-be60-4a2f-8279-e7648008afa2 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eecb045a-35d0-4762-9d83-9af992bf620c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ce1c303-b012-4350-b4fa-6ce8e179c2c0', 'volume_name': 'volume-8ce1c303-b012-4350-b4fa-6ce8e179c2c0', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-83aff773-be60-4a2f-8279-e7648008afa2 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc469ec6-d321-4be8-b115-82f9a2b16262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-83aff773-be60-4a2f-8279-e7648008afa2 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc469ec6-d321-4be8-b115-82f9a2b16262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-83aff773-be60-4a2f-8279-e7648008afa2 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bfd8581-db53-4966-bdf8-3cd7be0d2877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:43 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-83aff773-be60-4a2f-8279-e7648008afa2 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Volume 8ce1c303-b012-4350-b4fa-6ce8e179c2c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ce1c303-b012-4350-b4fa-6ce8e179c2c0', 'volume_size': 1} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-83aff773-be60-4a2f-8279-e7648008afa2 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:43 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c9515bb6-0499-48a0-a22f-7bf0e92ddb07 tempest-CreateVolumesFromImageTest-1435429064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c5a20647-0ff1-4fea-a697-fc51e1ccd4d3 1073741824" returned: 0 in 0.627s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed246283-af5c-4792-ace2-347f59ae7f3b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ed246283-af5c-4792-ace2-347f59ae7f3b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Flow 'volume_create_manager' (cf41ae5e-359e-4876-be50-3ef7ddac6d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ed246283-af5c-4792-ace2-347f59ae7f3b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd0fc55b-ccb3-4a32-9f4e-f35f34b940ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ed246283-af5c-4792-ace2-347f59ae7f3b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd0fc55b-ccb3-4a32-9f4e-f35f34b940ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1344102807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=840c6cd1-f80f-4145-8056-f29d5eca33f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b45c494de63b41b5a5f043d222605cf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:35:44Z,use_quota=True,user_id='cfe18c2eff8c4880bd9241eaead5957a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ed246283-af5c-4792-ace2-347f59ae7f3b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (412adb07-b939-444c-a435-eae16d373e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ed246283-af5c-4792-ace2-347f59ae7f3b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (412adb07-b939-444c-a435-eae16d373e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ed246283-af5c-4792-ace2-347f59ae7f3b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47b76aea-2cf1-4775-82bc-d43610f57308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ed246283-af5c-4792-ace2-347f59ae7f3b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47b76aea-2cf1-4775-82bc-d43610f57308) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '840c6cd1-f80f-4145-8056-f29d5eca33f5', 'volume_name': 'volume-840c6cd1-f80f-4145-8056-f29d5eca33f5', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ed246283-af5c-4792-ace2-347f59ae7f3b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88d5e703-3612-4ea4-b204-494f076037d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ed246283-af5c-4792-ace2-347f59ae7f3b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88d5e703-3612-4ea4-b204-494f076037d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ed246283-af5c-4792-ace2-347f59ae7f3b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fd2b441-3650-4b11-9cc0-33a902d1b3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:43 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-ed246283-af5c-4792-ace2-347f59ae7f3b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Volume 840c6cd1-f80f-4145-8056-f29d5eca33f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-840c6cd1-f80f-4145-8056-f29d5eca33f5', 'volume_size': 1} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ed246283-af5c-4792-ace2-347f59ae7f3b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c9515bb6-0499-48a0-a22f-7bf0e92ddb07 tempest-CreateVolumesFromImageTest-1435429064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c5a20647-0ff1-4fea-a697-fc51e1ccd4d3 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:43 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c5a20647-0ff1-4fea-a697-fc51e1ccd4d3 Sep 03 14:35:43 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:44 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c9515bb6-0499-48a0-a22f-7bf0e92ddb07 tempest-CreateVolumesFromImageTest-1435429064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c5a20647-0ff1-4fea-a697-fc51e1ccd4d3" returned: 0 in 0.343s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:44 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-c9515bb6-0499-48a0-a22f-7bf0e92ddb07 tempest-CreateVolumesFromImageTest-1435429064 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:35:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c9515bb6-0499-48a0-a22f-7bf0e92ddb07 tempest-CreateVolumesFromImageTest-1435429064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:35:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d9e1e39b-7750-4abb-be8b-4ce893ff7bd8 tempest-CreateVolumesFromImageTest-1435429064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.353s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:44 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d9e1e39b-7750-4abb-be8b-4ce893ff7bd8 tempest-CreateVolumesFromImageTest-1435429064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-311999079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41d88077-d8c3-4859-9def-f73abe7e8999,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71500195ab8c417eb106ac0b2b2543ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:35:42Z,use_quota=True,user_id='a98e7ed993b8454baa4de42532e94fc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:35:44 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-d9e1e39b-7750-4abb-be8b-4ce893ff7bd8 tempest-CreateVolumesFromImageTest-1435429064 None] Creating volume 41d88077-d8c3-4859-9def-f73abe7e8999 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:35:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d9e1e39b-7750-4abb-be8b-4ce893ff7bd8 tempest-CreateVolumesFromImageTest-1435429064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d9e1e39b-7750-4abb-be8b-4ce893ff7bd8 tempest-CreateVolumesFromImageTest-1435429064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:44 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d9e1e39b-7750-4abb-be8b-4ce893ff7bd8 tempest-CreateVolumesFromImageTest-1435429064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:35:44 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d9e1e39b-7750-4abb-be8b-4ce893ff7bd8 tempest-CreateVolumesFromImageTest-1435429064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:35:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d9e1e39b-7750-4abb-be8b-4ce893ff7bd8 tempest-CreateVolumesFromImageTest-1435429064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:35:44 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d9e1e39b-7750-4abb-be8b-4ce893ff7bd8 tempest-CreateVolumesFromImageTest-1435429064 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:35:44 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-d9e1e39b-7750-4abb-be8b-4ce893ff7bd8 tempest-CreateVolumesFromImageTest-1435429064 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:35:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d9e1e39b-7750-4abb-be8b-4ce893ff7bd8 tempest-CreateVolumesFromImageTest-1435429064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-41d88077-d8c3-4859-9def-f73abe7e8999 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c9515bb6-0499-48a0-a22f-7bf0e92ddb07 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (370dd73b-b6fa-40a2-9f7d-3dd1a9473ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5a20647-0ff1-4fea-a697-fc51e1ccd4d3', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c9515bb6-0499-48a0-a22f-7bf0e92ddb07 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28edc634-2ded-4fd1-8490-a2542e74689b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:44 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-41d88077-d8c3-4859-9def-f73abe7e8999 1073741824 Sep 03 14:35:44 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:44 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-c9515bb6-0499-48a0-a22f-7bf0e92ddb07 tempest-CreateVolumesFromImageTest-1435429064 None] Volume volume-c5a20647-0ff1-4fea-a697-fc51e1ccd4d3 (c5a20647-0ff1-4fea-a697-fc51e1ccd4d3): created successfully Sep 03 14:35:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c9515bb6-0499-48a0-a22f-7bf0e92ddb07 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28edc634-2ded-4fd1-8490-a2542e74689b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c9515bb6-0499-48a0-a22f-7bf0e92ddb07 tempest-CreateVolumesFromImageTest-1435429064 None] Flow 'volume_create_manager' (b922254e-9245-4066-875b-4462a76e2ed3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:35:44 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-c9515bb6-0499-48a0-a22f-7bf0e92ddb07 tempest-CreateVolumesFromImageTest-1435429064 None] Created volume successfully. Sep 03 14:35:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1991f7fd-bb92-4688-8119-fdef0cc8f77c tempest-VolumeDependencyTests-868207421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:44 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9f000e7-b04e-440b-b670-bd56df129b16 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:35:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a9f000e7-b04e-440b-b670-bd56df129b16 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Flow 'volume_create_manager' (608689df-32e1-48ab-b288-f2ea2e87957e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:35:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a9f000e7-b04e-440b-b670-bd56df129b16 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16748971-3842-4d9c-b106-e7577d3da3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a9f000e7-b04e-440b-b670-bd56df129b16 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16748971-3842-4d9c-b106-e7577d3da3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:35:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-367040240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=513a1c47-ce64-4adb-9a81-71ca30bd034a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b45c494de63b41b5a5f043d222605cf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:35:44Z,use_quota=True,user_id='cfe18c2eff8c4880bd9241eaead5957a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a9f000e7-b04e-440b-b670-bd56df129b16 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (575b8dc1-53ae-4605-8b1c-c95101cf680e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a9f000e7-b04e-440b-b670-bd56df129b16 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (575b8dc1-53ae-4605-8b1c-c95101cf680e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a9f000e7-b04e-440b-b670-bd56df129b16 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (963ab6aa-b435-40eb-b07d-bfcb58120da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a9f000e7-b04e-440b-b670-bd56df129b16 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (963ab6aa-b435-40eb-b07d-bfcb58120da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '513a1c47-ce64-4adb-9a81-71ca30bd034a', 'volume_name': 'volume-513a1c47-ce64-4adb-9a81-71ca30bd034a', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a9f000e7-b04e-440b-b670-bd56df129b16 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91dc226d-fdb3-4775-8f1c-3d14b0154a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a9f000e7-b04e-440b-b670-bd56df129b16 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91dc226d-fdb3-4775-8f1c-3d14b0154a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a9f000e7-b04e-440b-b670-bd56df129b16 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c23ef0fc-81f0-411d-b433-5861c3c4dbfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:44 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-a9f000e7-b04e-440b-b670-bd56df129b16 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Volume 513a1c47-ce64-4adb-9a81-71ca30bd034a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-513a1c47-ce64-4adb-9a81-71ca30bd034a', 'volume_size': 1} Sep 03 14:35:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a9f000e7-b04e-440b-b670-bd56df129b16 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:44 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaf18886-b3d0-4882-ab7c-96c4db9d515f tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:35:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-eaf18886-b3d0-4882-ab7c-96c4db9d515f tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Flow 'volume_create_manager' (cf3e4c76-0f02-49af-b174-fe194386b059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:35:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-eaf18886-b3d0-4882-ab7c-96c4db9d515f tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd4f1ba7-3d69-4ced-9f6c-0fc1afc6a55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-eaf18886-b3d0-4882-ab7c-96c4db9d515f tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd4f1ba7-3d69-4ced-9f6c-0fc1afc6a55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:35:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-908642973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b933df99-1d42-4b4d-8936-21d0c278a325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b45c494de63b41b5a5f043d222605cf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:35:45Z,use_quota=True,user_id='cfe18c2eff8c4880bd9241eaead5957a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-eaf18886-b3d0-4882-ab7c-96c4db9d515f tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcbcffb1-5828-4c89-9be5-0ba714168af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-eaf18886-b3d0-4882-ab7c-96c4db9d515f tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcbcffb1-5828-4c89-9be5-0ba714168af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-eaf18886-b3d0-4882-ab7c-96c4db9d515f tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75429c3a-636a-46e5-a38c-7ee7964fc737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-eaf18886-b3d0-4882-ab7c-96c4db9d515f tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75429c3a-636a-46e5-a38c-7ee7964fc737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b933df99-1d42-4b4d-8936-21d0c278a325', 'volume_name': 'volume-b933df99-1d42-4b4d-8936-21d0c278a325', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-eaf18886-b3d0-4882-ab7c-96c4db9d515f tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98e0a4f9-b9d3-4377-9cf7-221b0580f17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-eaf18886-b3d0-4882-ab7c-96c4db9d515f tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98e0a4f9-b9d3-4377-9cf7-221b0580f17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-eaf18886-b3d0-4882-ab7c-96c4db9d515f tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b63f0846-27e9-4183-8e63-d59eb1a65ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:44 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-eaf18886-b3d0-4882-ab7c-96c4db9d515f tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Volume b933df99-1d42-4b4d-8936-21d0c278a325: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b933df99-1d42-4b4d-8936-21d0c278a325', 'volume_size': 1} Sep 03 14:35:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-eaf18886-b3d0-4882-ab7c-96c4db9d515f tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:44 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d9e1e39b-7750-4abb-be8b-4ce893ff7bd8 tempest-CreateVolumesFromImageTest-1435429064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-41d88077-d8c3-4859-9def-f73abe7e8999 1073741824" returned: 0 in 0.625s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d9e1e39b-7750-4abb-be8b-4ce893ff7bd8 tempest-CreateVolumesFromImageTest-1435429064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-41d88077-d8c3-4859-9def-f73abe7e8999 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:44 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-41d88077-d8c3-4859-9def-f73abe7e8999 Sep 03 14:35:44 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-d36ff52d-2c01-41c7-be72-e45dfd54f748 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d36ff52d-2c01-41c7-be72-e45dfd54f748 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Flow 'volume_create_manager' (c083fb93-b4e6-4068-ad73-84b46ee4341b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d36ff52d-2c01-41c7-be72-e45dfd54f748 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c9c175f-5bef-44d3-b9f9-68217a54038f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d36ff52d-2c01-41c7-be72-e45dfd54f748 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c9c175f-5bef-44d3-b9f9-68217a54038f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-766472436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42ed77cd-70e2-4dff-9680-3e6699e795bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b45c494de63b41b5a5f043d222605cf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:35:45Z,use_quota=True,user_id='cfe18c2eff8c4880bd9241eaead5957a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d36ff52d-2c01-41c7-be72-e45dfd54f748 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (845e0967-1011-425a-adf1-728be08c2a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d36ff52d-2c01-41c7-be72-e45dfd54f748 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (845e0967-1011-425a-adf1-728be08c2a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d36ff52d-2c01-41c7-be72-e45dfd54f748 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f26a6ede-a1ac-41fd-b31f-0611d5872c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d36ff52d-2c01-41c7-be72-e45dfd54f748 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f26a6ede-a1ac-41fd-b31f-0611d5872c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42ed77cd-70e2-4dff-9680-3e6699e795bc', 'volume_name': 'volume-42ed77cd-70e2-4dff-9680-3e6699e795bc', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d36ff52d-2c01-41c7-be72-e45dfd54f748 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ee66c69-2c77-459a-a332-4c85b20db35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d36ff52d-2c01-41c7-be72-e45dfd54f748 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ee66c69-2c77-459a-a332-4c85b20db35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d36ff52d-2c01-41c7-be72-e45dfd54f748 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86a1a197-3374-4147-943b-c2d0cd8b27de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:45 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:45 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-d36ff52d-2c01-41c7-be72-e45dfd54f748 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Volume 42ed77cd-70e2-4dff-9680-3e6699e795bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42ed77cd-70e2-4dff-9680-3e6699e795bc', 'volume_size': 1} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d36ff52d-2c01-41c7-be72-e45dfd54f748 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d9e1e39b-7750-4abb-be8b-4ce893ff7bd8 tempest-CreateVolumesFromImageTest-1435429064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-41d88077-d8c3-4859-9def-f73abe7e8999" returned: 0 in 0.300s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d9e1e39b-7750-4abb-be8b-4ce893ff7bd8 tempest-CreateVolumesFromImageTest-1435429064 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d9e1e39b-7750-4abb-be8b-4ce893ff7bd8 tempest-CreateVolumesFromImageTest-1435429064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-aca68a18-c536-4fcd-a540-893e9aaad101 tempest-CreateVolumesFromImageTest-1435429064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.872s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-aca68a18-c536-4fcd-a540-893e9aaad101 tempest-CreateVolumesFromImageTest-1435429064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1983466581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2acababe-9076-48ab-a81a-ae90e9a35b99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71500195ab8c417eb106ac0b2b2543ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:35:42Z,use_quota=True,user_id='a98e7ed993b8454baa4de42532e94fc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-aca68a18-c536-4fcd-a540-893e9aaad101 tempest-CreateVolumesFromImageTest-1435429064 None] Creating volume 2acababe-9076-48ab-a81a-ae90e9a35b99 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-aca68a18-c536-4fcd-a540-893e9aaad101 tempest-CreateVolumesFromImageTest-1435429064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-aca68a18-c536-4fcd-a540-893e9aaad101 tempest-CreateVolumesFromImageTest-1435429064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-aca68a18-c536-4fcd-a540-893e9aaad101 tempest-CreateVolumesFromImageTest-1435429064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-aca68a18-c536-4fcd-a540-893e9aaad101 tempest-CreateVolumesFromImageTest-1435429064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-aca68a18-c536-4fcd-a540-893e9aaad101 tempest-CreateVolumesFromImageTest-1435429064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-aca68a18-c536-4fcd-a540-893e9aaad101 tempest-CreateVolumesFromImageTest-1435429064 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:35:45 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-aca68a18-c536-4fcd-a540-893e9aaad101 tempest-CreateVolumesFromImageTest-1435429064 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-aca68a18-c536-4fcd-a540-893e9aaad101 tempest-CreateVolumesFromImageTest-1435429064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2acababe-9076-48ab-a81a-ae90e9a35b99 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d9e1e39b-7750-4abb-be8b-4ce893ff7bd8 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (634e853f-804c-4cc0-a16c-01a214d45064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41d88077-d8c3-4859-9def-f73abe7e8999', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:45 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2acababe-9076-48ab-a81a-ae90e9a35b99 1073741824 Sep 03 14:35:45 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d9e1e39b-7750-4abb-be8b-4ce893ff7bd8 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a539e24-4af9-4a4f-afed-faa0526873f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:45 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-d9e1e39b-7750-4abb-be8b-4ce893ff7bd8 tempest-CreateVolumesFromImageTest-1435429064 None] Volume volume-41d88077-d8c3-4859-9def-f73abe7e8999 (41d88077-d8c3-4859-9def-f73abe7e8999): created successfully Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d9e1e39b-7750-4abb-be8b-4ce893ff7bd8 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a539e24-4af9-4a4f-afed-faa0526873f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d9e1e39b-7750-4abb-be8b-4ce893ff7bd8 tempest-CreateVolumesFromImageTest-1435429064 None] Flow 'volume_create_manager' (453904f9-209c-4616-a635-31198f687f1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:35:45 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-d9e1e39b-7750-4abb-be8b-4ce893ff7bd8 tempest-CreateVolumesFromImageTest-1435429064 None] Created volume successfully. Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Flow 'volume_create_manager' (885813a8-1206-4f8e-b7a1-07ec91957423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfc12d1a-3adb-4222-b249-cd189ce79b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfc12d1a-3adb-4222-b249-cd189ce79b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc966e44-944f-491e-8a58-908ff073b597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='702c4f76dc28489cbcbd19d650aea46e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:35:45Z,use_quota=True,user_id='2782a13d8ec846c2ab70f63fe99096bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ffe8229-3438-4af9-98db-dd76e680882f),volume_type_id=2ffe8229-3438-4af9-98db-dd76e680882f)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (539f4569-b629-4367-8c25-db5b9e228bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (539f4569-b629-4367-8c25-db5b9e228bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ca41905-6ad5-416e-9d7a-9adfefda570b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG cinder.image.glance [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Creating Keystone auth plugin from conf {{(pid=87007) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ca41905-6ad5-416e-9d7a-9adfefda570b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dc966e44-944f-491e-8a58-908ff073b597', 'volume_name': 'volume-dc966e44-944f-491e-8a58-908ff073b597', 'volume_size': 1, 'image_id': '0b84149c-b57a-4591-a645-882646d14301', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0b84149c-b57a-4591-a645-882646d14301', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f6f9aca2e9b48bc5e5cfc6349c40b045', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '702c4f76dc28489cbcbd19d650aea46e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'aecf390b5f3adc6638c988aa34c0ff0a86901e9fda21f557a4a93fb18fad071e7c177785a869cc357a00e7438e38ab4e603667c71a5c2d777f7b47b1fa98b075', 'id': '0b84149c-b57a-4591-a645-882646d14301', 'created_at': datetime.datetime(2026, 9, 3, 12, 35, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 12, 35, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0b84149c-b57a-4591-a645-882646d14301/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27b8928d-a594-463a-85e9-fdd28612b8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27b8928d-a594-463a-85e9-fdd28612b8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f9e2f0c-7b87-4696-80d7-a17a2edff465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:45 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Volume dc966e44-944f-491e-8a58-908ff073b597: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dc966e44-944f-491e-8a58-908ff073b597', 'volume_size': 1, 'image_id': '0b84149c-b57a-4591-a645-882646d14301', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0b84149c-b57a-4591-a645-882646d14301', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f6f9aca2e9b48bc5e5cfc6349c40b045', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '702c4f76dc28489cbcbd19d650aea46e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'aecf390b5f3adc6638c988aa34c0ff0a86901e9fda21f557a4a93fb18fad071e7c177785a869cc357a00e7438e38ab4e603667c71a5c2d777f7b47b1fa98b075', 'id': '0b84149c-b57a-4591-a645-882646d14301', 'created_at': datetime.datetime(2026, 9, 3, 12, 35, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 12, 35, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0b84149c-b57a-4591-a645-882646d14301/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Trying to clone dc966e44-944f-491e-8a58-908ff073b597 from image 0b84149c-b57a-4591-a645-882646d14301 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0b84149c-b57a-4591-a645-882646d14301', 'metadata': {}}]). {{(pid=87007) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 14:35:45 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-aca68a18-c536-4fcd-a540-893e9aaad101 tempest-CreateVolumesFromImageTest-1435429064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2acababe-9076-48ab-a81a-ae90e9a35b99 1073741824" returned: 0 in 0.502s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-aca68a18-c536-4fcd-a540-893e9aaad101 tempest-CreateVolumesFromImageTest-1435429064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2acababe-9076-48ab-a81a-ae90e9a35b99 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:45 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2acababe-9076-48ab-a81a-ae90e9a35b99 Sep 03 14:35:45 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0b84149c-b57a-4591-a645-882646d14301_7z3eycvddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87007) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 14:35:45 devstack cinder-volume[87007]: INFO cinder.image.image_utils [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Image download 0.00 MB at 0.00 MB/s Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8344412b-bb70-443f-be7d-5a7c86a459ee]: (4, 'raw') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0b84149c-b57a-4591-a645-882646d14301_7z3eycvddevstack@QuobyteHD {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:45 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0b84149c-b57a-4591-a645-882646d14301_7z3eycvddevstack@QuobyteHD Sep 03 14:35:45 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:45 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-aca68a18-c536-4fcd-a540-893e9aaad101 tempest-CreateVolumesFromImageTest-1435429064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2acababe-9076-48ab-a81a-ae90e9a35b99" returned: 0 in 0.249s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-aca68a18-c536-4fcd-a540-893e9aaad101 tempest-CreateVolumesFromImageTest-1435429064 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-aca68a18-c536-4fcd-a540-893e9aaad101 tempest-CreateVolumesFromImageTest-1435429064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-113c762e-525d-47dd-be3a-89ccc72c3957 tempest-CreateVolumesFromImageTest-1435429064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.278s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-113c762e-525d-47dd-be3a-89ccc72c3957 tempest-CreateVolumesFromImageTest-1435429064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-337573763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cf07fec-5611-4c7e-a0a9-9b9bc5108988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71500195ab8c417eb106ac0b2b2543ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:35:42Z,use_quota=True,user_id='a98e7ed993b8454baa4de42532e94fc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-113c762e-525d-47dd-be3a-89ccc72c3957 tempest-CreateVolumesFromImageTest-1435429064 None] Creating volume 9cf07fec-5611-4c7e-a0a9-9b9bc5108988 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-113c762e-525d-47dd-be3a-89ccc72c3957 tempest-CreateVolumesFromImageTest-1435429064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-113c762e-525d-47dd-be3a-89ccc72c3957 tempest-CreateVolumesFromImageTest-1435429064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-113c762e-525d-47dd-be3a-89ccc72c3957 tempest-CreateVolumesFromImageTest-1435429064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-113c762e-525d-47dd-be3a-89ccc72c3957 tempest-CreateVolumesFromImageTest-1435429064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-113c762e-525d-47dd-be3a-89ccc72c3957 tempest-CreateVolumesFromImageTest-1435429064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-113c762e-525d-47dd-be3a-89ccc72c3957 tempest-CreateVolumesFromImageTest-1435429064 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:35:45 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-113c762e-525d-47dd-be3a-89ccc72c3957 tempest-CreateVolumesFromImageTest-1435429064 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-113c762e-525d-47dd-be3a-89ccc72c3957 tempest-CreateVolumesFromImageTest-1435429064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9cf07fec-5611-4c7e-a0a9-9b9bc5108988 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-aca68a18-c536-4fcd-a540-893e9aaad101 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fbf775e-f5f9-43f8-9c7f-9a31e339a9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2acababe-9076-48ab-a81a-ae90e9a35b99', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-aca68a18-c536-4fcd-a540-893e9aaad101 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d105ad0-2db9-4ea2-a531-764914ce3a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:45 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9cf07fec-5611-4c7e-a0a9-9b9bc5108988 1073741824 Sep 03 14:35:45 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:46 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-aca68a18-c536-4fcd-a540-893e9aaad101 tempest-CreateVolumesFromImageTest-1435429064 None] Volume volume-2acababe-9076-48ab-a81a-ae90e9a35b99 (2acababe-9076-48ab-a81a-ae90e9a35b99): created successfully Sep 03 14:35:46 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-aca68a18-c536-4fcd-a540-893e9aaad101 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d105ad0-2db9-4ea2-a531-764914ce3a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:46 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-aca68a18-c536-4fcd-a540-893e9aaad101 tempest-CreateVolumesFromImageTest-1435429064 None] Flow 'volume_create_manager' (aa275198-8725-4b91-a850-150f75788a84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:35:46 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-aca68a18-c536-4fcd-a540-893e9aaad101 tempest-CreateVolumesFromImageTest-1435429064 None] Created volume successfully. Sep 03 14:35:46 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0b84149c-b57a-4591-a645-882646d14301_7z3eycvddevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b84149c-b57a-4591-a645-882646d14301_7z3eycvddevstack@QuobyteHD {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:46 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b84149c-b57a-4591-a645-882646d14301_7z3eycvddevstack@QuobyteHD Sep 03 14:35:46 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:46 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-113c762e-525d-47dd-be3a-89ccc72c3957 tempest-CreateVolumesFromImageTest-1435429064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9cf07fec-5611-4c7e-a0a9-9b9bc5108988 1073741824" returned: 0 in 0.468s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:46 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b84149c-b57a-4591-a645-882646d14301_7z3eycvddevstack@QuobyteHD" returned: 1 in 0.331s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b84149c-b57a-4591-a645-882646d14301_7z3eycvddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 14:35:46 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Temporary image 0b84149c-b57a-4591-a645-882646d14301 is fetched for user 2782a13d8ec846c2ab70f63fe99096bd. {{(pid=87007) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 14:35:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-113c762e-525d-47dd-be3a-89ccc72c3957 tempest-CreateVolumesFromImageTest-1435429064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9cf07fec-5611-4c7e-a0a9-9b9bc5108988 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:46 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9cf07fec-5611-4c7e-a0a9-9b9bc5108988 Sep 03 14:35:46 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:46 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[942f8d91-53b4-406d-8dee-5ae889c79ee4]: (4, 'raw') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:35:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0b84149c-b57a-4591-a645-882646d14301_7z3eycvddevstack@QuobyteHD {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:46 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0b84149c-b57a-4591-a645-882646d14301_7z3eycvddevstack@QuobyteHD Sep 03 14:35:46 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:46 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-113c762e-525d-47dd-be3a-89ccc72c3957 tempest-CreateVolumesFromImageTest-1435429064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9cf07fec-5611-4c7e-a0a9-9b9bc5108988" returned: 0 in 0.245s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:46 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-113c762e-525d-47dd-be3a-89ccc72c3957 tempest-CreateVolumesFromImageTest-1435429064 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:35:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-113c762e-525d-47dd-be3a-89ccc72c3957 tempest-CreateVolumesFromImageTest-1435429064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:35:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d1360d30-1937-4254-a4c0-740fb05f56bc tempest-CreateVolumesFromImageTest-1435429064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.440s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:46 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d1360d30-1937-4254-a4c0-740fb05f56bc tempest-CreateVolumesFromImageTest-1435429064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-749839487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=808e7bbf-fbfe-4136-8939-3510a397b345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71500195ab8c417eb106ac0b2b2543ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:35:43Z,use_quota=True,user_id='a98e7ed993b8454baa4de42532e94fc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:35:46 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-d1360d30-1937-4254-a4c0-740fb05f56bc tempest-CreateVolumesFromImageTest-1435429064 None] Creating volume 808e7bbf-fbfe-4136-8939-3510a397b345 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:35:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d1360d30-1937-4254-a4c0-740fb05f56bc tempest-CreateVolumesFromImageTest-1435429064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d1360d30-1937-4254-a4c0-740fb05f56bc tempest-CreateVolumesFromImageTest-1435429064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:46 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d1360d30-1937-4254-a4c0-740fb05f56bc tempest-CreateVolumesFromImageTest-1435429064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:35:46 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d1360d30-1937-4254-a4c0-740fb05f56bc tempest-CreateVolumesFromImageTest-1435429064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:35:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d1360d30-1937-4254-a4c0-740fb05f56bc tempest-CreateVolumesFromImageTest-1435429064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:35:46 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d1360d30-1937-4254-a4c0-740fb05f56bc tempest-CreateVolumesFromImageTest-1435429064 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:35:46 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-d1360d30-1937-4254-a4c0-740fb05f56bc tempest-CreateVolumesFromImageTest-1435429064 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:35:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d1360d30-1937-4254-a4c0-740fb05f56bc tempest-CreateVolumesFromImageTest-1435429064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-808e7bbf-fbfe-4136-8939-3510a397b345 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:46 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-113c762e-525d-47dd-be3a-89ccc72c3957 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6433d0ba-2d8a-4569-8515-900065bf8784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cf07fec-5611-4c7e-a0a9-9b9bc5108988', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:46 devstack sudo[106546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-808e7bbf-fbfe-4136-8939-3510a397b345 1073741824 Sep 03 14:35:46 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:46 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-113c762e-525d-47dd-be3a-89ccc72c3957 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f08562be-5e8a-4bd1-a746-c414140061cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:46 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-113c762e-525d-47dd-be3a-89ccc72c3957 tempest-CreateVolumesFromImageTest-1435429064 None] Volume volume-9cf07fec-5611-4c7e-a0a9-9b9bc5108988 (9cf07fec-5611-4c7e-a0a9-9b9bc5108988): created successfully Sep 03 14:35:46 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-113c762e-525d-47dd-be3a-89ccc72c3957 tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f08562be-5e8a-4bd1-a746-c414140061cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:46 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-113c762e-525d-47dd-be3a-89ccc72c3957 tempest-CreateVolumesFromImageTest-1435429064 None] Flow 'volume_create_manager' (485168f3-c290-40d6-acda-3ac10e8bb24a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:35:46 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-113c762e-525d-47dd-be3a-89ccc72c3957 tempest-CreateVolumesFromImageTest-1435429064 None] Created volume successfully. Sep 03 14:35:46 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0b84149c-b57a-4591-a645-882646d14301_7z3eycvddevstack@QuobyteHD" returned: 0 in 0.353s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b84149c-b57a-4591-a645-882646d14301_7z3eycvddevstack@QuobyteHD {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:47 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b84149c-b57a-4591-a645-882646d14301_7z3eycvddevstack@QuobyteHD Sep 03 14:35:47 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:47 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d1360d30-1937-4254-a4c0-740fb05f56bc tempest-CreateVolumesFromImageTest-1435429064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-808e7bbf-fbfe-4136-8939-3510a397b345 1073741824" returned: 0 in 0.476s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:47 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b84149c-b57a-4591-a645-882646d14301_7z3eycvddevstack@QuobyteHD" returned: 1 in 0.351s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b84149c-b57a-4591-a645-882646d14301_7z3eycvddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 14:35:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d1360d30-1937-4254-a4c0-740fb05f56bc tempest-CreateVolumesFromImageTest-1435429064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-808e7bbf-fbfe-4136-8939-3510a397b345 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:47 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-808e7bbf-fbfe-4136-8939-3510a397b345 Sep 03 14:35:47 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:47 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d1360d30-1937-4254-a4c0-740fb05f56bc tempest-CreateVolumesFromImageTest-1435429064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-808e7bbf-fbfe-4136-8939-3510a397b345" returned: 0 in 0.243s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:47 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d1360d30-1937-4254-a4c0-740fb05f56bc tempest-CreateVolumesFromImageTest-1435429064 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:35:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d1360d30-1937-4254-a4c0-740fb05f56bc tempest-CreateVolumesFromImageTest-1435429064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:35:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-83aff773-be60-4a2f-8279-e7648008afa2 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.042s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:47 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-83aff773-be60-4a2f-8279-e7648008afa2 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1973371271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce1c303-b012-4350-b4fa-6ce8e179c2c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b45c494de63b41b5a5f043d222605cf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:35:43Z,use_quota=True,user_id='cfe18c2eff8c4880bd9241eaead5957a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:35:47 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-83aff773-be60-4a2f-8279-e7648008afa2 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Creating volume 8ce1c303-b012-4350-b4fa-6ce8e179c2c0 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:35:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-83aff773-be60-4a2f-8279-e7648008afa2 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-83aff773-be60-4a2f-8279-e7648008afa2 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:47 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-83aff773-be60-4a2f-8279-e7648008afa2 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:35:47 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-83aff773-be60-4a2f-8279-e7648008afa2 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:35:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-83aff773-be60-4a2f-8279-e7648008afa2 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:35:47 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-83aff773-be60-4a2f-8279-e7648008afa2 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:35:47 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-83aff773-be60-4a2f-8279-e7648008afa2 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:35:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-83aff773-be60-4a2f-8279-e7648008afa2 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ce1c303-b012-4350-b4fa-6ce8e179c2c0 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:47 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ce1c303-b012-4350-b4fa-6ce8e179c2c0 1073741824 Sep 03 14:35:47 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d1360d30-1937-4254-a4c0-740fb05f56bc tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bb64bfa-4477-479e-a5a9-3b05f0215311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-808e7bbf-fbfe-4136-8939-3510a397b345', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:47 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:47 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d1360d30-1937-4254-a4c0-740fb05f56bc tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90964bf4-bc7b-4b39-9346-736de1ca8976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:47 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-d1360d30-1937-4254-a4c0-740fb05f56bc tempest-CreateVolumesFromImageTest-1435429064 None] Volume volume-808e7bbf-fbfe-4136-8939-3510a397b345 (808e7bbf-fbfe-4136-8939-3510a397b345): created successfully Sep 03 14:35:47 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d1360d30-1937-4254-a4c0-740fb05f56bc tempest-CreateVolumesFromImageTest-1435429064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90964bf4-bc7b-4b39-9346-736de1ca8976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:47 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d1360d30-1937-4254-a4c0-740fb05f56bc tempest-CreateVolumesFromImageTest-1435429064 None] Flow 'volume_create_manager' (0c8e5a55-c653-4dc0-983a-94163a1a2a53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:35:47 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-d1360d30-1937-4254-a4c0-740fb05f56bc tempest-CreateVolumesFromImageTest-1435429064 None] Created volume successfully. Sep 03 14:35:47 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-83aff773-be60-4a2f-8279-e7648008afa2 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ce1c303-b012-4350-b4fa-6ce8e179c2c0 1073741824" returned: 0 in 0.401s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-83aff773-be60-4a2f-8279-e7648008afa2 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ce1c303-b012-4350-b4fa-6ce8e179c2c0 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:47 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ce1c303-b012-4350-b4fa-6ce8e179c2c0 Sep 03 14:35:47 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:48 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-83aff773-be60-4a2f-8279-e7648008afa2 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ce1c303-b012-4350-b4fa-6ce8e179c2c0" returned: 0 in 0.247s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:48 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-83aff773-be60-4a2f-8279-e7648008afa2 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:35:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-83aff773-be60-4a2f-8279-e7648008afa2 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:35:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ed246283-af5c-4792-ace2-347f59ae7f3b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.386s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:48 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ed246283-af5c-4792-ace2-347f59ae7f3b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1344102807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=840c6cd1-f80f-4145-8056-f29d5eca33f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b45c494de63b41b5a5f043d222605cf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:35:44Z,use_quota=True,user_id='cfe18c2eff8c4880bd9241eaead5957a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:35:48 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-ed246283-af5c-4792-ace2-347f59ae7f3b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Creating volume 840c6cd1-f80f-4145-8056-f29d5eca33f5 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:35:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ed246283-af5c-4792-ace2-347f59ae7f3b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ed246283-af5c-4792-ace2-347f59ae7f3b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:48 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ed246283-af5c-4792-ace2-347f59ae7f3b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:35:48 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ed246283-af5c-4792-ace2-347f59ae7f3b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:35:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ed246283-af5c-4792-ace2-347f59ae7f3b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:35:48 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ed246283-af5c-4792-ace2-347f59ae7f3b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:35:48 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-ed246283-af5c-4792-ace2-347f59ae7f3b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:35:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ed246283-af5c-4792-ace2-347f59ae7f3b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-840c6cd1-f80f-4145-8056-f29d5eca33f5 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:48 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-83aff773-be60-4a2f-8279-e7648008afa2 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bfd8581-db53-4966-bdf8-3cd7be0d2877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ce1c303-b012-4350-b4fa-6ce8e179c2c0', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:48 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-840c6cd1-f80f-4145-8056-f29d5eca33f5 1073741824 Sep 03 14:35:48 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:48 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-83aff773-be60-4a2f-8279-e7648008afa2 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ce6fbef-a723-4121-9dbb-9f61e9eeb750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:48 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-83aff773-be60-4a2f-8279-e7648008afa2 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Volume volume-8ce1c303-b012-4350-b4fa-6ce8e179c2c0 (8ce1c303-b012-4350-b4fa-6ce8e179c2c0): created successfully Sep 03 14:35:48 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-83aff773-be60-4a2f-8279-e7648008afa2 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ce6fbef-a723-4121-9dbb-9f61e9eeb750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:48 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-83aff773-be60-4a2f-8279-e7648008afa2 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Flow 'volume_create_manager' (7e26f29f-219c-4bef-8ba7-6d83dff08501) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:35:48 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-83aff773-be60-4a2f-8279-e7648008afa2 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Created volume successfully. Sep 03 14:35:48 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8d67952c-f7ad-41e2-bc3c-6c56376b1c28 tempest-CreateVolumesFromImageTest-1435429064 None] Acquiring lock "cinder-808e7bbf-fbfe-4136-8939-3510a397b345-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:35:48 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8d67952c-f7ad-41e2-bc3c-6c56376b1c28 tempest-CreateVolumesFromImageTest-1435429064 None] Lock "cinder-808e7bbf-fbfe-4136-8939-3510a397b345-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:35:48 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8d67952c-f7ad-41e2-bc3c-6c56376b1c28 tempest-CreateVolumesFromImageTest-1435429064 None] Acquiring lock "cinder-quobyte-808e7bbf-fbfe-4136-8939-3510a397b345" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:35:48 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ed246283-af5c-4792-ace2-347f59ae7f3b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-840c6cd1-f80f-4145-8056-f29d5eca33f5 1073741824" returned: 0 in 0.461s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:48 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8d67952c-f7ad-41e2-bc3c-6c56376b1c28 tempest-CreateVolumesFromImageTest-1435429064 None] Lock "cinder-quobyte-808e7bbf-fbfe-4136-8939-3510a397b345" acquired by "delete_volume" :: waited 0.024s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:35:48 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5b63c3-7d53-47f8-8823-12f99d94305a]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:35:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8d67952c-f7ad-41e2-bc3c-6c56376b1c28 tempest-CreateVolumesFromImageTest-1435429064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-808e7bbf-fbfe-4136-8939-3510a397b345 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ed246283-af5c-4792-ace2-347f59ae7f3b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-840c6cd1-f80f-4145-8056-f29d5eca33f5 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:48 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-840c6cd1-f80f-4145-8056-f29d5eca33f5 Sep 03 14:35:48 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:48 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-808e7bbf-fbfe-4136-8939-3510a397b345 Sep 03 14:35:48 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:48 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ed246283-af5c-4792-ace2-347f59ae7f3b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-840c6cd1-f80f-4145-8056-f29d5eca33f5" returned: 0 in 0.241s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:48 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ed246283-af5c-4792-ace2-347f59ae7f3b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:35:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ed246283-af5c-4792-ace2-347f59ae7f3b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:35:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1991f7fd-bb92-4688-8119-fdef0cc8f77c tempest-VolumeDependencyTests-868207421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.616s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:48 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ed246283-af5c-4792-ace2-347f59ae7f3b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fd2b441-3650-4b11-9cc0-33a902d1b3f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-840c6cd1-f80f-4145-8056-f29d5eca33f5', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:48 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ed246283-af5c-4792-ace2-347f59ae7f3b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74191f82-ff69-46fe-9261-6892dc62f675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:49 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-1991f7fd-bb92-4688-8119-fdef0cc8f77c tempest-VolumeDependencyTests-868207421 None] Creating offline snapshot 5ad8760f-ce86-4365-b6ad-b0af4627fcd5 of volume 8ca6a53f-4580-4fb2-ad42-85386e9b1dff {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:35:49 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-ed246283-af5c-4792-ace2-347f59ae7f3b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Volume volume-840c6cd1-f80f-4145-8056-f29d5eca33f5 (840c6cd1-f80f-4145-8056-f29d5eca33f5): created successfully Sep 03 14:35:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ed246283-af5c-4792-ace2-347f59ae7f3b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74191f82-ff69-46fe-9261-6892dc62f675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ed246283-af5c-4792-ace2-347f59ae7f3b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Flow 'volume_create_manager' (cf41ae5e-359e-4876-be50-3ef7ddac6d2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:35:49 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf2b453-a074-4988-8d34-0c25b673c0cc]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:35:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1991f7fd-bb92-4688-8119-fdef0cc8f77c tempest-VolumeDependencyTests-868207421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:49 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-ed246283-af5c-4792-ace2-347f59ae7f3b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Created volume successfully. Sep 03 14:35:49 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8d67952c-f7ad-41e2-bc3c-6c56376b1c28 tempest-CreateVolumesFromImageTest-1435429064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-808e7bbf-fbfe-4136-8939-3510a397b345" returned: 0 in 0.377s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8d67952c-f7ad-41e2-bc3c-6c56376b1c28 tempest-CreateVolumesFromImageTest-1435429064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-808e7bbf-fbfe-4136-8939-3510a397b345 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:49 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-808e7bbf-fbfe-4136-8939-3510a397b345 Sep 03 14:35:49 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:49 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff Sep 03 14:35:49 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:49 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8d67952c-f7ad-41e2-bc3c-6c56376b1c28 tempest-CreateVolumesFromImageTest-1435429064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-808e7bbf-fbfe-4136-8939-3510a397b345" returned: 0 in 0.269s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:49 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8d67952c-f7ad-41e2-bc3c-6c56376b1c28 tempest-CreateVolumesFromImageTest-1435429064 None] Lock "cinder-quobyte-808e7bbf-fbfe-4136-8939-3510a397b345" released by "delete_volume" :: held 0.685s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:35:49 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:49 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-8d67952c-f7ad-41e2-bc3c-6c56376b1c28 tempest-CreateVolumesFromImageTest-1435429064 None] Created reservations ['0f0de000-408b-41fa-9fcf-17d318c9a448', '785ad151-3cd2-4623-830b-b6374fbe9e07', 'c487e4df-9231-4bd4-993e-97fb07801155', '22fafc6c-eb64-41dd-b336-34cb7ca398be'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:35:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1991f7fd-bb92-4688-8119-fdef0cc8f77c tempest-VolumeDependencyTests-868207421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff" returned: 0 in 0.383s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1991f7fd-bb92-4688-8119-fdef0cc8f77c tempest-VolumeDependencyTests-868207421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff.5ad8760f-ce86-4365-b6ad-b0af4627fcd5 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:49 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff.5ad8760f-ce86-4365-b6ad-b0af4627fcd5 1G Sep 03 14:35:49 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8d67952c-f7ad-41e2-bc3c-6c56376b1c28 tempest-CreateVolumesFromImageTest-1435429064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8d67952c-f7ad-41e2-bc3c-6c56376b1c28 tempest-CreateVolumesFromImageTest-1435429064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:49 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-8d67952c-f7ad-41e2-bc3c-6c56376b1c28 tempest-CreateVolumesFromImageTest-1435429064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:35:49 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-8d67952c-f7ad-41e2-bc3c-6c56376b1c28 tempest-CreateVolumesFromImageTest-1435429064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:35:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8d67952c-f7ad-41e2-bc3c-6c56376b1c28 tempest-CreateVolumesFromImageTest-1435429064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:35:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8d67952c-f7ad-41e2-bc3c-6c56376b1c28 tempest-CreateVolumesFromImageTest-1435429064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:49 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:35:49 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:49 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8d67952c-f7ad-41e2-bc3c-6c56376b1c28 tempest-CreateVolumesFromImageTest-1435429064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.262s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:49 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-8d67952c-f7ad-41e2-bc3c-6c56376b1c28 tempest-CreateVolumesFromImageTest-1435429064 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:35:49 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-dd6fecbb-4317-4a97-abe8-0ae81114722b tempest-CreateVolumesFromImageTest-1435429064 None] Acquiring lock "cinder-9cf07fec-5611-4c7e-a0a9-9b9bc5108988-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:35:49 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-8d67952c-f7ad-41e2-bc3c-6c56376b1c28 tempest-CreateVolumesFromImageTest-1435429064 None] Deleted volume successfully. Sep 03 14:35:49 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-dd6fecbb-4317-4a97-abe8-0ae81114722b tempest-CreateVolumesFromImageTest-1435429064 None] Lock "cinder-9cf07fec-5611-4c7e-a0a9-9b9bc5108988-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:35:49 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8d67952c-f7ad-41e2-bc3c-6c56376b1c28 tempest-CreateVolumesFromImageTest-1435429064 None] Lock "cinder-808e7bbf-fbfe-4136-8939-3510a397b345-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:35:49 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-dd6fecbb-4317-4a97-abe8-0ae81114722b tempest-CreateVolumesFromImageTest-1435429064 None] Acquiring lock "cinder-quobyte-9cf07fec-5611-4c7e-a0a9-9b9bc5108988" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:35:49 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-dd6fecbb-4317-4a97-abe8-0ae81114722b tempest-CreateVolumesFromImageTest-1435429064 None] Lock "cinder-quobyte-9cf07fec-5611-4c7e-a0a9-9b9bc5108988" acquired by "delete_volume" :: waited 0.013s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:35:49 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1991f7fd-bb92-4688-8119-fdef0cc8f77c tempest-VolumeDependencyTests-868207421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff.5ad8760f-ce86-4365-b6ad-b0af4627fcd5 1G" returned: 0 in 0.451s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1991f7fd-bb92-4688-8119-fdef0cc8f77c tempest-VolumeDependencyTests-868207421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff.5ad8760f-ce86-4365-b6ad-b0af4627fcd5 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:49 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa308cb-8dac-48d2-8e64-8f1dc03ddf3e]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:35:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dd6fecbb-4317-4a97-abe8-0ae81114722b tempest-CreateVolumesFromImageTest-1435429064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9cf07fec-5611-4c7e-a0a9-9b9bc5108988 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:49 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff.5ad8760f-ce86-4365-b6ad-b0af4627fcd5 Sep 03 14:35:49 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:49 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9cf07fec-5611-4c7e-a0a9-9b9bc5108988 Sep 03 14:35:49 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:50 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1991f7fd-bb92-4688-8119-fdef0cc8f77c tempest-VolumeDependencyTests-868207421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff.5ad8760f-ce86-4365-b6ad-b0af4627fcd5" returned: 0 in 0.285s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:50 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-1991f7fd-bb92-4688-8119-fdef0cc8f77c tempest-VolumeDependencyTests-868207421 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff.5ad8760f-ce86-4365-b6ad-b0af4627fcd5 is being set with open permissions: ugo+rw Sep 03 14:35:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1991f7fd-bb92-4688-8119-fdef0cc8f77c tempest-VolumeDependencyTests-868207421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff.5ad8760f-ce86-4365-b6ad-b0af4627fcd5 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:50 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff.5ad8760f-ce86-4365-b6ad-b0af4627fcd5 Sep 03 14:35:50 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:50 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dd6fecbb-4317-4a97-abe8-0ae81114722b tempest-CreateVolumesFromImageTest-1435429064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9cf07fec-5611-4c7e-a0a9-9b9bc5108988" returned: 0 in 0.382s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dd6fecbb-4317-4a97-abe8-0ae81114722b tempest-CreateVolumesFromImageTest-1435429064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9cf07fec-5611-4c7e-a0a9-9b9bc5108988 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:50 devstack sudo[106613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9cf07fec-5611-4c7e-a0a9-9b9bc5108988 Sep 03 14:35:50 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:50 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1991f7fd-bb92-4688-8119-fdef0cc8f77c tempest-VolumeDependencyTests-868207421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff.5ad8760f-ce86-4365-b6ad-b0af4627fcd5" returned: 0 in 0.272s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1991f7fd-bb92-4688-8119-fdef0cc8f77c tempest-VolumeDependencyTests-868207421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:50 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff.info Sep 03 14:35:50 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:50 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dd6fecbb-4317-4a97-abe8-0ae81114722b tempest-CreateVolumesFromImageTest-1435429064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-9cf07fec-5611-4c7e-a0a9-9b9bc5108988" returned: 0 in 0.262s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:50 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-dd6fecbb-4317-4a97-abe8-0ae81114722b tempest-CreateVolumesFromImageTest-1435429064 None] Lock "cinder-quobyte-9cf07fec-5611-4c7e-a0a9-9b9bc5108988" released by "delete_volume" :: held 0.689s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:35:50 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-dd6fecbb-4317-4a97-abe8-0ae81114722b tempest-CreateVolumesFromImageTest-1435429064 None] Created reservations ['dd0fc9e7-c9f5-44e4-9395-5320eb1e70d4', '405ffab4-1181-4e47-b683-52275564b798', '92ea0d20-ef34-4301-86bd-cfed24916863', '6900aaf1-db61-48a1-a99d-51aab9443c4e'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:35:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-dd6fecbb-4317-4a97-abe8-0ae81114722b tempest-CreateVolumesFromImageTest-1435429064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-dd6fecbb-4317-4a97-abe8-0ae81114722b tempest-CreateVolumesFromImageTest-1435429064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:50 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-dd6fecbb-4317-4a97-abe8-0ae81114722b tempest-CreateVolumesFromImageTest-1435429064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:35:50 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-dd6fecbb-4317-4a97-abe8-0ae81114722b tempest-CreateVolumesFromImageTest-1435429064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:35:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-dd6fecbb-4317-4a97-abe8-0ae81114722b tempest-CreateVolumesFromImageTest-1435429064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:35:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dd6fecbb-4317-4a97-abe8-0ae81114722b tempest-CreateVolumesFromImageTest-1435429064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:50 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:35:50 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:50 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1991f7fd-bb92-4688-8119-fdef0cc8f77c tempest-VolumeDependencyTests-868207421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff.info" returned: 0 in 0.263s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:50 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-1991f7fd-bb92-4688-8119-fdef0cc8f77c tempest-VolumeDependencyTests-868207421 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff.info is being set with open permissions: ugo+rw Sep 03 14:35:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1991f7fd-bb92-4688-8119-fdef0cc8f77c tempest-VolumeDependencyTests-868207421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:50 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff.info Sep 03 14:35:50 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:50 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dd6fecbb-4317-4a97-abe8-0ae81114722b tempest-CreateVolumesFromImageTest-1435429064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.265s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:50 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-dd6fecbb-4317-4a97-abe8-0ae81114722b tempest-CreateVolumesFromImageTest-1435429064 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:35:50 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-727f059e-612a-4d9f-80ce-24b96d05d495 tempest-CreateVolumesFromImageTest-1435429064 None] Acquiring lock "cinder-2acababe-9076-48ab-a81a-ae90e9a35b99-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:35:50 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-dd6fecbb-4317-4a97-abe8-0ae81114722b tempest-CreateVolumesFromImageTest-1435429064 None] Deleted volume successfully. Sep 03 14:35:50 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-727f059e-612a-4d9f-80ce-24b96d05d495 tempest-CreateVolumesFromImageTest-1435429064 None] Lock "cinder-2acababe-9076-48ab-a81a-ae90e9a35b99-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:35:50 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-dd6fecbb-4317-4a97-abe8-0ae81114722b tempest-CreateVolumesFromImageTest-1435429064 None] Lock "cinder-9cf07fec-5611-4c7e-a0a9-9b9bc5108988-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:35:50 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1991f7fd-bb92-4688-8119-fdef0cc8f77c tempest-VolumeDependencyTests-868207421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff.info" returned: 0 in 0.269s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1991f7fd-bb92-4688-8119-fdef0cc8f77c tempest-VolumeDependencyTests-868207421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.042s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:35:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a9f000e7-b04e-440b-b670-bd56df129b16 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.531s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a9f000e7-b04e-440b-b670-bd56df129b16 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:35:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-367040240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=513a1c47-ce64-4adb-9a81-71ca30bd034a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b45c494de63b41b5a5f043d222605cf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:35:44Z,use_quota=True,user_id='cfe18c2eff8c4880bd9241eaead5957a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:35:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-a9f000e7-b04e-440b-b670-bd56df129b16 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Creating volume 513a1c47-ce64-4adb-9a81-71ca30bd034a {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:35:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a9f000e7-b04e-440b-b670-bd56df129b16 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a9f000e7-b04e-440b-b670-bd56df129b16 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a9f000e7-b04e-440b-b670-bd56df129b16 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:35:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a9f000e7-b04e-440b-b670-bd56df129b16 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:35:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a9f000e7-b04e-440b-b670-bd56df129b16 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:35:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a9f000e7-b04e-440b-b670-bd56df129b16 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:35:51 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-a9f000e7-b04e-440b-b670-bd56df129b16 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:35:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a9f000e7-b04e-440b-b670-bd56df129b16 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-513a1c47-ce64-4adb-9a81-71ca30bd034a 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:51 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-513a1c47-ce64-4adb-9a81-71ca30bd034a 1073741824 Sep 03 14:35:51 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:51 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-727f059e-612a-4d9f-80ce-24b96d05d495 tempest-CreateVolumesFromImageTest-1435429064 None] Acquiring lock "cinder-quobyte-2acababe-9076-48ab-a81a-ae90e9a35b99" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:35:51 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-1991f7fd-bb92-4688-8119-fdef0cc8f77c tempest-VolumeDependencyTests-868207421 None] Create snapshot completed successfully Sep 03 14:35:51 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-727f059e-612a-4d9f-80ce-24b96d05d495 tempest-CreateVolumesFromImageTest-1435429064 None] Lock "cinder-quobyte-2acababe-9076-48ab-a81a-ae90e9a35b99" acquired by "delete_volume" :: waited 0.027s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:35:51 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6b40ef-96e8-4a52-8477-7ae2b385e875]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:35:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-727f059e-612a-4d9f-80ce-24b96d05d495 tempest-CreateVolumesFromImageTest-1435429064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2acababe-9076-48ab-a81a-ae90e9a35b99 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:51 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2acababe-9076-48ab-a81a-ae90e9a35b99 Sep 03 14:35:51 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:51 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-727f059e-612a-4d9f-80ce-24b96d05d495 tempest-CreateVolumesFromImageTest-1435429064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2acababe-9076-48ab-a81a-ae90e9a35b99" returned: 0 in 0.434s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-727f059e-612a-4d9f-80ce-24b96d05d495 tempest-CreateVolumesFromImageTest-1435429064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2acababe-9076-48ab-a81a-ae90e9a35b99 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:51 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a9f000e7-b04e-440b-b670-bd56df129b16 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-513a1c47-ce64-4adb-9a81-71ca30bd034a 1073741824" returned: 0 in 0.541s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:51 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2acababe-9076-48ab-a81a-ae90e9a35b99 Sep 03 14:35:51 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:51 devstack cinder-volume[87007]: DEBUG oslo_service.periodic_task [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87007) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 14:35:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:35:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:35:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:35:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a9f000e7-b04e-440b-b670-bd56df129b16 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-513a1c47-ce64-4adb-9a81-71ca30bd034a {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:51 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:35:51 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:51 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-513a1c47-ce64-4adb-9a81-71ca30bd034a Sep 03 14:35:51 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:51 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-727f059e-612a-4d9f-80ce-24b96d05d495 tempest-CreateVolumesFromImageTest-1435429064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-2acababe-9076-48ab-a81a-ae90e9a35b99" returned: 0 in 0.315s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:51 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-727f059e-612a-4d9f-80ce-24b96d05d495 tempest-CreateVolumesFromImageTest-1435429064 None] Lock "cinder-quobyte-2acababe-9076-48ab-a81a-ae90e9a35b99" released by "delete_volume" :: held 0.796s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:35:51 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a9f000e7-b04e-440b-b670-bd56df129b16 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-513a1c47-ce64-4adb-9a81-71ca30bd034a" returned: 0 in 0.311s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a9f000e7-b04e-440b-b670-bd56df129b16 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:35:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a9f000e7-b04e-440b-b670-bd56df129b16 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:35:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-eaf18886-b3d0-4882-ab7c-96c4db9d515f tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.214s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:51 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-eaf18886-b3d0-4882-ab7c-96c4db9d515f tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:35:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-908642973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b933df99-1d42-4b4d-8936-21d0c278a325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b45c494de63b41b5a5f043d222605cf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:35:45Z,use_quota=True,user_id='cfe18c2eff8c4880bd9241eaead5957a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:35:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-eaf18886-b3d0-4882-ab7c-96c4db9d515f tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Creating volume b933df99-1d42-4b4d-8936-21d0c278a325 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:35:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-eaf18886-b3d0-4882-ab7c-96c4db9d515f tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-eaf18886-b3d0-4882-ab7c-96c4db9d515f tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-eaf18886-b3d0-4882-ab7c-96c4db9d515f tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:35:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-eaf18886-b3d0-4882-ab7c-96c4db9d515f tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:35:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-eaf18886-b3d0-4882-ab7c-96c4db9d515f tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:35:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-eaf18886-b3d0-4882-ab7c-96c4db9d515f tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:35:51 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-eaf18886-b3d0-4882-ab7c-96c4db9d515f tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:35:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eaf18886-b3d0-4882-ab7c-96c4db9d515f tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b933df99-1d42-4b4d-8936-21d0c278a325 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:51 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b933df99-1d42-4b4d-8936-21d0c278a325 1073741824 Sep 03 14:35:51 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.371s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:51 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:35:51 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:35:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a9f000e7-b04e-440b-b670-bd56df129b16 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c23ef0fc-81f0-411d-b433-5861c3c4dbfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-513a1c47-ce64-4adb-9a81-71ca30bd034a', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a9f000e7-b04e-440b-b670-bd56df129b16 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3656ad3-6513-4c73-a8b5-25cd94b5dc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:52 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-727f059e-612a-4d9f-80ce-24b96d05d495 tempest-CreateVolumesFromImageTest-1435429064 None] Created reservations ['d25f25da-4b16-41eb-a287-f102891e0fa9', 'c667fcec-9845-45ae-a629-2c694f5665b7', 'dc94c7e0-6a8a-457f-9e4f-ec481cd63f74', 'b4ba406c-7855-4074-938c-87f0a8d091de'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:35:52 devstack cinder-volume[87007]: DEBUG oslo_service.periodic_task [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running periodic task VolumeManager._thread_info {{(pid=87007) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 14:35:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] thread count: 28 {{(pid=87007) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 14:35:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] thread info: [<_MainThread(MainThread, started 123689171054720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87007) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 14:35:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Flow 'volume_create_manager' (9b6487a9-af53-4d35-8cfb-620ce4526c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:35:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcbd27f2-5a24-41e4-9803-5d1d61c54a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:52 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-a9f000e7-b04e-440b-b670-bd56df129b16 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Volume volume-513a1c47-ce64-4adb-9a81-71ca30bd034a (513a1c47-ce64-4adb-9a81-71ca30bd034a): created successfully Sep 03 14:35:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a9f000e7-b04e-440b-b670-bd56df129b16 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3656ad3-6513-4c73-a8b5-25cd94b5dc83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a9f000e7-b04e-440b-b670-bd56df129b16 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Flow 'volume_create_manager' (608689df-32e1-48ab-b288-f2ea2e87957e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:35:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcbd27f2-5a24-41e4-9803-5d1d61c54a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-119732025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f376b414-fcc8-4afe-b9dc-ad3c44fd3b1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98d1833b12e740fb82e9257ec92fe5d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5ad8760f-ce86-4365-b6ad-b0af4627fcd5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:35:52Z,use_quota=True,user_id='b675a50c2cd3431ebc9b98882b788856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e2534ad-11dd-490d-808a-c0dd7dafc22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e2534ad-11dd-490d-808a-c0dd7dafc22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3279ad33-8a76-409a-af2b-8595ca4ed521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3279ad33-8a76-409a-af2b-8595ca4ed521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f376b414-fcc8-4afe-b9dc-ad3c44fd3b1c', 'volume_name': 'volume-f376b414-fcc8-4afe-b9dc-ad3c44fd3b1c', 'volume_size': 1, 'snapshot_id': '5ad8760f-ce86-4365-b6ad-b0af4627fcd5'}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdb426aa-2640-43c3-8cb7-69dc788eb1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdb426aa-2640-43c3-8cb7-69dc788eb1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d67aed1-fbc2-40d5-859c-1c4ce61bf67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:52 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Volume f376b414-fcc8-4afe-b9dc-ad3c44fd3b1c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f376b414-fcc8-4afe-b9dc-ad3c44fd3b1c', 'volume_size': 1, 'snapshot_id': '5ad8760f-ce86-4365-b6ad-b0af4627fcd5'} Sep 03 14:35:52 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-a9f000e7-b04e-440b-b670-bd56df129b16 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Created volume successfully. Sep 03 14:35:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-727f059e-612a-4d9f-80ce-24b96d05d495 tempest-CreateVolumesFromImageTest-1435429064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-727f059e-612a-4d9f-80ce-24b96d05d495 tempest-CreateVolumesFromImageTest-1435429064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:52 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-727f059e-612a-4d9f-80ce-24b96d05d495 tempest-CreateVolumesFromImageTest-1435429064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:35:52 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-727f059e-612a-4d9f-80ce-24b96d05d495 tempest-CreateVolumesFromImageTest-1435429064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:35:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-727f059e-612a-4d9f-80ce-24b96d05d495 tempest-CreateVolumesFromImageTest-1435429064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:35:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-727f059e-612a-4d9f-80ce-24b96d05d495 tempest-CreateVolumesFromImageTest-1435429064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:52 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:35:52 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:52 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eaf18886-b3d0-4882-ab7c-96c4db9d515f tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b933df99-1d42-4b4d-8936-21d0c278a325 1073741824" returned: 0 in 0.451s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eaf18886-b3d0-4882-ab7c-96c4db9d515f tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b933df99-1d42-4b4d-8936-21d0c278a325 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:52 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-727f059e-612a-4d9f-80ce-24b96d05d495 tempest-CreateVolumesFromImageTest-1435429064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.256s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:52 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-727f059e-612a-4d9f-80ce-24b96d05d495 tempest-CreateVolumesFromImageTest-1435429064 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:35:52 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-727f059e-612a-4d9f-80ce-24b96d05d495 tempest-CreateVolumesFromImageTest-1435429064 None] Deleted volume successfully. Sep 03 14:35:52 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b933df99-1d42-4b4d-8936-21d0c278a325 Sep 03 14:35:52 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:52 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-727f059e-612a-4d9f-80ce-24b96d05d495 tempest-CreateVolumesFromImageTest-1435429064 None] Lock "cinder-2acababe-9076-48ab-a81a-ae90e9a35b99-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:35:52 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eaf18886-b3d0-4882-ab7c-96c4db9d515f tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b933df99-1d42-4b4d-8936-21d0c278a325" returned: 0 in 0.264s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:52 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-eaf18886-b3d0-4882-ab7c-96c4db9d515f tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:35:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-eaf18886-b3d0-4882-ab7c-96c4db9d515f tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:35:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d36ff52d-2c01-41c7-be72-e45dfd54f748 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.558s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:52 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d36ff52d-2c01-41c7-be72-e45dfd54f748 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-766472436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42ed77cd-70e2-4dff-9680-3e6699e795bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b45c494de63b41b5a5f043d222605cf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:35:45Z,use_quota=True,user_id='cfe18c2eff8c4880bd9241eaead5957a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:35:52 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-d36ff52d-2c01-41c7-be72-e45dfd54f748 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Creating volume 42ed77cd-70e2-4dff-9680-3e6699e795bc {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:35:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d36ff52d-2c01-41c7-be72-e45dfd54f748 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d36ff52d-2c01-41c7-be72-e45dfd54f748 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:52 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d36ff52d-2c01-41c7-be72-e45dfd54f748 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:35:52 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d36ff52d-2c01-41c7-be72-e45dfd54f748 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:35:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d36ff52d-2c01-41c7-be72-e45dfd54f748 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:35:52 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d36ff52d-2c01-41c7-be72-e45dfd54f748 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:35:52 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-d36ff52d-2c01-41c7-be72-e45dfd54f748 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:35:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d36ff52d-2c01-41c7-be72-e45dfd54f748 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-42ed77cd-70e2-4dff-9680-3e6699e795bc 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:52 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-42ed77cd-70e2-4dff-9680-3e6699e795bc 1073741824 Sep 03 14:35:52 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-eaf18886-b3d0-4882-ab7c-96c4db9d515f tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b63f0846-27e9-4183-8e63-d59eb1a65ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b933df99-1d42-4b4d-8936-21d0c278a325', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-eaf18886-b3d0-4882-ab7c-96c4db9d515f tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f5f1e1c-a477-42c0-85ec-a5a6fe4515fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:52 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-eaf18886-b3d0-4882-ab7c-96c4db9d515f tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Volume volume-b933df99-1d42-4b4d-8936-21d0c278a325 (b933df99-1d42-4b4d-8936-21d0c278a325): created successfully Sep 03 14:35:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-eaf18886-b3d0-4882-ab7c-96c4db9d515f tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f5f1e1c-a477-42c0-85ec-a5a6fe4515fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-eaf18886-b3d0-4882-ab7c-96c4db9d515f tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Flow 'volume_create_manager' (cf3e4c76-0f02-49af-b174-fe194386b059) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:35:52 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-eaf18886-b3d0-4882-ab7c-96c4db9d515f tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Created volume successfully. Sep 03 14:35:53 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d36ff52d-2c01-41c7-be72-e45dfd54f748 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-42ed77cd-70e2-4dff-9680-3e6699e795bc 1073741824" returned: 0 in 0.404s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d36ff52d-2c01-41c7-be72-e45dfd54f748 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-42ed77cd-70e2-4dff-9680-3e6699e795bc {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:53 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2a123e27-0486-4a78-a7ba-1f45db70cadb tempest-CreateVolumesFromImageTest-1435429064 None] Acquiring lock "cinder-41d88077-d8c3-4859-9def-f73abe7e8999-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:35:53 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-42ed77cd-70e2-4dff-9680-3e6699e795bc Sep 03 14:35:53 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:53 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2a123e27-0486-4a78-a7ba-1f45db70cadb tempest-CreateVolumesFromImageTest-1435429064 None] Lock "cinder-41d88077-d8c3-4859-9def-f73abe7e8999-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:35:53 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2a123e27-0486-4a78-a7ba-1f45db70cadb tempest-CreateVolumesFromImageTest-1435429064 None] Acquiring lock "cinder-quobyte-41d88077-d8c3-4859-9def-f73abe7e8999" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:35:53 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2a123e27-0486-4a78-a7ba-1f45db70cadb tempest-CreateVolumesFromImageTest-1435429064 None] Lock "cinder-quobyte-41d88077-d8c3-4859-9def-f73abe7e8999" acquired by "delete_volume" :: waited 0.019s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:35:53 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdce75b4-6a12-4e36-99ef-86d11df0a776]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:35:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2a123e27-0486-4a78-a7ba-1f45db70cadb tempest-CreateVolumesFromImageTest-1435429064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-41d88077-d8c3-4859-9def-f73abe7e8999 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:53 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-41d88077-d8c3-4859-9def-f73abe7e8999 Sep 03 14:35:53 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:53 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d36ff52d-2c01-41c7-be72-e45dfd54f748 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-42ed77cd-70e2-4dff-9680-3e6699e795bc" returned: 0 in 0.265s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:53 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d36ff52d-2c01-41c7-be72-e45dfd54f748 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:35:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d36ff52d-2c01-41c7-be72-e45dfd54f748 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:35:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.180s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:53 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc966e44-944f-491e-8a58-908ff073b597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='702c4f76dc28489cbcbd19d650aea46e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:35:45Z,use_quota=True,user_id='2782a13d8ec846c2ab70f63fe99096bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ffe8229-3438-4af9-98db-dd76e680882f),volume_type_id=2ffe8229-3438-4af9-98db-dd76e680882f)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:35:53 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Creating volume dc966e44-944f-491e-8a58-908ff073b597 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:35:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:53 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:35:53 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:35:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:35:53 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:35:53 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:35:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dc966e44-944f-491e-8a58-908ff073b597 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:53 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d36ff52d-2c01-41c7-be72-e45dfd54f748 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86a1a197-3374-4147-943b-c2d0cd8b27de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42ed77cd-70e2-4dff-9680-3e6699e795bc', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:53 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dc966e44-944f-491e-8a58-908ff073b597 1073741824 Sep 03 14:35:53 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d36ff52d-2c01-41c7-be72-e45dfd54f748 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30227134-ebb7-4578-a9e7-c64682cde316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:53 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:53 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-d36ff52d-2c01-41c7-be72-e45dfd54f748 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Volume volume-42ed77cd-70e2-4dff-9680-3e6699e795bc (42ed77cd-70e2-4dff-9680-3e6699e795bc): created successfully Sep 03 14:35:53 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d36ff52d-2c01-41c7-be72-e45dfd54f748 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30227134-ebb7-4578-a9e7-c64682cde316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:53 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d36ff52d-2c01-41c7-be72-e45dfd54f748 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Flow 'volume_create_manager' (c083fb93-b4e6-4068-ad73-84b46ee4341b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:35:53 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-d36ff52d-2c01-41c7-be72-e45dfd54f748 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Created volume successfully. Sep 03 14:35:53 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2a123e27-0486-4a78-a7ba-1f45db70cadb tempest-CreateVolumesFromImageTest-1435429064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-41d88077-d8c3-4859-9def-f73abe7e8999" returned: 0 in 0.479s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2a123e27-0486-4a78-a7ba-1f45db70cadb tempest-CreateVolumesFromImageTest-1435429064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-41d88077-d8c3-4859-9def-f73abe7e8999 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:53 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-28240b54-baeb-46d0-9ddf-2ab2bac942f5 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Acquiring lock "cinder-42ed77cd-70e2-4dff-9680-3e6699e795bc-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:35:53 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-41d88077-d8c3-4859-9def-f73abe7e8999 Sep 03 14:35:53 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:53 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-28240b54-baeb-46d0-9ddf-2ab2bac942f5 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "cinder-42ed77cd-70e2-4dff-9680-3e6699e795bc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:35:53 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-28240b54-baeb-46d0-9ddf-2ab2bac942f5 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Acquiring lock "cinder-quobyte-42ed77cd-70e2-4dff-9680-3e6699e795bc" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:35:53 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-28240b54-baeb-46d0-9ddf-2ab2bac942f5 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "cinder-quobyte-42ed77cd-70e2-4dff-9680-3e6699e795bc" acquired by "delete_volume" :: waited 0.016s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:35:53 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[99af52ae-f119-49b7-8121-4f4e04540f52]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:35:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-28240b54-baeb-46d0-9ddf-2ab2bac942f5 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-42ed77cd-70e2-4dff-9680-3e6699e795bc {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:53 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dc966e44-944f-491e-8a58-908ff073b597 1073741824" returned: 0 in 0.551s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dc966e44-944f-491e-8a58-908ff073b597 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:54 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-42ed77cd-70e2-4dff-9680-3e6699e795bc Sep 03 14:35:54 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:54 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dc966e44-944f-491e-8a58-908ff073b597 Sep 03 14:35:54 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:54 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2a123e27-0486-4a78-a7ba-1f45db70cadb tempest-CreateVolumesFromImageTest-1435429064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-41d88077-d8c3-4859-9def-f73abe7e8999" returned: 0 in 0.323s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2a123e27-0486-4a78-a7ba-1f45db70cadb tempest-CreateVolumesFromImageTest-1435429064 None] Lock "cinder-quobyte-41d88077-d8c3-4859-9def-f73abe7e8999" released by "delete_volume" :: held 0.856s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-2a123e27-0486-4a78-a7ba-1f45db70cadb tempest-CreateVolumesFromImageTest-1435429064 None] Created reservations ['5eb749bb-1026-4d16-8e47-ee42f7564af9', 'd69b71dc-525e-453c-81a6-b3b98232b676', 'b789abd7-7763-45bf-8685-0e20352ba98b', '4b256c45-40c9-4534-9b3c-6ab68350263f'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2a123e27-0486-4a78-a7ba-1f45db70cadb tempest-CreateVolumesFromImageTest-1435429064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2a123e27-0486-4a78-a7ba-1f45db70cadb tempest-CreateVolumesFromImageTest-1435429064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2a123e27-0486-4a78-a7ba-1f45db70cadb tempest-CreateVolumesFromImageTest-1435429064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2a123e27-0486-4a78-a7ba-1f45db70cadb tempest-CreateVolumesFromImageTest-1435429064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2a123e27-0486-4a78-a7ba-1f45db70cadb tempest-CreateVolumesFromImageTest-1435429064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2a123e27-0486-4a78-a7ba-1f45db70cadb tempest-CreateVolumesFromImageTest-1435429064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:54 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:35:54 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:54 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dc966e44-944f-491e-8a58-908ff073b597" returned: 0 in 0.274s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.148s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:54 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Acquiring lock "cinder-quobyte-5ad8760f-ce86-4365-b6ad-b0af4627fcd5-f376b414-fcc8-4afe-b9dc-ad3c44fd3b1c" by "_create_volume_from_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-28240b54-baeb-46d0-9ddf-2ab2bac942f5 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-42ed77cd-70e2-4dff-9680-3e6699e795bc" returned: 0 in 0.421s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-28240b54-baeb-46d0-9ddf-2ab2bac942f5 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-42ed77cd-70e2-4dff-9680-3e6699e795bc {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:54 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-42ed77cd-70e2-4dff-9680-3e6699e795bc Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG cinder.volume.volume_utils [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Attempting download of 0b84149c-b57a-4591-a645-882646d14301 ((None, [{'url': 'file:///opt/stack/data/glance/images/0b84149c-b57a-4591-a645-882646d14301', 'metadata': {}}])) to volume dc966e44-944f-491e-8a58-908ff073b597. {{(pid=87007) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 14:35:54 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Lock "cinder-quobyte-5ad8760f-ce86-4365-b6ad-b0af4627fcd5-f376b414-fcc8-4afe-b9dc-ad3c44fd3b1c" acquired by "_create_volume_from_snapshot" :: waited 0.052s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Creating volume f376b414-fcc8-4afe-b9dc-ad3c44fd3b1c from snapshot 5ad8760f-ce86-4365-b6ad-b0af4627fcd5 {{(pid=87007) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Acquiring lock "cinder-quobyte-f376b414-fcc8-4afe-b9dc-ad3c44fd3b1c" by "_copy_volume_from_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a33c10d2-db14-4b1a-96da-1d1fd0e5b294 tempest-CreateVolumesFromImageTest-1435429064 None] Acquiring lock "cinder-c5a20647-0ff1-4fea-a697-fc51e1ccd4d3-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Lock "cinder-quobyte-f376b414-fcc8-4afe-b9dc-ad3c44fd3b1c" acquired by "_copy_volume_from_snapshot" :: waited 0.046s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] snapshot: 5ad8760f-ce86-4365-b6ad-b0af4627fcd5, volume: f376b414-fcc8-4afe-b9dc-ad3c44fd3b1c, {{(pid=87007) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a33c10d2-db14-4b1a-96da-1d1fd0e5b294 tempest-CreateVolumesFromImageTest-1435429064 None] Lock "cinder-c5a20647-0ff1-4fea-a697-fc51e1ccd4d3-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7c51c9-7f77-4494-973c-833de922df9f]: (4, 'raw') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0b84149c-b57a-4591-a645-882646d14301_15ykde60 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:54 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9babe5c-0342-469f-9d3f-3e0edce8769c]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff.5ad8760f-ce86-4365-b6ad-b0af4627fcd5 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2a123e27-0486-4a78-a7ba-1f45db70cadb tempest-CreateVolumesFromImageTest-1435429064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.320s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-2a123e27-0486-4a78-a7ba-1f45db70cadb tempest-CreateVolumesFromImageTest-1435429064 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:35:54 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-2a123e27-0486-4a78-a7ba-1f45db70cadb tempest-CreateVolumesFromImageTest-1435429064 None] Deleted volume successfully. Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a33c10d2-db14-4b1a-96da-1d1fd0e5b294 tempest-CreateVolumesFromImageTest-1435429064 None] Acquiring lock "cinder-quobyte-c5a20647-0ff1-4fea-a697-fc51e1ccd4d3" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-2a123e27-0486-4a78-a7ba-1f45db70cadb tempest-CreateVolumesFromImageTest-1435429064 None] Lock "cinder-41d88077-d8c3-4859-9def-f73abe7e8999-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a33c10d2-db14-4b1a-96da-1d1fd0e5b294 tempest-CreateVolumesFromImageTest-1435429064 None] Lock "cinder-quobyte-c5a20647-0ff1-4fea-a697-fc51e1ccd4d3" acquired by "delete_volume" :: waited 0.023s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f006f2ee-ac40-4d3e-aeaa-77bcca256a2c]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a33c10d2-db14-4b1a-96da-1d1fd0e5b294 tempest-CreateVolumesFromImageTest-1435429064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c5a20647-0ff1-4fea-a697-fc51e1ccd4d3 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:54 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:54 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0b84149c-b57a-4591-a645-882646d14301_15ykde60 Sep 03 14:35:54 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-28240b54-baeb-46d0-9ddf-2ab2bac942f5 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-42ed77cd-70e2-4dff-9680-3e6699e795bc" returned: 0 in 0.336s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:54 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff.5ad8760f-ce86-4365-b6ad-b0af4627fcd5 Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-28240b54-baeb-46d0-9ddf-2ab2bac942f5 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "cinder-quobyte-42ed77cd-70e2-4dff-9680-3e6699e795bc" released by "delete_volume" :: held 0.803s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:35:54 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-28240b54-baeb-46d0-9ddf-2ab2bac942f5 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Created reservations ['01b665ef-8bc1-4f87-9b58-c7b97b7e7ac4', '4f63ecad-6563-4f0f-a278-107af9ab8fdb', 'e55d3353-1a27-410c-9552-ca0c5490995a', '999a41a4-99f6-4549-a4e4-e023092ea532'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:35:54 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c5a20647-0ff1-4fea-a697-fc51e1ccd4d3 Sep 03 14:35:54 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-28240b54-baeb-46d0-9ddf-2ab2bac942f5 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-28240b54-baeb-46d0-9ddf-2ab2bac942f5 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-28240b54-baeb-46d0-9ddf-2ab2bac942f5 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-28240b54-baeb-46d0-9ddf-2ab2bac942f5 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-28240b54-baeb-46d0-9ddf-2ab2bac942f5 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-28240b54-baeb-46d0-9ddf-2ab2bac942f5 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:54 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:35:54 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:54 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0b84149c-b57a-4591-a645-882646d14301_15ykde60" returned: 0 in 0.461s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0b84149c-b57a-4591-a645-882646d14301_15ykde60 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:55 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff.5ad8760f-ce86-4365-b6ad-b0af4627fcd5" returned: 0 in 0.497s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:55 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:35:55 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7bd03e7a-af04-43bc-a18a-6cbc8de17d83 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Acquiring lock "cinder-b933df99-1d42-4b4d-8936-21d0c278a325-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:35:55 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e71ab65-2fb2-4d23-a185-94cbd2ff58cd]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:35:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:55 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7bd03e7a-af04-43bc-a18a-6cbc8de17d83 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "cinder-b933df99-1d42-4b4d-8936-21d0c278a325-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:35:55 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-28240b54-baeb-46d0-9ddf-2ab2bac942f5 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.301s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:55 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-28240b54-baeb-46d0-9ddf-2ab2bac942f5 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:35:55 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:55 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-28240b54-baeb-46d0-9ddf-2ab2bac942f5 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Deleted volume successfully. Sep 03 14:35:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a33c10d2-db14-4b1a-96da-1d1fd0e5b294 tempest-CreateVolumesFromImageTest-1435429064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c5a20647-0ff1-4fea-a697-fc51e1ccd4d3" returned: 0 in 0.546s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a33c10d2-db14-4b1a-96da-1d1fd0e5b294 tempest-CreateVolumesFromImageTest-1435429064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c5a20647-0ff1-4fea-a697-fc51e1ccd4d3 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:55 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7bd03e7a-af04-43bc-a18a-6cbc8de17d83 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Acquiring lock "cinder-quobyte-b933df99-1d42-4b4d-8936-21d0c278a325" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:35:55 devstack sudo[106712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0b84149c-b57a-4591-a645-882646d14301_15ykde60 Sep 03 14:35:55 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:55 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c5a20647-0ff1-4fea-a697-fc51e1ccd4d3 Sep 03 14:35:55 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:55 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-28240b54-baeb-46d0-9ddf-2ab2bac942f5 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "cinder-42ed77cd-70e2-4dff-9680-3e6699e795bc-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:35:55 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7bd03e7a-af04-43bc-a18a-6cbc8de17d83 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "cinder-quobyte-b933df99-1d42-4b4d-8936-21d0c278a325" acquired by "delete_volume" :: waited 0.031s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:35:55 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff Sep 03 14:35:55 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:55 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bcb72c0-e737-4fd9-aff5-c05f947493a5]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:35:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7bd03e7a-af04-43bc-a18a-6cbc8de17d83 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b933df99-1d42-4b4d-8936-21d0c278a325 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:55 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b933df99-1d42-4b4d-8936-21d0c278a325 Sep 03 14:35:55 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:55 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0b84149c-b57a-4591-a645-882646d14301_15ykde60" returned: 1 in 0.515s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0b84149c-b57a-4591-a645-882646d14301_15ykde60' failed. Not Retrying. {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 14:35:55 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf2f12d-73d7-451f-8cde-96be303b1768]: (4, 'raw') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:35:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0b84149c-b57a-4591-a645-882646d14301_7z3eycvddevstack@QuobyteHD {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:55 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:55 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a33c10d2-db14-4b1a-96da-1d1fd0e5b294 tempest-CreateVolumesFromImageTest-1435429064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-c5a20647-0ff1-4fea-a697-fc51e1ccd4d3" returned: 0 in 0.323s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff" returned: 0 in 0.460s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:55 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff {{(pid=87007) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 14:35:55 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Creating direct copy from snapshot {{(pid=87007) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 14:35:55 devstack cinder-volume[87007]: DEBUG cinder.utils [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Path /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f376b414-fcc8-4afe-b9dc-ad3c44fd3b1c not found in is_blk_device check {{(pid=87007) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 14:35:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f376b414-fcc8-4afe-b9dc-ad3c44fd3b1c {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:55 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a33c10d2-db14-4b1a-96da-1d1fd0e5b294 tempest-CreateVolumesFromImageTest-1435429064 None] Lock "cinder-quobyte-c5a20647-0ff1-4fea-a697-fc51e1ccd4d3" released by "delete_volume" :: held 0.944s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:35:55 devstack sudo[106731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f376b414-fcc8-4afe-b9dc-ad3c44fd3b1c Sep 03 14:35:55 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:55 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-a33c10d2-db14-4b1a-96da-1d1fd0e5b294 tempest-CreateVolumesFromImageTest-1435429064 None] Created reservations ['1a6ef472-2368-4987-814a-159aea4a8168', 'd4a4b927-9e66-46c2-a0f8-72da4e062607', '72836bca-6988-4e30-a4fc-39acb6f00f51', '9db13fa3-e738-49e4-91da-ce503212b502'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:35:55 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0b84149c-b57a-4591-a645-882646d14301_7z3eycvddevstack@QuobyteHD Sep 03 14:35:55 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a33c10d2-db14-4b1a-96da-1d1fd0e5b294 tempest-CreateVolumesFromImageTest-1435429064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a33c10d2-db14-4b1a-96da-1d1fd0e5b294 tempest-CreateVolumesFromImageTest-1435429064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:55 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a33c10d2-db14-4b1a-96da-1d1fd0e5b294 tempest-CreateVolumesFromImageTest-1435429064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:35:55 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:55 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a33c10d2-db14-4b1a-96da-1d1fd0e5b294 tempest-CreateVolumesFromImageTest-1435429064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:35:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a33c10d2-db14-4b1a-96da-1d1fd0e5b294 tempest-CreateVolumesFromImageTest-1435429064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:35:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a33c10d2-db14-4b1a-96da-1d1fd0e5b294 tempest-CreateVolumesFromImageTest-1435429064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7bd03e7a-af04-43bc-a18a-6cbc8de17d83 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b933df99-1d42-4b4d-8936-21d0c278a325" returned: 0 in 0.457s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7bd03e7a-af04-43bc-a18a-6cbc8de17d83 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b933df99-1d42-4b4d-8936-21d0c278a325 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:55 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:35:55 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:55 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b933df99-1d42-4b4d-8936-21d0c278a325 Sep 03 14:35:55 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:55 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0b84149c-b57a-4591-a645-882646d14301_7z3eycvddevstack@QuobyteHD" returned: 0 in 0.416s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b84149c-b57a-4591-a645-882646d14301_7z3eycvddevstack@QuobyteHD {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:56 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7bd03e7a-af04-43bc-a18a-6cbc8de17d83 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b933df99-1d42-4b4d-8936-21d0c278a325" returned: 0 in 0.284s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:56 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a33c10d2-db14-4b1a-96da-1d1fd0e5b294 tempest-CreateVolumesFromImageTest-1435429064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.313s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:56 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-a33c10d2-db14-4b1a-96da-1d1fd0e5b294 tempest-CreateVolumesFromImageTest-1435429064 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:35:56 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7bd03e7a-af04-43bc-a18a-6cbc8de17d83 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "cinder-quobyte-b933df99-1d42-4b4d-8936-21d0c278a325" released by "delete_volume" :: held 0.796s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:35:56 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b84149c-b57a-4591-a645-882646d14301_7z3eycvddevstack@QuobyteHD Sep 03 14:35:56 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:56 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-a33c10d2-db14-4b1a-96da-1d1fd0e5b294 tempest-CreateVolumesFromImageTest-1435429064 None] Deleted volume successfully. Sep 03 14:35:56 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a33c10d2-db14-4b1a-96da-1d1fd0e5b294 tempest-CreateVolumesFromImageTest-1435429064 None] Lock "cinder-c5a20647-0ff1-4fea-a697-fc51e1ccd4d3-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:35:56 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-7bd03e7a-af04-43bc-a18a-6cbc8de17d83 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Created reservations ['07847cdb-ccbb-4e1c-8cbf-3af1f6cc570e', '4a1edbbf-e997-42f4-8c7a-d7a7c5430815', '16e7123a-a3fd-42c0-95eb-6362a65b4209', '179d9203-3d20-44f5-8d42-88a8e9df9a54'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:35:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7bd03e7a-af04-43bc-a18a-6cbc8de17d83 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7bd03e7a-af04-43bc-a18a-6cbc8de17d83 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:56 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-7bd03e7a-af04-43bc-a18a-6cbc8de17d83 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:35:56 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-7bd03e7a-af04-43bc-a18a-6cbc8de17d83 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:35:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7bd03e7a-af04-43bc-a18a-6cbc8de17d83 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:35:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7bd03e7a-af04-43bc-a18a-6cbc8de17d83 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:56 devstack sudo[106757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:35:56 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:56 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a3bc75ee-7a3d-42bc-b2e0-ab8e31442a4b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Acquiring lock "cinder-513a1c47-ce64-4adb-9a81-71ca30bd034a-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:35:56 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a3bc75ee-7a3d-42bc-b2e0-ab8e31442a4b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "cinder-513a1c47-ce64-4adb-9a81-71ca30bd034a-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:35:56 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b84149c-b57a-4591-a645-882646d14301_7z3eycvddevstack@QuobyteHD" returned: 1 in 0.784s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b84149c-b57a-4591-a645-882646d14301_7z3eycvddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 14:35:56 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] 0b84149c-b57a-4591-a645-882646d14301 was raw, converting to qcow2 {{(pid=87007) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 14:35:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0b84149c-b57a-4591-a645-882646d14301_7z3eycvddevstack@QuobyteHD /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dc966e44-944f-491e-8a58-908ff073b597 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:56 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0b84149c-b57a-4591-a645-882646d14301_7z3eycvddevstack@QuobyteHD /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dc966e44-944f-491e-8a58-908ff073b597 Sep 03 14:35:56 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:56 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a3bc75ee-7a3d-42bc-b2e0-ab8e31442a4b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Acquiring lock "cinder-quobyte-513a1c47-ce64-4adb-9a81-71ca30bd034a" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:35:56 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a3bc75ee-7a3d-42bc-b2e0-ab8e31442a4b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "cinder-quobyte-513a1c47-ce64-4adb-9a81-71ca30bd034a" acquired by "delete_volume" :: waited 0.060s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:35:56 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7bd03e7a-af04-43bc-a18a-6cbc8de17d83 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.669s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:56 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-7bd03e7a-af04-43bc-a18a-6cbc8de17d83 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:35:56 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53e282a-31ea-4964-b0be-320523a4ab93]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:35:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a3bc75ee-7a3d-42bc-b2e0-ab8e31442a4b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-513a1c47-ce64-4adb-9a81-71ca30bd034a {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:57 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-7bd03e7a-af04-43bc-a18a-6cbc8de17d83 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Deleted volume successfully. Sep 03 14:35:57 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7bd03e7a-af04-43bc-a18a-6cbc8de17d83 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "cinder-b933df99-1d42-4b4d-8936-21d0c278a325-delete_volume" released by "delete_volume" :: held 1.995s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:35:57 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-513a1c47-ce64-4adb-9a81-71ca30bd034a Sep 03 14:35:57 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:57 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0b84149c-b57a-4591-a645-882646d14301_7z3eycvddevstack@QuobyteHD /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dc966e44-944f-491e-8a58-908ff073b597" returned: 0 in 1.176s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:57 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0b84149c-b57a-4591-a645-882646d14301_7z3eycvddevstack@QuobyteHD, size 0.00 MB, duration 1.18 sec, destination /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dc966e44-944f-491e-8a58-908ff073b597 {{(pid=87007) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 14:35:57 devstack cinder-volume[87007]: INFO cinder.image.image_utils [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Converted 0.00 MB image at 0.00 MB/s Sep 03 14:35:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dc966e44-944f-491e-8a58-908ff073b597 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:57 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dc966e44-944f-491e-8a58-908ff073b597 1G Sep 03 14:35:57 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:58 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a3bc75ee-7a3d-42bc-b2e0-ab8e31442a4b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-513a1c47-ce64-4adb-9a81-71ca30bd034a" returned: 0 in 1.156s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a3bc75ee-7a3d-42bc-b2e0-ab8e31442a4b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-513a1c47-ce64-4adb-9a81-71ca30bd034a {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:58 devstack sudo[106779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-513a1c47-ce64-4adb-9a81-71ca30bd034a Sep 03 14:35:58 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:35:58 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a3bc75ee-7a3d-42bc-b2e0-ab8e31442a4b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-513a1c47-ce64-4adb-9a81-71ca30bd034a" returned: 0 in 0.595s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:58 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a3bc75ee-7a3d-42bc-b2e0-ab8e31442a4b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "cinder-quobyte-513a1c47-ce64-4adb-9a81-71ca30bd034a" released by "delete_volume" :: held 1.879s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:35:58 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Sep 03 14:35:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dc966e44-944f-491e-8a58-908ff073b597 1G" returned: 0 in 1.012s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:35:58 devstack cinder-volume[87007]: DEBUG cinder.volume.volume_utils [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Downloaded image 0b84149c-b57a-4591-a645-882646d14301 ((None, [{'url': 'file:///opt/stack/data/glance/images/0b84149c-b57a-4591-a645-882646d14301', 'metadata': {}}])) to volume dc966e44-944f-491e-8a58-908ff073b597 successfully. {{(pid=87007) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 14:35:58 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Temporary image 0b84149c-b57a-4591-a645-882646d14301 for user 2782a13d8ec846c2ab70f63fe99096bd is deleted. {{(pid=87007) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 14:35:58 devstack cinder-volume[87007]: DEBUG cinder.volume.volume_utils [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Marking volume dc966e44-944f-491e-8a58-908ff073b597 as bootable. {{(pid=87007) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 14:35:58 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Copying metadata from image 0b84149c-b57a-4591-a645-882646d14301 to dc966e44-944f-491e-8a58-908ff073b597. {{(pid=87007) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 14:35:58 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Creating volume glance metadata for volume dc966e44-944f-491e-8a58-908ff073b597 backed by image 0b84149c-b57a-4591-a645-882646d14301 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '0b84149c-b57a-4591-a645-882646d14301', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'f6f9aca2e9b48bc5e5cfc6349c40b045', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87007) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 14:35:59 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-a3bc75ee-7a3d-42bc-b2e0-ab8e31442a4b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Created reservations ['05c18ba2-b837-45b1-a387-84a89fc95516', '52d5adc2-1500-4048-9e44-2ee51d4aa1df', '2211f0de-cdb2-41a6-8cc3-c82a7e0efedd', '75456021-28a6-48ea-8adb-b7d19c5e22a2'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:35:59 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f9e2f0c-7b87-4696-80d7-a17a2edff465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc966e44-944f-491e-8a58-908ff073b597', 'volume_size': 1, 'image_id': '0b84149c-b57a-4591-a645-882646d14301', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0b84149c-b57a-4591-a645-882646d14301', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f6f9aca2e9b48bc5e5cfc6349c40b045', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '702c4f76dc28489cbcbd19d650aea46e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'aecf390b5f3adc6638c988aa34c0ff0a86901e9fda21f557a4a93fb18fad071e7c177785a869cc357a00e7438e38ab4e603667c71a5c2d777f7b47b1fa98b075', 'id': '0b84149c-b57a-4591-a645-882646d14301', 'created_at': datetime.datetime(2026, 9, 3, 12, 35, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 12, 35, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0b84149c-b57a-4591-a645-882646d14301/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:59 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d28d10d8-bba5-4746-b143-211f61a22867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:35:59 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Volume volume-dc966e44-944f-491e-8a58-908ff073b597 (dc966e44-944f-491e-8a58-908ff073b597): created successfully Sep 03 14:35:59 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d28d10d8-bba5-4746-b143-211f61a22867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:35:59 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Flow 'volume_create_manager' (885813a8-1206-4f8e-b7a1-07ec91957423) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:35:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a3bc75ee-7a3d-42bc-b2e0-ab8e31442a4b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:35:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a3bc75ee-7a3d-42bc-b2e0-ab8e31442a4b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:35:59 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a3bc75ee-7a3d-42bc-b2e0-ab8e31442a4b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:35:59 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a3bc75ee-7a3d-42bc-b2e0-ab8e31442a4b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:35:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a3bc75ee-7a3d-42bc-b2e0-ab8e31442a4b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:35:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a3bc75ee-7a3d-42bc-b2e0-ab8e31442a4b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:35:59 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-b2800c4f-6885-449c-9fd8-a21936044e42 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Created volume successfully. Sep 03 14:35:59 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:35:59 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:00 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a3bc75ee-7a3d-42bc-b2e0-ab8e31442a4b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.721s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:00 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-a3bc75ee-7a3d-42bc-b2e0-ab8e31442a4b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:36:00 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-a3bc75ee-7a3d-42bc-b2e0-ab8e31442a4b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Deleted volume successfully. Sep 03 14:36:00 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c941c708-ec56-4f30-ab5d-f96509fe5274 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Acquiring lock "cinder-840c6cd1-f80f-4145-8056-f29d5eca33f5-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:00 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a3bc75ee-7a3d-42bc-b2e0-ab8e31442a4b tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "cinder-513a1c47-ce64-4adb-9a81-71ca30bd034a-delete_volume" released by "delete_volume" :: held 3.725s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:00 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c941c708-ec56-4f30-ab5d-f96509fe5274 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "cinder-840c6cd1-f80f-4145-8056-f29d5eca33f5-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:00 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c941c708-ec56-4f30-ab5d-f96509fe5274 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Acquiring lock "cinder-quobyte-840c6cd1-f80f-4145-8056-f29d5eca33f5" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:00 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c941c708-ec56-4f30-ab5d-f96509fe5274 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "cinder-quobyte-840c6cd1-f80f-4145-8056-f29d5eca33f5" acquired by "delete_volume" :: waited 0.028s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:00 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1f295d-1354-43bf-9329-2b8ee637b382]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c941c708-ec56-4f30-ab5d-f96509fe5274 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-840c6cd1-f80f-4145-8056-f29d5eca33f5 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:00 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b69b0c6a-03e0-47ff-869a-74fb57205d95 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Acquiring lock "cinder-dc966e44-944f-491e-8a58-908ff073b597-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:00 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b69b0c6a-03e0-47ff-869a-74fb57205d95 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Lock "cinder-dc966e44-944f-491e-8a58-908ff073b597-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:00 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-840c6cd1-f80f-4145-8056-f29d5eca33f5 Sep 03 14:36:00 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:00 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b69b0c6a-03e0-47ff-869a-74fb57205d95 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Acquiring lock "cinder-quobyte-dc966e44-944f-491e-8a58-908ff073b597" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:01 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b69b0c6a-03e0-47ff-869a-74fb57205d95 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Lock "cinder-quobyte-dc966e44-944f-491e-8a58-908ff073b597" acquired by "delete_volume" :: waited 0.038s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:01 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a8d4bc-1d5f-442b-bcc8-b9bf4882371e]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b69b0c6a-03e0-47ff-869a-74fb57205d95 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dc966e44-944f-491e-8a58-908ff073b597 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:01 devstack sudo[106790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dc966e44-944f-491e-8a58-908ff073b597 Sep 03 14:36:01 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:01 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c941c708-ec56-4f30-ab5d-f96509fe5274 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-840c6cd1-f80f-4145-8056-f29d5eca33f5" returned: 0 in 0.806s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c941c708-ec56-4f30-ab5d-f96509fe5274 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-840c6cd1-f80f-4145-8056-f29d5eca33f5 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:01 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-840c6cd1-f80f-4145-8056-f29d5eca33f5 Sep 03 14:36:01 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:01 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f376b414-fcc8-4afe-b9dc-ad3c44fd3b1c" returned: 0 in 6.229s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:01 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Image conversion details: src /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff, size 1024.00 MB, duration 6.23 sec, destination /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f376b414-fcc8-4afe-b9dc-ad3c44fd3b1c {{(pid=87007) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 14:36:01 devstack cinder-volume[87007]: INFO cinder.image.image_utils [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Converted 1024.00 MB image at 164.34 MB/s Sep 03 14:36:01 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f376b414-fcc8-4afe-b9dc-ad3c44fd3b1c is being set with open permissions: ugo+rw Sep 03 14:36:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f376b414-fcc8-4afe-b9dc-ad3c44fd3b1c {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:01 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f376b414-fcc8-4afe-b9dc-ad3c44fd3b1c Sep 03 14:36:01 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:01 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b69b0c6a-03e0-47ff-869a-74fb57205d95 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dc966e44-944f-491e-8a58-908ff073b597" returned: 0 in 0.805s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b69b0c6a-03e0-47ff-869a-74fb57205d95 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dc966e44-944f-491e-8a58-908ff073b597 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:01 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c941c708-ec56-4f30-ab5d-f96509fe5274 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-840c6cd1-f80f-4145-8056-f29d5eca33f5" returned: 0 in 0.543s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:01 devstack sudo[106803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dc966e44-944f-491e-8a58-908ff073b597 Sep 03 14:36:01 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:01 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c941c708-ec56-4f30-ab5d-f96509fe5274 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "cinder-quobyte-840c6cd1-f80f-4145-8056-f29d5eca33f5" released by "delete_volume" :: held 1.440s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:02 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-c941c708-ec56-4f30-ab5d-f96509fe5274 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Created reservations ['3e257c59-f102-4ade-a326-6726113ef4aa', '1b2b0a0c-86c1-4ec6-adc4-aa41ecc7d438', 'fbadc3b3-94bd-41c7-b280-012eb6fffe46', 'fc33f82b-ee01-44cb-8cca-d66adeee6a7b'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:36:02 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f376b414-fcc8-4afe-b9dc-ad3c44fd3b1c" returned: 0 in 0.338s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:02 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Lock "cinder-quobyte-f376b414-fcc8-4afe-b9dc-ad3c44fd3b1c" released by "_copy_volume_from_snapshot" :: held 7.700s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c941c708-ec56-4f30-ab5d-f96509fe5274 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c941c708-ec56-4f30-ab5d-f96509fe5274 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:02 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-c941c708-ec56-4f30-ab5d-f96509fe5274 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:36:02 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-c941c708-ec56-4f30-ab5d-f96509fe5274 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:36:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c941c708-ec56-4f30-ab5d-f96509fe5274 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c941c708-ec56-4f30-ab5d-f96509fe5274 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:02 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:36:02 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:02 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Lock "cinder-quobyte-5ad8760f-ce86-4365-b6ad-b0af4627fcd5-f376b414-fcc8-4afe-b9dc-ad3c44fd3b1c" released by "_create_volume_from_snapshot" :: held 7.849s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.904s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:02 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d67aed1-fbc2-40d5-859c-1c4ce61bf67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f376b414-fcc8-4afe-b9dc-ad3c44fd3b1c', 'volume_size': 1, 'snapshot_id': '5ad8760f-ce86-4365-b6ad-b0af4627fcd5'}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:02 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4890a117-3dc8-4077-8896-a2fe0172d631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:02 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b69b0c6a-03e0-47ff-869a-74fb57205d95 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dc966e44-944f-491e-8a58-908ff073b597" returned: 0 in 0.344s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:02 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Volume volume-f376b414-fcc8-4afe-b9dc-ad3c44fd3b1c (f376b414-fcc8-4afe-b9dc-ad3c44fd3b1c): created successfully Sep 03 14:36:02 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4890a117-3dc8-4077-8896-a2fe0172d631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:02 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Flow 'volume_create_manager' (9b6487a9-af53-4d35-8cfb-620ce4526c6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:36:02 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b69b0c6a-03e0-47ff-869a-74fb57205d95 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Lock "cinder-quobyte-dc966e44-944f-491e-8a58-908ff073b597" released by "delete_volume" :: held 1.278s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:02 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-71353e7c-ef35-4f19-b09d-df3124bb8346 tempest-VolumeDependencyTests-868207421 None] Created volume successfully. Sep 03 14:36:02 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-b69b0c6a-03e0-47ff-869a-74fb57205d95 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Created reservations ['bd0872fb-1993-4ba5-867a-b67ab4361d33', 'b213b2c9-e9f0-4dae-acc3-36cb889099ae', '3c148edb-8605-476a-ba07-dd521219ac6a', '7b369dd3-3413-4b7c-9f43-e5981dffcc89'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:36:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b69b0c6a-03e0-47ff-869a-74fb57205d95 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b69b0c6a-03e0-47ff-869a-74fb57205d95 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:02 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b69b0c6a-03e0-47ff-869a-74fb57205d95 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:36:02 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b69b0c6a-03e0-47ff-869a-74fb57205d95 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:36:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b69b0c6a-03e0-47ff-869a-74fb57205d95 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b69b0c6a-03e0-47ff-869a-74fb57205d95 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:02 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c941c708-ec56-4f30-ab5d-f96509fe5274 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.303s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:02 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-c941c708-ec56-4f30-ab5d-f96509fe5274 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:36:02 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-c941c708-ec56-4f30-ab5d-f96509fe5274 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Deleted volume successfully. Sep 03 14:36:02 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:36:02 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:02 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c941c708-ec56-4f30-ab5d-f96509fe5274 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "cinder-840c6cd1-f80f-4145-8056-f29d5eca33f5-delete_volume" released by "delete_volume" :: held 2.087s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:02 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b69b0c6a-03e0-47ff-869a-74fb57205d95 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.260s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:02 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-b69b0c6a-03e0-47ff-869a-74fb57205d95 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:36:02 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-b69b0c6a-03e0-47ff-869a-74fb57205d95 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Deleted volume successfully. Sep 03 14:36:02 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b69b0c6a-03e0-47ff-869a-74fb57205d95 tempest-VolumeAndVolumeTypeFromImageTest-1967453892 None] Lock "cinder-dc966e44-944f-491e-8a58-908ff073b597-delete_volume" released by "delete_volume" :: held 1.919s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:02 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-772e1f3f-6e27-4d8a-aafd-942e2edfe94c tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Acquiring lock "cinder-8ce1c303-b012-4350-b4fa-6ce8e179c2c0-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:02 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-772e1f3f-6e27-4d8a-aafd-942e2edfe94c tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "cinder-8ce1c303-b012-4350-b4fa-6ce8e179c2c0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:02 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-772e1f3f-6e27-4d8a-aafd-942e2edfe94c tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Acquiring lock "cinder-quobyte-8ce1c303-b012-4350-b4fa-6ce8e179c2c0" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:02 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-772e1f3f-6e27-4d8a-aafd-942e2edfe94c tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "cinder-quobyte-8ce1c303-b012-4350-b4fa-6ce8e179c2c0" acquired by "delete_volume" :: waited 0.017s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:02 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2730b7-2ac8-4d43-af88-143ca2c2c103]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-772e1f3f-6e27-4d8a-aafd-942e2edfe94c tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ce1c303-b012-4350-b4fa-6ce8e179c2c0 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:02 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ce1c303-b012-4350-b4fa-6ce8e179c2c0 Sep 03 14:36:02 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd174d0a-d847-4e9c-897b-06ff1c7f1ea4 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-dd174d0a-d847-4e9c-897b-06ff1c7f1ea4 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Flow 'volume_create_manager' (f524c289-3aef-4464-8711-b62a101511d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-dd174d0a-d847-4e9c-897b-06ff1c7f1ea4 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e00dee-5ef3-41ef-9311-e98b72376bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-f7134699-9d91-4764-bf9f-86705915740a tempest-VolumeDependencyTests-868207421 None] Acquiring lock "cinder-5ad8760f-ce86-4365-b6ad-b0af4627fcd5-delete_snapshot" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-dd174d0a-d847-4e9c-897b-06ff1c7f1ea4 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e00dee-5ef3-41ef-9311-e98b72376bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2086120922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a124632-b007-4c13-b628-8570c81d19f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='696a41fa28cd42a19231ef5c6fd021f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:36:03Z,use_quota=True,user_id='54964ed2c3124b11b186dfd55531d31f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-dd174d0a-d847-4e9c-897b-06ff1c7f1ea4 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b65392da-4d15-495f-a0dc-ec31b66d27b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-dd174d0a-d847-4e9c-897b-06ff1c7f1ea4 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b65392da-4d15-495f-a0dc-ec31b66d27b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-dd174d0a-d847-4e9c-897b-06ff1c7f1ea4 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee3b3b7f-62bc-443c-8a2f-86f211ca5931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-dd174d0a-d847-4e9c-897b-06ff1c7f1ea4 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee3b3b7f-62bc-443c-8a2f-86f211ca5931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a124632-b007-4c13-b628-8570c81d19f0', 'volume_name': 'volume-3a124632-b007-4c13-b628-8570c81d19f0', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-dd174d0a-d847-4e9c-897b-06ff1c7f1ea4 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aa0cf23-d63a-42fa-83a7-0cda7a1a66d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-dd174d0a-d847-4e9c-897b-06ff1c7f1ea4 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aa0cf23-d63a-42fa-83a7-0cda7a1a66d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-dd174d0a-d847-4e9c-897b-06ff1c7f1ea4 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8e9b3c8-cdfe-46cf-9684-ebeff409e17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:03 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-dd174d0a-d847-4e9c-897b-06ff1c7f1ea4 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Volume 3a124632-b007-4c13-b628-8570c81d19f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a124632-b007-4c13-b628-8570c81d19f0', 'volume_size': 1} Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-dd174d0a-d847-4e9c-897b-06ff1c7f1ea4 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-dd174d0a-d847-4e9c-897b-06ff1c7f1ea4 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-dd174d0a-d847-4e9c-897b-06ff1c7f1ea4 tempest-CreateVolumesFromSnapshotTest-2050907273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2086120922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a124632-b007-4c13-b628-8570c81d19f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='696a41fa28cd42a19231ef5c6fd021f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:36:03Z,use_quota=True,user_id='54964ed2c3124b11b186dfd55531d31f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-dd174d0a-d847-4e9c-897b-06ff1c7f1ea4 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Creating volume 3a124632-b007-4c13-b628-8570c81d19f0 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-dd174d0a-d847-4e9c-897b-06ff1c7f1ea4 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-dd174d0a-d847-4e9c-897b-06ff1c7f1ea4 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-dd174d0a-d847-4e9c-897b-06ff1c7f1ea4 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-dd174d0a-d847-4e9c-897b-06ff1c7f1ea4 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-dd174d0a-d847-4e9c-897b-06ff1c7f1ea4 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-dd174d0a-d847-4e9c-897b-06ff1c7f1ea4 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:36:03 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-dd174d0a-d847-4e9c-897b-06ff1c7f1ea4 tempest-CreateVolumesFromSnapshotTest-2050907273 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dd174d0a-d847-4e9c-897b-06ff1c7f1ea4 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a124632-b007-4c13-b628-8570c81d19f0 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-f7134699-9d91-4764-bf9f-86705915740a tempest-VolumeDependencyTests-868207421 None] Lock "cinder-5ad8760f-ce86-4365-b6ad-b0af4627fcd5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.096s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-f7134699-9d91-4764-bf9f-86705915740a tempest-VolumeDependencyTests-868207421 None] Acquiring lock "cinder-quobyte-8ca6a53f-4580-4fb2-ad42-85386e9b1dff" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:03 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a124632-b007-4c13-b628-8570c81d19f0 1073741824 Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-f7134699-9d91-4764-bf9f-86705915740a tempest-VolumeDependencyTests-868207421 None] Lock "cinder-quobyte-8ca6a53f-4580-4fb2-ad42-85386e9b1dff" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-f7134699-9d91-4764-bf9f-86705915740a tempest-VolumeDependencyTests-868207421 None] Acquiring lock "cinder-quobyte-5ad8760f-ce86-4365-b6ad-b0af4627fcd5" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:03 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-f7134699-9d91-4764-bf9f-86705915740a tempest-VolumeDependencyTests-868207421 None] Lock "cinder-quobyte-5ad8760f-ce86-4365-b6ad-b0af4627fcd5" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-f7134699-9d91-4764-bf9f-86705915740a tempest-VolumeDependencyTests-868207421 None] Deleting offline snapshot 5ad8760f-ce86-4365-b6ad-b0af4627fcd5 of volume 8ca6a53f-4580-4fb2-ad42-85386e9b1dff {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-f7134699-9d91-4764-bf9f-86705915740a tempest-VolumeDependencyTests-868207421 None] snapshot_file for this snap is: volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff.5ad8760f-ce86-4365-b6ad-b0af4627fcd5 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca451617-c49a-4546-9bec-2d9edf017269]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f7134699-9d91-4764-bf9f-86705915740a tempest-VolumeDependencyTests-868207421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff.5ad8760f-ce86-4365-b6ad-b0af4627fcd5 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:03 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-772e1f3f-6e27-4d8a-aafd-942e2edfe94c tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ce1c303-b012-4350-b4fa-6ce8e179c2c0" returned: 0 in 0.484s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-772e1f3f-6e27-4d8a-aafd-942e2edfe94c tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ce1c303-b012-4350-b4fa-6ce8e179c2c0 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:03 devstack sudo[106821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ce1c303-b012-4350-b4fa-6ce8e179c2c0 Sep 03 14:36:03 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:03 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff.5ad8760f-ce86-4365-b6ad-b0af4627fcd5 Sep 03 14:36:03 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:03 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-772e1f3f-6e27-4d8a-aafd-942e2edfe94c tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ce1c303-b012-4350-b4fa-6ce8e179c2c0" returned: 0 in 0.319s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-772e1f3f-6e27-4d8a-aafd-942e2edfe94c tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "cinder-quobyte-8ce1c303-b012-4350-b4fa-6ce8e179c2c0" released by "delete_volume" :: held 0.860s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:03 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f7134699-9d91-4764-bf9f-86705915740a tempest-VolumeDependencyTests-868207421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff.5ad8760f-ce86-4365-b6ad-b0af4627fcd5" returned: 0 in 0.418s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-f7134699-9d91-4764-bf9f-86705915740a tempest-VolumeDependencyTests-868207421 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ee941d-4b81-493e-ace4-a193301d827c]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f7134699-9d91-4764-bf9f-86705915740a tempest-VolumeDependencyTests-868207421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:03 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dd174d0a-d847-4e9c-897b-06ff1c7f1ea4 tempest-CreateVolumesFromSnapshotTest-2050907273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a124632-b007-4c13-b628-8570c81d19f0 1073741824" returned: 0 in 0.576s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-772e1f3f-6e27-4d8a-aafd-942e2edfe94c tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Created reservations ['39d088b3-d837-47d7-9fb1-f3025b356598', 'b1553d38-02f0-41b5-8a3f-a2ffef409ac6', '76942b60-ca1e-4a8e-8928-4911517604cd', 'f7d9159c-f5a9-4ac1-894a-a7424d3d3e02'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dd174d0a-d847-4e9c-897b-06ff1c7f1ea4 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a124632-b007-4c13-b628-8570c81d19f0 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:03 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a124632-b007-4c13-b628-8570c81d19f0 Sep 03 14:36:03 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:03 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff Sep 03 14:36:03 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-772e1f3f-6e27-4d8a-aafd-942e2edfe94c tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-772e1f3f-6e27-4d8a-aafd-942e2edfe94c tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-772e1f3f-6e27-4d8a-aafd-942e2edfe94c tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-772e1f3f-6e27-4d8a-aafd-942e2edfe94c tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-772e1f3f-6e27-4d8a-aafd-942e2edfe94c tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-772e1f3f-6e27-4d8a-aafd-942e2edfe94c tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:04 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-28612303-2aff-4607-b80c-9520ff33eba0 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Acquiring lock "cinder-b56d3bb1-a5b2-49c3-b653-b38bd464a538-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:04 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:36:04 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:04 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-28612303-2aff-4607-b80c-9520ff33eba0 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "cinder-b56d3bb1-a5b2-49c3-b653-b38bd464a538-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:04 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-28612303-2aff-4607-b80c-9520ff33eba0 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Acquiring lock "cinder-quobyte-b56d3bb1-a5b2-49c3-b653-b38bd464a538" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:04 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-28612303-2aff-4607-b80c-9520ff33eba0 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "cinder-quobyte-b56d3bb1-a5b2-49c3-b653-b38bd464a538" acquired by "delete_volume" :: waited 0.024s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:04 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b22e1f-00f3-4ad9-81e1-466b2a4e703c]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-28612303-2aff-4607-b80c-9520ff33eba0 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b56d3bb1-a5b2-49c3-b653-b38bd464a538 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:04 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b56d3bb1-a5b2-49c3-b653-b38bd464a538 Sep 03 14:36:04 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:04 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-dd174d0a-d847-4e9c-897b-06ff1c7f1ea4 tempest-CreateVolumesFromSnapshotTest-2050907273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a124632-b007-4c13-b628-8570c81d19f0" returned: 0 in 0.532s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:04 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:04 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-dd174d0a-d847-4e9c-897b-06ff1c7f1ea4 tempest-CreateVolumesFromSnapshotTest-2050907273 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:36:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-dd174d0a-d847-4e9c-897b-06ff1c7f1ea4 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-772e1f3f-6e27-4d8a-aafd-942e2edfe94c tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.401s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:04 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-772e1f3f-6e27-4d8a-aafd-942e2edfe94c tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:36:04 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-772e1f3f-6e27-4d8a-aafd-942e2edfe94c tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Deleted volume successfully. Sep 03 14:36:04 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-dd174d0a-d847-4e9c-897b-06ff1c7f1ea4 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8e9b3c8-cdfe-46cf-9684-ebeff409e17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a124632-b007-4c13-b628-8570c81d19f0', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:04 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-dd174d0a-d847-4e9c-897b-06ff1c7f1ea4 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d98994e8-281c-4ab4-a2fe-affa3952432f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:04 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-dd174d0a-d847-4e9c-897b-06ff1c7f1ea4 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Volume volume-3a124632-b007-4c13-b628-8570c81d19f0 (3a124632-b007-4c13-b628-8570c81d19f0): created successfully Sep 03 14:36:04 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-dd174d0a-d847-4e9c-897b-06ff1c7f1ea4 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d98994e8-281c-4ab4-a2fe-affa3952432f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:04 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-dd174d0a-d847-4e9c-897b-06ff1c7f1ea4 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Flow 'volume_create_manager' (f524c289-3aef-4464-8711-b62a101511d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:36:04 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-772e1f3f-6e27-4d8a-aafd-942e2edfe94c tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "cinder-8ce1c303-b012-4350-b4fa-6ce8e179c2c0-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:04 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-dd174d0a-d847-4e9c-897b-06ff1c7f1ea4 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Created volume successfully. Sep 03 14:36:04 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f7134699-9d91-4764-bf9f-86705915740a tempest-VolumeDependencyTests-868207421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff" returned: 0 in 0.805s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f7134699-9d91-4764-bf9f-86705915740a tempest-VolumeDependencyTests-868207421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff.5ad8760f-ce86-4365-b6ad-b0af4627fcd5 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:04 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff.5ad8760f-ce86-4365-b6ad-b0af4627fcd5 Sep 03 14:36:04 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:04 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-28612303-2aff-4607-b80c-9520ff33eba0 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b56d3bb1-a5b2-49c3-b653-b38bd464a538" returned: 0 in 0.454s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-28612303-2aff-4607-b80c-9520ff33eba0 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b56d3bb1-a5b2-49c3-b653-b38bd464a538 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:04 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b56d3bb1-a5b2-49c3-b653-b38bd464a538 Sep 03 14:36:04 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:04 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-28612303-2aff-4607-b80c-9520ff33eba0 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b56d3bb1-a5b2-49c3-b653-b38bd464a538" returned: 0 in 0.265s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:04 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-28612303-2aff-4607-b80c-9520ff33eba0 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "cinder-quobyte-b56d3bb1-a5b2-49c3-b653-b38bd464a538" released by "delete_volume" :: held 0.802s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:04 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f7134699-9d91-4764-bf9f-86705915740a tempest-VolumeDependencyTests-868207421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff.5ad8760f-ce86-4365-b6ad-b0af4627fcd5" returned: 0 in 0.409s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f7134699-9d91-4764-bf9f-86705915740a tempest-VolumeDependencyTests-868207421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff.5ad8760f-ce86-4365-b6ad-b0af4627fcd5 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:04 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-28612303-2aff-4607-b80c-9520ff33eba0 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Created reservations ['d9ef8b25-f80f-4fca-9694-cc3d2a2eda91', '853e1689-6bf1-4fa2-b225-959e613f0213', '9488003b-c60d-4e41-ad66-902310ec372f', 'ac376836-7bff-4133-92fc-9b94e4cd7e6e'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:36:04 devstack sudo[106857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff.5ad8760f-ce86-4365-b6ad-b0af4627fcd5 Sep 03 14:36:04 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-28612303-2aff-4607-b80c-9520ff33eba0 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-28612303-2aff-4607-b80c-9520ff33eba0 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:05 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-28612303-2aff-4607-b80c-9520ff33eba0 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:36:05 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-28612303-2aff-4607-b80c-9520ff33eba0 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:36:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-28612303-2aff-4607-b80c-9520ff33eba0 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-28612303-2aff-4607-b80c-9520ff33eba0 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:05 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:36:05 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:05 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f7134699-9d91-4764-bf9f-86705915740a tempest-VolumeDependencyTests-868207421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff.5ad8760f-ce86-4365-b6ad-b0af4627fcd5" returned: 0 in 0.362s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:05 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-f7134699-9d91-4764-bf9f-86705915740a tempest-VolumeDependencyTests-868207421 None] Lock "cinder-quobyte-5ad8760f-ce86-4365-b6ad-b0af4627fcd5" released by "_delete_snapshot" :: held 2.164s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:05 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-f7134699-9d91-4764-bf9f-86705915740a tempest-VolumeDependencyTests-868207421 None] Lock "cinder-quobyte-8ca6a53f-4580-4fb2-ad42-85386e9b1dff" released by "delete_snapshot" :: held 2.200s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:05 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-28612303-2aff-4607-b80c-9520ff33eba0 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.353s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:05 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-28612303-2aff-4607-b80c-9520ff33eba0 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:36:05 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-28612303-2aff-4607-b80c-9520ff33eba0 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Deleted volume successfully. Sep 03 14:36:05 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-28612303-2aff-4607-b80c-9520ff33eba0 tempest-CreateVolumesFromSourceVolumeTest-1432483410 None] Lock "cinder-b56d3bb1-a5b2-49c3-b653-b38bd464a538-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:05 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-f7134699-9d91-4764-bf9f-86705915740a tempest-VolumeDependencyTests-868207421 None] Created reservations ['913b73eb-74c9-40f3-890a-4b68d0d4cf8f', 'ee98b71a-6236-412b-a283-186dca01c923', '50d2e6a8-804e-490d-b796-7f4f440aa7c9', '27e90738-5419-4cde-8d6d-c10374ec9e04'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:36:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a91ddf1f-4532-498e-b8c8-84f098abc40b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a91ddf1f-4532-498e-b8c8-84f098abc40b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:05 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-a91ddf1f-4532-498e-b8c8-84f098abc40b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Creating offline snapshot df45cdc6-5629-4f30-b9eb-cb7cca8cff93 of volume 3a124632-b007-4c13-b628-8570c81d19f0 {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:36:05 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-f7134699-9d91-4764-bf9f-86705915740a tempest-VolumeDependencyTests-868207421 None] Delete snapshot completed successfully. Sep 03 14:36:05 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-f7134699-9d91-4764-bf9f-86705915740a tempest-VolumeDependencyTests-868207421 None] Lock "cinder-5ad8760f-ce86-4365-b6ad-b0af4627fcd5-delete_snapshot" released by "delete_snapshot" :: held 2.454s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:05 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17b67af-ec1a-4740-a752-5d53986a0224]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a91ddf1f-4532-498e-b8c8-84f098abc40b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a124632-b007-4c13-b628-8570c81d19f0 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:05 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a124632-b007-4c13-b628-8570c81d19f0 Sep 03 14:36:05 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:06 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a91ddf1f-4532-498e-b8c8-84f098abc40b tempest-CreateVolumesFromSnapshotTest-2050907273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a124632-b007-4c13-b628-8570c81d19f0" returned: 0 in 0.421s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a91ddf1f-4532-498e-b8c8-84f098abc40b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a124632-b007-4c13-b628-8570c81d19f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a124632-b007-4c13-b628-8570c81d19f0.df45cdc6-5629-4f30-b9eb-cb7cca8cff93 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:06 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a124632-b007-4c13-b628-8570c81d19f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a124632-b007-4c13-b628-8570c81d19f0.df45cdc6-5629-4f30-b9eb-cb7cca8cff93 1G Sep 03 14:36:06 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:06 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-931111a4-2750-4360-a667-99e907de947a tempest-VolumeDependencyTests-868207421 None] Acquiring lock "cinder-8ca6a53f-4580-4fb2-ad42-85386e9b1dff-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:06 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-931111a4-2750-4360-a667-99e907de947a tempest-VolumeDependencyTests-868207421 None] Lock "cinder-8ca6a53f-4580-4fb2-ad42-85386e9b1dff-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:06 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-931111a4-2750-4360-a667-99e907de947a tempest-VolumeDependencyTests-868207421 None] Acquiring lock "cinder-quobyte-8ca6a53f-4580-4fb2-ad42-85386e9b1dff" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:06 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-931111a4-2750-4360-a667-99e907de947a tempest-VolumeDependencyTests-868207421 None] Lock "cinder-quobyte-8ca6a53f-4580-4fb2-ad42-85386e9b1dff" acquired by "delete_volume" :: waited 0.025s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:06 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fd71b8-e6f3-4372-ba04-24196746e23a]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-931111a4-2750-4360-a667-99e907de947a tempest-VolumeDependencyTests-868207421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:06 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a91ddf1f-4532-498e-b8c8-84f098abc40b tempest-CreateVolumesFromSnapshotTest-2050907273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a124632-b007-4c13-b628-8570c81d19f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a124632-b007-4c13-b628-8570c81d19f0.df45cdc6-5629-4f30-b9eb-cb7cca8cff93 1G" returned: 0 in 0.609s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a91ddf1f-4532-498e-b8c8-84f098abc40b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a124632-b007-4c13-b628-8570c81d19f0 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a124632-b007-4c13-b628-8570c81d19f0.df45cdc6-5629-4f30-b9eb-cb7cca8cff93 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:06 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a124632-b007-4c13-b628-8570c81d19f0 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a124632-b007-4c13-b628-8570c81d19f0.df45cdc6-5629-4f30-b9eb-cb7cca8cff93 Sep 03 14:36:06 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:06 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff Sep 03 14:36:06 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:07 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a91ddf1f-4532-498e-b8c8-84f098abc40b tempest-CreateVolumesFromSnapshotTest-2050907273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a124632-b007-4c13-b628-8570c81d19f0 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a124632-b007-4c13-b628-8570c81d19f0.df45cdc6-5629-4f30-b9eb-cb7cca8cff93" returned: 0 in 0.407s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:07 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-a91ddf1f-4532-498e-b8c8-84f098abc40b tempest-CreateVolumesFromSnapshotTest-2050907273 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a124632-b007-4c13-b628-8570c81d19f0.df45cdc6-5629-4f30-b9eb-cb7cca8cff93 is being set with open permissions: ugo+rw Sep 03 14:36:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a91ddf1f-4532-498e-b8c8-84f098abc40b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a124632-b007-4c13-b628-8570c81d19f0.df45cdc6-5629-4f30-b9eb-cb7cca8cff93 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:07 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-931111a4-2750-4360-a667-99e907de947a tempest-VolumeDependencyTests-868207421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff" returned: 0 in 0.515s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-931111a4-2750-4360-a667-99e907de947a tempest-VolumeDependencyTests-868207421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:07 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a124632-b007-4c13-b628-8570c81d19f0.df45cdc6-5629-4f30-b9eb-cb7cca8cff93 Sep 03 14:36:07 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:07 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff Sep 03 14:36:07 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:07 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a91ddf1f-4532-498e-b8c8-84f098abc40b tempest-CreateVolumesFromSnapshotTest-2050907273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a124632-b007-4c13-b628-8570c81d19f0.df45cdc6-5629-4f30-b9eb-cb7cca8cff93" returned: 0 in 0.285s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a91ddf1f-4532-498e-b8c8-84f098abc40b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a124632-b007-4c13-b628-8570c81d19f0.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:07 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-931111a4-2750-4360-a667-99e907de947a tempest-VolumeDependencyTests-868207421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8ca6a53f-4580-4fb2-ad42-85386e9b1dff" returned: 0 in 0.322s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:07 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a124632-b007-4c13-b628-8570c81d19f0.info Sep 03 14:36:07 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:07 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-931111a4-2750-4360-a667-99e907de947a tempest-VolumeDependencyTests-868207421 None] Lock "cinder-quobyte-8ca6a53f-4580-4fb2-ad42-85386e9b1dff" released by "delete_volume" :: held 0.931s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:07 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-931111a4-2750-4360-a667-99e907de947a tempest-VolumeDependencyTests-868207421 None] Created reservations ['53dc1d4f-145b-4161-8347-ac0622dacf9d', 'b3cdd149-37a9-4105-a313-67c8fd8460e7', '0587b6e6-42db-47ad-a56d-2d3fc6d40549', 'e7631569-cef2-4144-9ffe-bfc27f378572'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:36:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-931111a4-2750-4360-a667-99e907de947a tempest-VolumeDependencyTests-868207421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-931111a4-2750-4360-a667-99e907de947a tempest-VolumeDependencyTests-868207421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:07 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-931111a4-2750-4360-a667-99e907de947a tempest-VolumeDependencyTests-868207421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:36:07 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-931111a4-2750-4360-a667-99e907de947a tempest-VolumeDependencyTests-868207421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:36:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-931111a4-2750-4360-a667-99e907de947a tempest-VolumeDependencyTests-868207421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-931111a4-2750-4360-a667-99e907de947a tempest-VolumeDependencyTests-868207421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:07 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:36:07 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:07 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a91ddf1f-4532-498e-b8c8-84f098abc40b tempest-CreateVolumesFromSnapshotTest-2050907273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a124632-b007-4c13-b628-8570c81d19f0.info" returned: 0 in 0.326s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:07 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-a91ddf1f-4532-498e-b8c8-84f098abc40b tempest-CreateVolumesFromSnapshotTest-2050907273 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a124632-b007-4c13-b628-8570c81d19f0.info is being set with open permissions: ugo+rw Sep 03 14:36:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a91ddf1f-4532-498e-b8c8-84f098abc40b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a124632-b007-4c13-b628-8570c81d19f0.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:07 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a124632-b007-4c13-b628-8570c81d19f0.info Sep 03 14:36:07 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:07 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-931111a4-2750-4360-a667-99e907de947a tempest-VolumeDependencyTests-868207421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.293s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:07 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-931111a4-2750-4360-a667-99e907de947a tempest-VolumeDependencyTests-868207421 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:36:07 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-931111a4-2750-4360-a667-99e907de947a tempest-VolumeDependencyTests-868207421 None] Deleted volume successfully. Sep 03 14:36:08 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-931111a4-2750-4360-a667-99e907de947a tempest-VolumeDependencyTests-868207421 None] Lock "cinder-8ca6a53f-4580-4fb2-ad42-85386e9b1dff-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:08 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a91ddf1f-4532-498e-b8c8-84f098abc40b tempest-CreateVolumesFromSnapshotTest-2050907273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a124632-b007-4c13-b628-8570c81d19f0.info" returned: 0 in 0.295s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a91ddf1f-4532-498e-b8c8-84f098abc40b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.464s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:08 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-a91ddf1f-4532-498e-b8c8-84f098abc40b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Create snapshot completed successfully Sep 03 14:36:08 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-eecd16f0-8ef3-4dd9-b70c-e3a034781456 tempest-VolumeDependencyTests-868207421 None] Acquiring lock "cinder-f376b414-fcc8-4afe-b9dc-ad3c44fd3b1c-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:08 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-eecd16f0-8ef3-4dd9-b70c-e3a034781456 tempest-VolumeDependencyTests-868207421 None] Lock "cinder-f376b414-fcc8-4afe-b9dc-ad3c44fd3b1c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:08 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-eecd16f0-8ef3-4dd9-b70c-e3a034781456 tempest-VolumeDependencyTests-868207421 None] Acquiring lock "cinder-quobyte-f376b414-fcc8-4afe-b9dc-ad3c44fd3b1c" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:08 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-eecd16f0-8ef3-4dd9-b70c-e3a034781456 tempest-VolumeDependencyTests-868207421 None] Lock "cinder-quobyte-f376b414-fcc8-4afe-b9dc-ad3c44fd3b1c" acquired by "delete_volume" :: waited 0.020s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:08 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b54e56d-a840-48da-8ea0-c917bcbf2a70]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eecd16f0-8ef3-4dd9-b70c-e3a034781456 tempest-VolumeDependencyTests-868207421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f376b414-fcc8-4afe-b9dc-ad3c44fd3b1c {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:08 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f376b414-fcc8-4afe-b9dc-ad3c44fd3b1c Sep 03 14:36:08 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:09 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eecd16f0-8ef3-4dd9-b70c-e3a034781456 tempest-VolumeDependencyTests-868207421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f376b414-fcc8-4afe-b9dc-ad3c44fd3b1c" returned: 0 in 0.489s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eecd16f0-8ef3-4dd9-b70c-e3a034781456 tempest-VolumeDependencyTests-868207421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f376b414-fcc8-4afe-b9dc-ad3c44fd3b1c {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:09 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f376b414-fcc8-4afe-b9dc-ad3c44fd3b1c Sep 03 14:36:09 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:09 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eecd16f0-8ef3-4dd9-b70c-e3a034781456 tempest-VolumeDependencyTests-868207421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f376b414-fcc8-4afe-b9dc-ad3c44fd3b1c" returned: 0 in 0.315s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:09 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-eecd16f0-8ef3-4dd9-b70c-e3a034781456 tempest-VolumeDependencyTests-868207421 None] Lock "cinder-quobyte-f376b414-fcc8-4afe-b9dc-ad3c44fd3b1c" released by "delete_volume" :: held 0.865s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:09 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-eecd16f0-8ef3-4dd9-b70c-e3a034781456 tempest-VolumeDependencyTests-868207421 None] Created reservations ['9977ccd7-1323-4acd-a667-cc9ec9f0fdc8', 'ceeda89b-b5f2-42f9-97ed-7ff9b4d16ad9', 'dcceacc4-7b9d-450c-a364-872cda5cbc24', 'a7735336-a329-4702-8c7a-c2b130017eb0'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:36:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-eecd16f0-8ef3-4dd9-b70c-e3a034781456 tempest-VolumeDependencyTests-868207421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-eecd16f0-8ef3-4dd9-b70c-e3a034781456 tempest-VolumeDependencyTests-868207421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:09 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-eecd16f0-8ef3-4dd9-b70c-e3a034781456 tempest-VolumeDependencyTests-868207421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:36:09 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-eecd16f0-8ef3-4dd9-b70c-e3a034781456 tempest-VolumeDependencyTests-868207421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:36:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-eecd16f0-8ef3-4dd9-b70c-e3a034781456 tempest-VolumeDependencyTests-868207421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eecd16f0-8ef3-4dd9-b70c-e3a034781456 tempest-VolumeDependencyTests-868207421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:09 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:36:09 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:09 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-db646f52-e1f1-4577-8b6e-a2811c1b2450 tempest-ProjectMemberTests-1350538287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:36:09 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-db646f52-e1f1-4577-8b6e-a2811c1b2450 tempest-ProjectMemberTests-1350538287 None] Flow 'volume_create_manager' (9fc7116e-4fb0-4d28-85e5-495e749a4ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:36:09 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-db646f52-e1f1-4577-8b6e-a2811c1b2450 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58af9b41-a94b-478b-bdfa-e95f55971d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:09 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-db646f52-e1f1-4577-8b6e-a2811c1b2450 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58af9b41-a94b-478b-bdfa-e95f55971d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1953718636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b066235a-72b7-42d2-8b07-5d7ef1d7bcfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bdc07719fdf40189d19adf3cf793220',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:36:10Z,use_quota=True,user_id='c0e0fc3b02a64f5b9b037ade3f94a724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:09 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-db646f52-e1f1-4577-8b6e-a2811c1b2450 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c3213fd-5ef3-4580-98d2-26c269d12892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:09 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-db646f52-e1f1-4577-8b6e-a2811c1b2450 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c3213fd-5ef3-4580-98d2-26c269d12892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:09 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-db646f52-e1f1-4577-8b6e-a2811c1b2450 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03881f8a-16ad-45c2-8599-594fe81af6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-db646f52-e1f1-4577-8b6e-a2811c1b2450 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03881f8a-16ad-45c2-8599-594fe81af6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b066235a-72b7-42d2-8b07-5d7ef1d7bcfb', 'volume_name': 'volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-db646f52-e1f1-4577-8b6e-a2811c1b2450 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79fc532f-3a2b-4d64-a104-ffe308f579f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-db646f52-e1f1-4577-8b6e-a2811c1b2450 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79fc532f-3a2b-4d64-a104-ffe308f579f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-db646f52-e1f1-4577-8b6e-a2811c1b2450 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47ef82c5-eb31-42ca-af3e-337d147234c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:10 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-db646f52-e1f1-4577-8b6e-a2811c1b2450 tempest-ProjectMemberTests-1350538287 None] Volume b066235a-72b7-42d2-8b07-5d7ef1d7bcfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb', 'volume_size': 1} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-db646f52-e1f1-4577-8b6e-a2811c1b2450 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-db646f52-e1f1-4577-8b6e-a2811c1b2450 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-db646f52-e1f1-4577-8b6e-a2811c1b2450 tempest-ProjectMemberTests-1350538287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1953718636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b066235a-72b7-42d2-8b07-5d7ef1d7bcfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bdc07719fdf40189d19adf3cf793220',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:36:10Z,use_quota=True,user_id='c0e0fc3b02a64f5b9b037ade3f94a724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-db646f52-e1f1-4577-8b6e-a2811c1b2450 tempest-ProjectMemberTests-1350538287 None] Creating volume b066235a-72b7-42d2-8b07-5d7ef1d7bcfb {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-db646f52-e1f1-4577-8b6e-a2811c1b2450 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-db646f52-e1f1-4577-8b6e-a2811c1b2450 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-db646f52-e1f1-4577-8b6e-a2811c1b2450 tempest-ProjectMemberTests-1350538287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-db646f52-e1f1-4577-8b6e-a2811c1b2450 tempest-ProjectMemberTests-1350538287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-db646f52-e1f1-4577-8b6e-a2811c1b2450 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-db646f52-e1f1-4577-8b6e-a2811c1b2450 tempest-ProjectMemberTests-1350538287 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:36:10 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-db646f52-e1f1-4577-8b6e-a2811c1b2450 tempest-ProjectMemberTests-1350538287 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-db646f52-e1f1-4577-8b6e-a2811c1b2450 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:10 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb 1073741824 Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-06545229-4765-4a22-ba54-932db54955a0 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:36:10 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-06545229-4765-4a22-ba54-932db54955a0 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Flow 'volume_create_manager' (14b386dd-a3b5-41d2-9c8d-22eddc2fe081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-06545229-4765-4a22-ba54-932db54955a0 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28b8265e-bba5-4cb5-9803-0bb26cf0b7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-06545229-4765-4a22-ba54-932db54955a0 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28b8265e-bba5-4cb5-9803-0bb26cf0b7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-772518956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=932da1d5-4629-417e-8fda-41a2a09e236c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='696a41fa28cd42a19231ef5c6fd021f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:36:10Z,use_quota=True,user_id='54964ed2c3124b11b186dfd55531d31f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-06545229-4765-4a22-ba54-932db54955a0 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dafb1aed-fa22-4a36-bb44-2b10872df98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-06545229-4765-4a22-ba54-932db54955a0 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dafb1aed-fa22-4a36-bb44-2b10872df98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-06545229-4765-4a22-ba54-932db54955a0 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f5bd56f-b5b5-4b02-8cb9-dce89551a9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-06545229-4765-4a22-ba54-932db54955a0 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f5bd56f-b5b5-4b02-8cb9-dce89551a9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '932da1d5-4629-417e-8fda-41a2a09e236c', 'volume_name': 'volume-932da1d5-4629-417e-8fda-41a2a09e236c', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-06545229-4765-4a22-ba54-932db54955a0 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02b787f8-6d87-4004-b35a-df26614d89f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-06545229-4765-4a22-ba54-932db54955a0 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02b787f8-6d87-4004-b35a-df26614d89f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-06545229-4765-4a22-ba54-932db54955a0 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67caaff7-2278-4d82-9736-deb7eb9252e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:10 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-06545229-4765-4a22-ba54-932db54955a0 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Volume 932da1d5-4629-417e-8fda-41a2a09e236c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-932da1d5-4629-417e-8fda-41a2a09e236c', 'volume_size': 1} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-06545229-4765-4a22-ba54-932db54955a0 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-b657384f-3e1d-4441-9f25-25ad53cc8f43 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b657384f-3e1d-4441-9f25-25ad53cc8f43 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Flow 'volume_create_manager' (c62d9eb9-2409-4b06-bbd4-fd3a21776ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:36:10 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b657384f-3e1d-4441-9f25-25ad53cc8f43 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a227d57-8d7d-47c6-91d5-7529a934c1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eecd16f0-8ef3-4dd9-b70c-e3a034781456 tempest-VolumeDependencyTests-868207421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.589s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-eecd16f0-8ef3-4dd9-b70c-e3a034781456 tempest-VolumeDependencyTests-868207421 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:36:10 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-eecd16f0-8ef3-4dd9-b70c-e3a034781456 tempest-VolumeDependencyTests-868207421 None] Deleted volume successfully. Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b657384f-3e1d-4441-9f25-25ad53cc8f43 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a227d57-8d7d-47c6-91d5-7529a934c1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1205830224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df437fe5-25b5-416b-a624-173b19c74295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='696a41fa28cd42a19231ef5c6fd021f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:36:10Z,use_quota=True,user_id='54964ed2c3124b11b186dfd55531d31f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b657384f-3e1d-4441-9f25-25ad53cc8f43 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b63af90e-4b90-40ca-934e-9fdd36df3e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b657384f-3e1d-4441-9f25-25ad53cc8f43 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b63af90e-4b90-40ca-934e-9fdd36df3e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b657384f-3e1d-4441-9f25-25ad53cc8f43 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dfafff1-0184-4762-aadc-3f9c8b857a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b657384f-3e1d-4441-9f25-25ad53cc8f43 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dfafff1-0184-4762-aadc-3f9c8b857a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df437fe5-25b5-416b-a624-173b19c74295', 'volume_name': 'volume-df437fe5-25b5-416b-a624-173b19c74295', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b657384f-3e1d-4441-9f25-25ad53cc8f43 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c2cac34-22c5-431a-8fea-20cf4165d3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b657384f-3e1d-4441-9f25-25ad53cc8f43 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c2cac34-22c5-431a-8fea-20cf4165d3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b657384f-3e1d-4441-9f25-25ad53cc8f43 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cade57e-2fc5-4936-ae3c-5f27fd380690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:10 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-b657384f-3e1d-4441-9f25-25ad53cc8f43 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Volume df437fe5-25b5-416b-a624-173b19c74295: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df437fe5-25b5-416b-a624-173b19c74295', 'volume_size': 1} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b657384f-3e1d-4441-9f25-25ad53cc8f43 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-eecd16f0-8ef3-4dd9-b70c-e3a034781456 tempest-VolumeDependencyTests-868207421 None] Lock "cinder-f376b414-fcc8-4afe-b9dc-ad3c44fd3b1c-delete_volume" released by "delete_volume" :: held 1.858s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-5427fd10-d8e8-4a12-8619-16706a125e1b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5427fd10-d8e8-4a12-8619-16706a125e1b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Flow 'volume_create_manager' (2dcbb064-af0c-406e-982b-b3557993ea4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5427fd10-d8e8-4a12-8619-16706a125e1b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31ae467e-fbc6-4b9a-ab39-d3e527f0ae87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5427fd10-d8e8-4a12-8619-16706a125e1b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31ae467e-fbc6-4b9a-ab39-d3e527f0ae87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-823995269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41a6fb0f-fd5c-4f76-b3e6-82d60287b19f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='696a41fa28cd42a19231ef5c6fd021f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:36:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:36:11Z,use_quota=True,user_id='54964ed2c3124b11b186dfd55531d31f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5427fd10-d8e8-4a12-8619-16706a125e1b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (febf3620-45a4-4628-b828-6e7ed7dbebd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5427fd10-d8e8-4a12-8619-16706a125e1b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (febf3620-45a4-4628-b828-6e7ed7dbebd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5427fd10-d8e8-4a12-8619-16706a125e1b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62fc0415-fbaa-48e6-9ddf-18d676d9e553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5427fd10-d8e8-4a12-8619-16706a125e1b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62fc0415-fbaa-48e6-9ddf-18d676d9e553) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41a6fb0f-fd5c-4f76-b3e6-82d60287b19f', 'volume_name': 'volume-41a6fb0f-fd5c-4f76-b3e6-82d60287b19f', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5427fd10-d8e8-4a12-8619-16706a125e1b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc8c3a42-8a64-462c-a329-f498782c0efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5427fd10-d8e8-4a12-8619-16706a125e1b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc8c3a42-8a64-462c-a329-f498782c0efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5427fd10-d8e8-4a12-8619-16706a125e1b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (161fad6b-cb5a-47dc-bd97-487cc8fb0e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:10 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-5427fd10-d8e8-4a12-8619-16706a125e1b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Volume 41a6fb0f-fd5c-4f76-b3e6-82d60287b19f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41a6fb0f-fd5c-4f76-b3e6-82d60287b19f', 'volume_size': 1} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-5427fd10-d8e8-4a12-8619-16706a125e1b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:10 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-db646f52-e1f1-4577-8b6e-a2811c1b2450 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb 1073741824" returned: 0 in 0.793s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-db646f52-e1f1-4577-8b6e-a2811c1b2450 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:10 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb Sep 03 14:36:10 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:11 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6e1663e-8b3c-4e3d-922a-d5d64fbe293e tempest-CreateVolumesFromSnapshotTest-2050907273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:36:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d6e1663e-8b3c-4e3d-922a-d5d64fbe293e tempest-CreateVolumesFromSnapshotTest-2050907273 None] Flow 'volume_create_manager' (32cc3d90-85ad-4d78-aab1-89213bbb2b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:36:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d6e1663e-8b3c-4e3d-922a-d5d64fbe293e tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3bcbf4d-9962-4660-9014-39debb6d7c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d6e1663e-8b3c-4e3d-922a-d5d64fbe293e tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3bcbf4d-9962-4660-9014-39debb6d7c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:36:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-572245227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cc5563d-a6e2-44fa-9eb0-af48013c6431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='696a41fa28cd42a19231ef5c6fd021f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:36:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:36:11Z,use_quota=True,user_id='54964ed2c3124b11b186dfd55531d31f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d6e1663e-8b3c-4e3d-922a-d5d64fbe293e tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d919b78-add1-4f4a-8173-014ea5ac9c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d6e1663e-8b3c-4e3d-922a-d5d64fbe293e tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d919b78-add1-4f4a-8173-014ea5ac9c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d6e1663e-8b3c-4e3d-922a-d5d64fbe293e tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d319cc-dbbd-42c7-8c29-f3781a5ec18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d6e1663e-8b3c-4e3d-922a-d5d64fbe293e tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d319cc-dbbd-42c7-8c29-f3781a5ec18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cc5563d-a6e2-44fa-9eb0-af48013c6431', 'volume_name': 'volume-8cc5563d-a6e2-44fa-9eb0-af48013c6431', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:11 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d6e1663e-8b3c-4e3d-922a-d5d64fbe293e tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c3615d5-deb7-41da-adae-322b7b39ca03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d6e1663e-8b3c-4e3d-922a-d5d64fbe293e tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c3615d5-deb7-41da-adae-322b7b39ca03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d6e1663e-8b3c-4e3d-922a-d5d64fbe293e tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85d56caa-8189-4c6f-858c-2a720140ef5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:11 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-d6e1663e-8b3c-4e3d-922a-d5d64fbe293e tempest-CreateVolumesFromSnapshotTest-2050907273 None] Volume 8cc5563d-a6e2-44fa-9eb0-af48013c6431: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cc5563d-a6e2-44fa-9eb0-af48013c6431', 'volume_size': 1} Sep 03 14:36:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d6e1663e-8b3c-4e3d-922a-d5d64fbe293e tempest-CreateVolumesFromSnapshotTest-2050907273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-db646f52-e1f1-4577-8b6e-a2811c1b2450 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb" returned: 0 in 0.360s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:11 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-db646f52-e1f1-4577-8b6e-a2811c1b2450 tempest-ProjectMemberTests-1350538287 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:36:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-db646f52-e1f1-4577-8b6e-a2811c1b2450 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-06545229-4765-4a22-ba54-932db54955a0 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.053s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:11 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-06545229-4765-4a22-ba54-932db54955a0 tempest-CreateVolumesFromSnapshotTest-2050907273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-772518956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=932da1d5-4629-417e-8fda-41a2a09e236c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='696a41fa28cd42a19231ef5c6fd021f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:36:10Z,use_quota=True,user_id='54964ed2c3124b11b186dfd55531d31f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:36:11 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-06545229-4765-4a22-ba54-932db54955a0 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Creating volume 932da1d5-4629-417e-8fda-41a2a09e236c {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:36:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-06545229-4765-4a22-ba54-932db54955a0 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-06545229-4765-4a22-ba54-932db54955a0 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:11 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-06545229-4765-4a22-ba54-932db54955a0 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:36:11 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-06545229-4765-4a22-ba54-932db54955a0 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:36:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-06545229-4765-4a22-ba54-932db54955a0 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:11 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-06545229-4765-4a22-ba54-932db54955a0 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:36:11 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-06545229-4765-4a22-ba54-932db54955a0 tempest-CreateVolumesFromSnapshotTest-2050907273 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:36:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-06545229-4765-4a22-ba54-932db54955a0 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-932da1d5-4629-417e-8fda-41a2a09e236c 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-db646f52-e1f1-4577-8b6e-a2811c1b2450 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47ef82c5-eb31-42ca-af3e-337d147234c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-db646f52-e1f1-4577-8b6e-a2811c1b2450 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5b107af-d411-4e42-b97e-2889cd616334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:11 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-932da1d5-4629-417e-8fda-41a2a09e236c 1073741824 Sep 03 14:36:11 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:11 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-db646f52-e1f1-4577-8b6e-a2811c1b2450 tempest-ProjectMemberTests-1350538287 None] Volume volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb (b066235a-72b7-42d2-8b07-5d7ef1d7bcfb): created successfully Sep 03 14:36:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-db646f52-e1f1-4577-8b6e-a2811c1b2450 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5b107af-d411-4e42-b97e-2889cd616334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-db646f52-e1f1-4577-8b6e-a2811c1b2450 tempest-ProjectMemberTests-1350538287 None] Flow 'volume_create_manager' (9fc7116e-4fb0-4d28-85e5-495e749a4ea9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:36:11 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-db646f52-e1f1-4577-8b6e-a2811c1b2450 tempest-ProjectMemberTests-1350538287 None] Created volume successfully. Sep 03 14:36:11 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-b146bcee-2ad6-4ba5-b5d7-f75b820604aa tempest-CreateVolumesFromSnapshotTest-2050907273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:36:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b146bcee-2ad6-4ba5-b5d7-f75b820604aa tempest-CreateVolumesFromSnapshotTest-2050907273 None] Flow 'volume_create_manager' (32b95305-47d4-4031-8fa6-ac8526aa0659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:36:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b146bcee-2ad6-4ba5-b5d7-f75b820604aa tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8df110bb-d5a5-4013-99c2-2bbe76c6fa10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b146bcee-2ad6-4ba5-b5d7-f75b820604aa tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8df110bb-d5a5-4013-99c2-2bbe76c6fa10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:36:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1906055560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14e89a63-1533-431a-9174-5f69835246cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='696a41fa28cd42a19231ef5c6fd021f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:36:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:36:12Z,use_quota=True,user_id='54964ed2c3124b11b186dfd55531d31f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b146bcee-2ad6-4ba5-b5d7-f75b820604aa tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (158082a6-4eb1-4f4b-826f-6d1023b72b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b146bcee-2ad6-4ba5-b5d7-f75b820604aa tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (158082a6-4eb1-4f4b-826f-6d1023b72b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b146bcee-2ad6-4ba5-b5d7-f75b820604aa tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ea2054d-88a5-4e3f-b7d6-21ad1e20aebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b146bcee-2ad6-4ba5-b5d7-f75b820604aa tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ea2054d-88a5-4e3f-b7d6-21ad1e20aebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14e89a63-1533-431a-9174-5f69835246cd', 'volume_name': 'volume-14e89a63-1533-431a-9174-5f69835246cd', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b146bcee-2ad6-4ba5-b5d7-f75b820604aa tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06808de4-8eca-4a18-b6cc-b972ba50c8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b146bcee-2ad6-4ba5-b5d7-f75b820604aa tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06808de4-8eca-4a18-b6cc-b972ba50c8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b146bcee-2ad6-4ba5-b5d7-f75b820604aa tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fae6cb74-56f5-4eb9-a852-0ac33d2a71c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:11 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-b146bcee-2ad6-4ba5-b5d7-f75b820604aa tempest-CreateVolumesFromSnapshotTest-2050907273 None] Volume 14e89a63-1533-431a-9174-5f69835246cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14e89a63-1533-431a-9174-5f69835246cd', 'volume_size': 1} Sep 03 14:36:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b146bcee-2ad6-4ba5-b5d7-f75b820604aa tempest-CreateVolumesFromSnapshotTest-2050907273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:11 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-06545229-4765-4a22-ba54-932db54955a0 tempest-CreateVolumesFromSnapshotTest-2050907273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-932da1d5-4629-417e-8fda-41a2a09e236c 1073741824" returned: 0 in 0.681s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-06545229-4765-4a22-ba54-932db54955a0 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-932da1d5-4629-417e-8fda-41a2a09e236c {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:12 devstack sudo[106932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-932da1d5-4629-417e-8fda-41a2a09e236c Sep 03 14:36:12 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:12 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-06545229-4765-4a22-ba54-932db54955a0 tempest-CreateVolumesFromSnapshotTest-2050907273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-932da1d5-4629-417e-8fda-41a2a09e236c" returned: 0 in 0.338s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:12 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-06545229-4765-4a22-ba54-932db54955a0 tempest-CreateVolumesFromSnapshotTest-2050907273 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:36:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-06545229-4765-4a22-ba54-932db54955a0 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b657384f-3e1d-4441-9f25-25ad53cc8f43 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.758s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:12 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b657384f-3e1d-4441-9f25-25ad53cc8f43 tempest-CreateVolumesFromSnapshotTest-2050907273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1205830224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df437fe5-25b5-416b-a624-173b19c74295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='696a41fa28cd42a19231ef5c6fd021f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:36:10Z,use_quota=True,user_id='54964ed2c3124b11b186dfd55531d31f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:36:12 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-b657384f-3e1d-4441-9f25-25ad53cc8f43 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Creating volume df437fe5-25b5-416b-a624-173b19c74295 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:36:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b657384f-3e1d-4441-9f25-25ad53cc8f43 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b657384f-3e1d-4441-9f25-25ad53cc8f43 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:12 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b657384f-3e1d-4441-9f25-25ad53cc8f43 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:36:12 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b657384f-3e1d-4441-9f25-25ad53cc8f43 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:36:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b657384f-3e1d-4441-9f25-25ad53cc8f43 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:12 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b657384f-3e1d-4441-9f25-25ad53cc8f43 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:36:12 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-b657384f-3e1d-4441-9f25-25ad53cc8f43 tempest-CreateVolumesFromSnapshotTest-2050907273 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:36:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b657384f-3e1d-4441-9f25-25ad53cc8f43 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-df437fe5-25b5-416b-a624-173b19c74295 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:12 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-06545229-4765-4a22-ba54-932db54955a0 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67caaff7-2278-4d82-9736-deb7eb9252e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-932da1d5-4629-417e-8fda-41a2a09e236c', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:12 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-06545229-4765-4a22-ba54-932db54955a0 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dc6b85a-36af-43b2-8f37-08bb9e58c430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:12 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-df437fe5-25b5-416b-a624-173b19c74295 1073741824 Sep 03 14:36:12 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:12 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-06545229-4765-4a22-ba54-932db54955a0 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Volume volume-932da1d5-4629-417e-8fda-41a2a09e236c (932da1d5-4629-417e-8fda-41a2a09e236c): created successfully Sep 03 14:36:12 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-06545229-4765-4a22-ba54-932db54955a0 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dc6b85a-36af-43b2-8f37-08bb9e58c430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:12 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-06545229-4765-4a22-ba54-932db54955a0 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Flow 'volume_create_manager' (14b386dd-a3b5-41d2-9c8d-22eddc2fe081) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:36:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-18a6889d-162c-4ec9-a060-2e69e74e6ae8 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:12 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-06545229-4765-4a22-ba54-932db54955a0 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Created volume successfully. Sep 03 14:36:12 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b657384f-3e1d-4441-9f25-25ad53cc8f43 tempest-CreateVolumesFromSnapshotTest-2050907273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-df437fe5-25b5-416b-a624-173b19c74295 1073741824" returned: 0 in 0.622s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b657384f-3e1d-4441-9f25-25ad53cc8f43 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-df437fe5-25b5-416b-a624-173b19c74295 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:13 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-df437fe5-25b5-416b-a624-173b19c74295 Sep 03 14:36:13 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:13 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:36:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Flow 'volume_create_manager' (f248d347-33c6-486b-9fee-c9c1a5e3c657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:36:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03e1a284-a312-461b-91bd-293c2478ec11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03e1a284-a312-461b-91bd-293c2478ec11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:36:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b9b39fe-3eaf-4cad-808a-3c126558a8e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fac0890f307b4fc8bde71b44bd4d8aa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:36:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:36:13Z,use_quota=True,user_id='c6b8400395394890827d4f0bcd267f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db1a09b3-a4ea-40f6-97fb-01c9d716dace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db1a09b3-a4ea-40f6-97fb-01c9d716dace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58eebd85-3ce0-4683-b904-c9b1d4f0fe22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:13 devstack cinder-volume[87007]: DEBUG cinder.image.glance [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Creating Keystone auth plugin from conf {{(pid=87007) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 14:36:13 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b657384f-3e1d-4441-9f25-25ad53cc8f43 tempest-CreateVolumesFromSnapshotTest-2050907273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-df437fe5-25b5-416b-a624-173b19c74295" returned: 0 in 0.328s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:13 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b657384f-3e1d-4441-9f25-25ad53cc8f43 tempest-CreateVolumesFromSnapshotTest-2050907273 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:36:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b657384f-3e1d-4441-9f25-25ad53cc8f43 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-5427fd10-d8e8-4a12-8619-16706a125e1b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.592s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:13 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-5427fd10-d8e8-4a12-8619-16706a125e1b tempest-CreateVolumesFromSnapshotTest-2050907273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-823995269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41a6fb0f-fd5c-4f76-b3e6-82d60287b19f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='696a41fa28cd42a19231ef5c6fd021f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:36:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:36:11Z,use_quota=True,user_id='54964ed2c3124b11b186dfd55531d31f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:36:13 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-5427fd10-d8e8-4a12-8619-16706a125e1b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Creating volume 41a6fb0f-fd5c-4f76-b3e6-82d60287b19f {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:36:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-5427fd10-d8e8-4a12-8619-16706a125e1b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-5427fd10-d8e8-4a12-8619-16706a125e1b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:13 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-5427fd10-d8e8-4a12-8619-16706a125e1b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:36:13 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-5427fd10-d8e8-4a12-8619-16706a125e1b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:36:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-5427fd10-d8e8-4a12-8619-16706a125e1b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:13 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-5427fd10-d8e8-4a12-8619-16706a125e1b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:36:13 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-5427fd10-d8e8-4a12-8619-16706a125e1b tempest-CreateVolumesFromSnapshotTest-2050907273 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:36:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5427fd10-d8e8-4a12-8619-16706a125e1b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-41a6fb0f-fd5c-4f76-b3e6-82d60287b19f 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:13 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-41a6fb0f-fd5c-4f76-b3e6-82d60287b19f 1073741824 Sep 03 14:36:13 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b657384f-3e1d-4441-9f25-25ad53cc8f43 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cade57e-2fc5-4936-ae3c-5f27fd380690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df437fe5-25b5-416b-a624-173b19c74295', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b657384f-3e1d-4441-9f25-25ad53cc8f43 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b09ede2-49ea-41fd-8e23-e4937065c002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:13 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-b657384f-3e1d-4441-9f25-25ad53cc8f43 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Volume volume-df437fe5-25b5-416b-a624-173b19c74295 (df437fe5-25b5-416b-a624-173b19c74295): created successfully Sep 03 14:36:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b657384f-3e1d-4441-9f25-25ad53cc8f43 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b09ede2-49ea-41fd-8e23-e4937065c002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b657384f-3e1d-4441-9f25-25ad53cc8f43 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Flow 'volume_create_manager' (c62d9eb9-2409-4b06-bbd4-fd3a21776ec6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:36:13 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-b657384f-3e1d-4441-9f25-25ad53cc8f43 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Created volume successfully. Sep 03 14:36:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58eebd85-3ce0-4683-b904-c9b1d4f0fe22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8b9b39fe-3eaf-4cad-808a-3c126558a8e0', 'volume_name': 'volume-8b9b39fe-3eaf-4cad-808a-3c126558a8e0', 'volume_size': 1, 'image_id': '613dce03-e064-4ac6-b0ce-f0c0dacea1b1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/613dce03-e064-4ac6-b0ce-f0c0dacea1b1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '97a3878f136334447c051decf912044d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fac0890f307b4fc8bde71b44bd4d8aa5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ffcdfe2fd72bdcabb4a856c3ae6d1abe3abe9a8044702f9e36d3a6d9a375badb0ac6b40c0487464d1d283e073f114251c250881d2926dd971f9b9942fcc1b8e7', 'id': '613dce03-e064-4ac6-b0ce-f0c0dacea1b1', 'created_at': datetime.datetime(2026, 9, 3, 12, 36, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 12, 36, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/613dce03-e064-4ac6-b0ce-f0c0dacea1b1/file', 'properties': {}}, 'image_service': }' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf655d03-5398-4872-915d-8c13d01dfadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf655d03-5398-4872-915d-8c13d01dfadf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:13 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e713b7f3-1aca-4acd-a55b-5d7707df98b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:13 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Volume 8b9b39fe-3eaf-4cad-808a-3c126558a8e0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8b9b39fe-3eaf-4cad-808a-3c126558a8e0', 'volume_size': 1, 'image_id': '613dce03-e064-4ac6-b0ce-f0c0dacea1b1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/613dce03-e064-4ac6-b0ce-f0c0dacea1b1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '97a3878f136334447c051decf912044d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fac0890f307b4fc8bde71b44bd4d8aa5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ffcdfe2fd72bdcabb4a856c3ae6d1abe3abe9a8044702f9e36d3a6d9a375badb0ac6b40c0487464d1d283e073f114251c250881d2926dd971f9b9942fcc1b8e7', 'id': '613dce03-e064-4ac6-b0ce-f0c0dacea1b1', 'created_at': datetime.datetime(2026, 9, 3, 12, 36, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 12, 36, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/613dce03-e064-4ac6-b0ce-f0c0dacea1b1/file', 'properties': {}}, 'image_service': } Sep 03 14:36:13 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Trying to clone 8b9b39fe-3eaf-4cad-808a-3c126558a8e0 from image 613dce03-e064-4ac6-b0ce-f0c0dacea1b1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/613dce03-e064-4ac6-b0ce-f0c0dacea1b1', 'metadata': {}}]). {{(pid=87007) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 14:36:13 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_613dce03-e064-4ac6-b0ce-f0c0dacea1b1_vr3qyaw5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87007) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 14:36:13 devstack cinder-volume[87007]: INFO cinder.image.image_utils [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Image download 0.00 MB at 0.00 MB/s Sep 03 14:36:13 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e3be81-a9be-4366-b737-1eeb50cc2c0f]: (4, 'raw') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_613dce03-e064-4ac6-b0ce-f0c0dacea1b1_vr3qyaw5devstack@QuobyteHD {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:13 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5427fd10-d8e8-4a12-8619-16706a125e1b tempest-CreateVolumesFromSnapshotTest-2050907273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-41a6fb0f-fd5c-4f76-b3e6-82d60287b19f 1073741824" returned: 0 in 0.567s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:13 devstack sudo[106985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_613dce03-e064-4ac6-b0ce-f0c0dacea1b1_vr3qyaw5devstack@QuobyteHD Sep 03 14:36:13 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5427fd10-d8e8-4a12-8619-16706a125e1b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-41a6fb0f-fd5c-4f76-b3e6-82d60287b19f {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:14 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-41a6fb0f-fd5c-4f76-b3e6-82d60287b19f Sep 03 14:36:14 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:14 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-cca848c6-720d-4946-a0e8-6389eece026b tempest-CinderUnicodeTest-2026399211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:36:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cca848c6-720d-4946-a0e8-6389eece026b tempest-CinderUnicodeTest-2026399211 None] Flow 'volume_create_manager' (14a77212-b579-40ba-971d-84479d75297b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:36:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cca848c6-720d-4946-a0e8-6389eece026b tempest-CinderUnicodeTest-2026399211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa6f13d8-72a0-4215-b582-bbb65e036f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cca848c6-720d-4946-a0e8-6389eece026b tempest-CinderUnicodeTest-2026399211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa6f13d8-72a0-4215-b582-bbb65e036f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:36:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c53f9ce-a137-49aa-9bfe-07e86c6f34b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3417d5f000444b3896cfd9dfd6df793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:36:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:36:14Z,use_quota=True,user_id='4eb287f555fb44799554f055e6852cf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cca848c6-720d-4946-a0e8-6389eece026b tempest-CinderUnicodeTest-2026399211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e12959a0-e544-43ed-81ff-f51ff23ba03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cca848c6-720d-4946-a0e8-6389eece026b tempest-CinderUnicodeTest-2026399211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e12959a0-e544-43ed-81ff-f51ff23ba03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cca848c6-720d-4946-a0e8-6389eece026b tempest-CinderUnicodeTest-2026399211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4f76fa6-bab1-493f-a8f8-59ccf238d936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cca848c6-720d-4946-a0e8-6389eece026b tempest-CinderUnicodeTest-2026399211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4f76fa6-bab1-493f-a8f8-59ccf238d936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c53f9ce-a137-49aa-9bfe-07e86c6f34b8', 'volume_name': 'volume-5c53f9ce-a137-49aa-9bfe-07e86c6f34b8', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cca848c6-720d-4946-a0e8-6389eece026b tempest-CinderUnicodeTest-2026399211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9234d25d-3d8b-4e80-a95a-8b102f401f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cca848c6-720d-4946-a0e8-6389eece026b tempest-CinderUnicodeTest-2026399211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9234d25d-3d8b-4e80-a95a-8b102f401f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cca848c6-720d-4946-a0e8-6389eece026b tempest-CinderUnicodeTest-2026399211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad8a7d01-54ef-450d-8b38-f723cdc69e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:14 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-cca848c6-720d-4946-a0e8-6389eece026b tempest-CinderUnicodeTest-2026399211 None] Volume 5c53f9ce-a137-49aa-9bfe-07e86c6f34b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c53f9ce-a137-49aa-9bfe-07e86c6f34b8', 'volume_size': 1} Sep 03 14:36:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-cca848c6-720d-4946-a0e8-6389eece026b tempest-CinderUnicodeTest-2026399211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:14 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_613dce03-e064-4ac6-b0ce-f0c0dacea1b1_vr3qyaw5devstack@QuobyteHD" returned: 0 in 0.413s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_613dce03-e064-4ac6-b0ce-f0c0dacea1b1_vr3qyaw5devstack@QuobyteHD {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:14 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5427fd10-d8e8-4a12-8619-16706a125e1b tempest-CreateVolumesFromSnapshotTest-2050907273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-41a6fb0f-fd5c-4f76-b3e6-82d60287b19f" returned: 0 in 0.329s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-5427fd10-d8e8-4a12-8619-16706a125e1b tempest-CreateVolumesFromSnapshotTest-2050907273 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:36:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-5427fd10-d8e8-4a12-8619-16706a125e1b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d6e1663e-8b3c-4e3d-922a-d5d64fbe293e tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.122s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d6e1663e-8b3c-4e3d-922a-d5d64fbe293e tempest-CreateVolumesFromSnapshotTest-2050907273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:36:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-572245227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cc5563d-a6e2-44fa-9eb0-af48013c6431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='696a41fa28cd42a19231ef5c6fd021f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:36:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:36:11Z,use_quota=True,user_id='54964ed2c3124b11b186dfd55531d31f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:36:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-d6e1663e-8b3c-4e3d-922a-d5d64fbe293e tempest-CreateVolumesFromSnapshotTest-2050907273 None] Creating volume 8cc5563d-a6e2-44fa-9eb0-af48013c6431 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:36:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d6e1663e-8b3c-4e3d-922a-d5d64fbe293e tempest-CreateVolumesFromSnapshotTest-2050907273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d6e1663e-8b3c-4e3d-922a-d5d64fbe293e tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d6e1663e-8b3c-4e3d-922a-d5d64fbe293e tempest-CreateVolumesFromSnapshotTest-2050907273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:36:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d6e1663e-8b3c-4e3d-922a-d5d64fbe293e tempest-CreateVolumesFromSnapshotTest-2050907273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:36:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d6e1663e-8b3c-4e3d-922a-d5d64fbe293e tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d6e1663e-8b3c-4e3d-922a-d5d64fbe293e tempest-CreateVolumesFromSnapshotTest-2050907273 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:36:14 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-d6e1663e-8b3c-4e3d-922a-d5d64fbe293e tempest-CreateVolumesFromSnapshotTest-2050907273 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:36:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d6e1663e-8b3c-4e3d-922a-d5d64fbe293e tempest-CreateVolumesFromSnapshotTest-2050907273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8cc5563d-a6e2-44fa-9eb0-af48013c6431 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5427fd10-d8e8-4a12-8619-16706a125e1b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (161fad6b-cb5a-47dc-bd97-487cc8fb0e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41a6fb0f-fd5c-4f76-b3e6-82d60287b19f', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5427fd10-d8e8-4a12-8619-16706a125e1b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38399721-fb81-40a1-ad61-c5e4f9cc87d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:14 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8cc5563d-a6e2-44fa-9eb0-af48013c6431 1073741824 Sep 03 14:36:14 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:14 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_613dce03-e064-4ac6-b0ce-f0c0dacea1b1_vr3qyaw5devstack@QuobyteHD Sep 03 14:36:14 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:14 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-5427fd10-d8e8-4a12-8619-16706a125e1b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Volume volume-41a6fb0f-fd5c-4f76-b3e6-82d60287b19f (41a6fb0f-fd5c-4f76-b3e6-82d60287b19f): created successfully Sep 03 14:36:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5427fd10-d8e8-4a12-8619-16706a125e1b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38399721-fb81-40a1-ad61-c5e4f9cc87d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-5427fd10-d8e8-4a12-8619-16706a125e1b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Flow 'volume_create_manager' (2dcbb064-af0c-406e-982b-b3557993ea4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:36:14 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-5427fd10-d8e8-4a12-8619-16706a125e1b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Created volume successfully. Sep 03 14:36:14 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_613dce03-e064-4ac6-b0ce-f0c0dacea1b1_vr3qyaw5devstack@QuobyteHD" returned: 1 in 0.343s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_613dce03-e064-4ac6-b0ce-f0c0dacea1b1_vr3qyaw5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 14:36:14 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Temporary image 613dce03-e064-4ac6-b0ce-f0c0dacea1b1 is fetched for user c6b8400395394890827d4f0bcd267f32. {{(pid=87007) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 14:36:14 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e1b4a5-d2bf-4b52-a32b-3c784b2a429e]: (4, 'raw') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_613dce03-e064-4ac6-b0ce-f0c0dacea1b1_vr3qyaw5devstack@QuobyteHD {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:14 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d6e1663e-8b3c-4e3d-922a-d5d64fbe293e tempest-CreateVolumesFromSnapshotTest-2050907273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8cc5563d-a6e2-44fa-9eb0-af48013c6431 1073741824" returned: 0 in 0.436s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:14 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_613dce03-e064-4ac6-b0ce-f0c0dacea1b1_vr3qyaw5devstack@QuobyteHD Sep 03 14:36:14 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d6e1663e-8b3c-4e3d-922a-d5d64fbe293e tempest-CreateVolumesFromSnapshotTest-2050907273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8cc5563d-a6e2-44fa-9eb0-af48013c6431 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:14 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8cc5563d-a6e2-44fa-9eb0-af48013c6431 Sep 03 14:36:14 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:15 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_613dce03-e064-4ac6-b0ce-f0c0dacea1b1_vr3qyaw5devstack@QuobyteHD" returned: 0 in 0.380s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_613dce03-e064-4ac6-b0ce-f0c0dacea1b1_vr3qyaw5devstack@QuobyteHD {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:15 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d6e1663e-8b3c-4e3d-922a-d5d64fbe293e tempest-CreateVolumesFromSnapshotTest-2050907273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8cc5563d-a6e2-44fa-9eb0-af48013c6431" returned: 0 in 0.262s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:15 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d6e1663e-8b3c-4e3d-922a-d5d64fbe293e tempest-CreateVolumesFromSnapshotTest-2050907273 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:36:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d6e1663e-8b3c-4e3d-922a-d5d64fbe293e tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b146bcee-2ad6-4ba5-b5d7-f75b820604aa tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.221s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:15 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b146bcee-2ad6-4ba5-b5d7-f75b820604aa tempest-CreateVolumesFromSnapshotTest-2050907273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:36:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1906055560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14e89a63-1533-431a-9174-5f69835246cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='696a41fa28cd42a19231ef5c6fd021f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:36:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:36:12Z,use_quota=True,user_id='54964ed2c3124b11b186dfd55531d31f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:36:15 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-b146bcee-2ad6-4ba5-b5d7-f75b820604aa tempest-CreateVolumesFromSnapshotTest-2050907273 None] Creating volume 14e89a63-1533-431a-9174-5f69835246cd {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:36:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b146bcee-2ad6-4ba5-b5d7-f75b820604aa tempest-CreateVolumesFromSnapshotTest-2050907273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b146bcee-2ad6-4ba5-b5d7-f75b820604aa tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:15 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b146bcee-2ad6-4ba5-b5d7-f75b820604aa tempest-CreateVolumesFromSnapshotTest-2050907273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:36:15 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b146bcee-2ad6-4ba5-b5d7-f75b820604aa tempest-CreateVolumesFromSnapshotTest-2050907273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:36:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b146bcee-2ad6-4ba5-b5d7-f75b820604aa tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:15 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b146bcee-2ad6-4ba5-b5d7-f75b820604aa tempest-CreateVolumesFromSnapshotTest-2050907273 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:36:15 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-b146bcee-2ad6-4ba5-b5d7-f75b820604aa tempest-CreateVolumesFromSnapshotTest-2050907273 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:36:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b146bcee-2ad6-4ba5-b5d7-f75b820604aa tempest-CreateVolumesFromSnapshotTest-2050907273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-14e89a63-1533-431a-9174-5f69835246cd 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:15 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d6e1663e-8b3c-4e3d-922a-d5d64fbe293e tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85d56caa-8189-4c6f-858c-2a720140ef5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cc5563d-a6e2-44fa-9eb0-af48013c6431', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:15 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-14e89a63-1533-431a-9174-5f69835246cd 1073741824 Sep 03 14:36:15 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:15 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d6e1663e-8b3c-4e3d-922a-d5d64fbe293e tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (959cce8c-b354-4afa-a325-c5d3aa0e26f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:15 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-d6e1663e-8b3c-4e3d-922a-d5d64fbe293e tempest-CreateVolumesFromSnapshotTest-2050907273 None] Volume volume-8cc5563d-a6e2-44fa-9eb0-af48013c6431 (8cc5563d-a6e2-44fa-9eb0-af48013c6431): created successfully Sep 03 14:36:15 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d6e1663e-8b3c-4e3d-922a-d5d64fbe293e tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (959cce8c-b354-4afa-a325-c5d3aa0e26f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:15 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d6e1663e-8b3c-4e3d-922a-d5d64fbe293e tempest-CreateVolumesFromSnapshotTest-2050907273 None] Flow 'volume_create_manager' (32cc3d90-85ad-4d78-aab1-89213bbb2b3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:36:15 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-d6e1663e-8b3c-4e3d-922a-d5d64fbe293e tempest-CreateVolumesFromSnapshotTest-2050907273 None] Created volume successfully. Sep 03 14:36:15 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_613dce03-e064-4ac6-b0ce-f0c0dacea1b1_vr3qyaw5devstack@QuobyteHD Sep 03 14:36:15 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:15 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_613dce03-e064-4ac6-b0ce-f0c0dacea1b1_vr3qyaw5devstack@QuobyteHD" returned: 1 in 0.367s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_613dce03-e064-4ac6-b0ce-f0c0dacea1b1_vr3qyaw5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 14:36:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:15 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b146bcee-2ad6-4ba5-b5d7-f75b820604aa tempest-CreateVolumesFromSnapshotTest-2050907273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-14e89a63-1533-431a-9174-5f69835246cd 1073741824" returned: 0 in 0.442s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b146bcee-2ad6-4ba5-b5d7-f75b820604aa tempest-CreateVolumesFromSnapshotTest-2050907273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-14e89a63-1533-431a-9174-5f69835246cd {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:15 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-14e89a63-1533-431a-9174-5f69835246cd Sep 03 14:36:15 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:15 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b146bcee-2ad6-4ba5-b5d7-f75b820604aa tempest-CreateVolumesFromSnapshotTest-2050907273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-14e89a63-1533-431a-9174-5f69835246cd" returned: 0 in 0.247s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:15 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b146bcee-2ad6-4ba5-b5d7-f75b820604aa tempest-CreateVolumesFromSnapshotTest-2050907273 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:36:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b146bcee-2ad6-4ba5-b5d7-f75b820604aa tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-18a6889d-162c-4ec9-a060-2e69e74e6ae8 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.397s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:15 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b146bcee-2ad6-4ba5-b5d7-f75b820604aa tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fae6cb74-56f5-4eb9-a852-0ac33d2a71c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14e89a63-1533-431a-9174-5f69835246cd', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:15 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b146bcee-2ad6-4ba5-b5d7-f75b820604aa tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e09a04da-8170-4117-8d6c-24666ab7c1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:15 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-18a6889d-162c-4ec9-a060-2e69e74e6ae8 tempest-ProjectMemberTests-1350538287 None] Creating offline snapshot 5eb9d359-0052-43fa-98d1-14829d8932d3 of volume b066235a-72b7-42d2-8b07-5d7ef1d7bcfb {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:36:15 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-b146bcee-2ad6-4ba5-b5d7-f75b820604aa tempest-CreateVolumesFromSnapshotTest-2050907273 None] Volume volume-14e89a63-1533-431a-9174-5f69835246cd (14e89a63-1533-431a-9174-5f69835246cd): created successfully Sep 03 14:36:15 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b146bcee-2ad6-4ba5-b5d7-f75b820604aa tempest-CreateVolumesFromSnapshotTest-2050907273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e09a04da-8170-4117-8d6c-24666ab7c1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:15 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b146bcee-2ad6-4ba5-b5d7-f75b820604aa tempest-CreateVolumesFromSnapshotTest-2050907273 None] Flow 'volume_create_manager' (32b95305-47d4-4031-8fa6-ac8526aa0659) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:36:15 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[991b892e-9048-49db-8d92-a96ac8282d5c]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-18a6889d-162c-4ec9-a060-2e69e74e6ae8 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:15 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-b146bcee-2ad6-4ba5-b5d7-f75b820604aa tempest-CreateVolumesFromSnapshotTest-2050907273 None] Created volume successfully. Sep 03 14:36:16 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb Sep 03 14:36:16 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:16 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7e09e151-f5e5-45d1-8490-8646d52df672 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Acquiring lock "cinder-14e89a63-1533-431a-9174-5f69835246cd-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:16 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7e09e151-f5e5-45d1-8490-8646d52df672 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "cinder-14e89a63-1533-431a-9174-5f69835246cd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:16 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7e09e151-f5e5-45d1-8490-8646d52df672 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Acquiring lock "cinder-quobyte-14e89a63-1533-431a-9174-5f69835246cd" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:16 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7e09e151-f5e5-45d1-8490-8646d52df672 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "cinder-quobyte-14e89a63-1533-431a-9174-5f69835246cd" acquired by "delete_volume" :: waited 0.015s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:16 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f145f3b-4659-4f81-926c-cacc634ec978]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7e09e151-f5e5-45d1-8490-8646d52df672 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-14e89a63-1533-431a-9174-5f69835246cd {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:16 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-18a6889d-162c-4ec9-a060-2e69e74e6ae8 tempest-ProjectMemberTests-1350538287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb" returned: 0 in 0.398s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-18a6889d-162c-4ec9-a060-2e69e74e6ae8 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb.5eb9d359-0052-43fa-98d1-14829d8932d3 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:16 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb.5eb9d359-0052-43fa-98d1-14829d8932d3 1G Sep 03 14:36:16 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:16 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-14e89a63-1533-431a-9174-5f69835246cd Sep 03 14:36:16 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:16 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7e09e151-f5e5-45d1-8490-8646d52df672 tempest-CreateVolumesFromSnapshotTest-2050907273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-14e89a63-1533-431a-9174-5f69835246cd" returned: 0 in 0.385s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7e09e151-f5e5-45d1-8490-8646d52df672 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-14e89a63-1533-431a-9174-5f69835246cd {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:16 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-14e89a63-1533-431a-9174-5f69835246cd Sep 03 14:36:16 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:16 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-18a6889d-162c-4ec9-a060-2e69e74e6ae8 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb.5eb9d359-0052-43fa-98d1-14829d8932d3 1G" returned: 0 in 0.422s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-18a6889d-162c-4ec9-a060-2e69e74e6ae8 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb.5eb9d359-0052-43fa-98d1-14829d8932d3 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:16 devstack sudo[107042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb.5eb9d359-0052-43fa-98d1-14829d8932d3 Sep 03 14:36:16 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:16 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7e09e151-f5e5-45d1-8490-8646d52df672 tempest-CreateVolumesFromSnapshotTest-2050907273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-14e89a63-1533-431a-9174-5f69835246cd" returned: 0 in 0.272s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:16 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7e09e151-f5e5-45d1-8490-8646d52df672 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "cinder-quobyte-14e89a63-1533-431a-9174-5f69835246cd" released by "delete_volume" :: held 0.705s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:16 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-7e09e151-f5e5-45d1-8490-8646d52df672 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Created reservations ['c5ffe377-aa24-4b00-96d1-eb469272738e', 'e3bb4454-0428-41b1-983b-1b6be4188990', 'b5a70918-6d8e-4c47-b72e-02c6948d4488', '4e7247fd-cf07-4883-908f-b581c113e948'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:36:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7e09e151-f5e5-45d1-8490-8646d52df672 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7e09e151-f5e5-45d1-8490-8646d52df672 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:17 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-7e09e151-f5e5-45d1-8490-8646d52df672 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:36:17 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:17 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-7e09e151-f5e5-45d1-8490-8646d52df672 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:36:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7e09e151-f5e5-45d1-8490-8646d52df672 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7e09e151-f5e5-45d1-8490-8646d52df672 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-18a6889d-162c-4ec9-a060-2e69e74e6ae8 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb.5eb9d359-0052-43fa-98d1-14829d8932d3" returned: 0 in 0.330s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:17 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-18a6889d-162c-4ec9-a060-2e69e74e6ae8 tempest-ProjectMemberTests-1350538287 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb.5eb9d359-0052-43fa-98d1-14829d8932d3 is being set with open permissions: ugo+rw Sep 03 14:36:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-18a6889d-162c-4ec9-a060-2e69e74e6ae8 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb.5eb9d359-0052-43fa-98d1-14829d8932d3 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:17 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:36:17 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:17 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb.5eb9d359-0052-43fa-98d1-14829d8932d3 Sep 03 14:36:17 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:17 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c8d7bc81-b4dc-4333-847d-ef777850abed tempest-CreateVolumesFromSnapshotTest-2050907273 None] Acquiring lock "cinder-8cc5563d-a6e2-44fa-9eb0-af48013c6431-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:17 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:17 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-18a6889d-162c-4ec9-a060-2e69e74e6ae8 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb.5eb9d359-0052-43fa-98d1-14829d8932d3" returned: 0 in 0.285s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7e09e151-f5e5-45d1-8490-8646d52df672 tempest-CreateVolumesFromSnapshotTest-2050907273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.305s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:17 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-7e09e151-f5e5-45d1-8490-8646d52df672 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:36:17 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c8d7bc81-b4dc-4333-847d-ef777850abed tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "cinder-8cc5563d-a6e2-44fa-9eb0-af48013c6431-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:17 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-7e09e151-f5e5-45d1-8490-8646d52df672 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Deleted volume successfully. Sep 03 14:36:17 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7e09e151-f5e5-45d1-8490-8646d52df672 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "cinder-14e89a63-1533-431a-9174-5f69835246cd-delete_volume" released by "delete_volume" :: held 1.246s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-18a6889d-162c-4ec9-a060-2e69e74e6ae8 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:17 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c8d7bc81-b4dc-4333-847d-ef777850abed tempest-CreateVolumesFromSnapshotTest-2050907273 None] Acquiring lock "cinder-quobyte-8cc5563d-a6e2-44fa-9eb0-af48013c6431" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:17 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb.info Sep 03 14:36:17 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:17 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c8d7bc81-b4dc-4333-847d-ef777850abed tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "cinder-quobyte-8cc5563d-a6e2-44fa-9eb0-af48013c6431" acquired by "delete_volume" :: waited 0.016s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:17 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36b4df9-faad-4caa-8f9a-c3a4fb493dc8]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c8d7bc81-b4dc-4333-847d-ef777850abed tempest-CreateVolumesFromSnapshotTest-2050907273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8cc5563d-a6e2-44fa-9eb0-af48013c6431 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:17 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8cc5563d-a6e2-44fa-9eb0-af48013c6431 Sep 03 14:36:17 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:17 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-18a6889d-162c-4ec9-a060-2e69e74e6ae8 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb.info" returned: 0 in 0.266s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:17 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-18a6889d-162c-4ec9-a060-2e69e74e6ae8 tempest-ProjectMemberTests-1350538287 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb.info is being set with open permissions: ugo+rw Sep 03 14:36:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-18a6889d-162c-4ec9-a060-2e69e74e6ae8 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:17 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb.info Sep 03 14:36:17 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:17 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c8d7bc81-b4dc-4333-847d-ef777850abed tempest-CreateVolumesFromSnapshotTest-2050907273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8cc5563d-a6e2-44fa-9eb0-af48013c6431" returned: 0 in 0.359s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c8d7bc81-b4dc-4333-847d-ef777850abed tempest-CreateVolumesFromSnapshotTest-2050907273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8cc5563d-a6e2-44fa-9eb0-af48013c6431 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:17 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8cc5563d-a6e2-44fa-9eb0-af48013c6431 Sep 03 14:36:17 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:17 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-18a6889d-162c-4ec9-a060-2e69e74e6ae8 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb.info" returned: 0 in 0.248s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-18a6889d-162c-4ec9-a060-2e69e74e6ae8 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.096s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-cca848c6-720d-4946-a0e8-6389eece026b tempest-CinderUnicodeTest-2026399211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.678s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:17 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-cca848c6-720d-4946-a0e8-6389eece026b tempest-CinderUnicodeTest-2026399211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:36:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c53f9ce-a137-49aa-9bfe-07e86c6f34b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3417d5f000444b3896cfd9dfd6df793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:36:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:36:14Z,use_quota=True,user_id='4eb287f555fb44799554f055e6852cf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:36:17 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-cca848c6-720d-4946-a0e8-6389eece026b tempest-CinderUnicodeTest-2026399211 None] Creating volume 5c53f9ce-a137-49aa-9bfe-07e86c6f34b8 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:36:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-cca848c6-720d-4946-a0e8-6389eece026b tempest-CinderUnicodeTest-2026399211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-cca848c6-720d-4946-a0e8-6389eece026b tempest-CinderUnicodeTest-2026399211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:17 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-cca848c6-720d-4946-a0e8-6389eece026b tempest-CinderUnicodeTest-2026399211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:36:17 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-cca848c6-720d-4946-a0e8-6389eece026b tempest-CinderUnicodeTest-2026399211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:36:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-cca848c6-720d-4946-a0e8-6389eece026b tempest-CinderUnicodeTest-2026399211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:17 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-cca848c6-720d-4946-a0e8-6389eece026b tempest-CinderUnicodeTest-2026399211 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:36:17 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-cca848c6-720d-4946-a0e8-6389eece026b tempest-CinderUnicodeTest-2026399211 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:36:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-cca848c6-720d-4946-a0e8-6389eece026b tempest-CinderUnicodeTest-2026399211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c53f9ce-a137-49aa-9bfe-07e86c6f34b8 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:17 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c53f9ce-a137-49aa-9bfe-07e86c6f34b8 1073741824 Sep 03 14:36:17 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:17 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-18a6889d-162c-4ec9-a060-2e69e74e6ae8 tempest-ProjectMemberTests-1350538287 None] Create snapshot completed successfully Sep 03 14:36:18 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c8d7bc81-b4dc-4333-847d-ef777850abed tempest-CreateVolumesFromSnapshotTest-2050907273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8cc5563d-a6e2-44fa-9eb0-af48013c6431" returned: 0 in 0.263s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:18 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c8d7bc81-b4dc-4333-847d-ef777850abed tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "cinder-quobyte-8cc5563d-a6e2-44fa-9eb0-af48013c6431" released by "delete_volume" :: held 0.667s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:18 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-c8d7bc81-b4dc-4333-847d-ef777850abed tempest-CreateVolumesFromSnapshotTest-2050907273 None] Created reservations ['30715ac6-61c0-461e-abdf-137782870295', '8368b584-8330-47e1-aa01-0fbf7c838c60', '05e437d5-f77f-4c23-b1ff-a10705538f7e', 'cc711816-b525-4328-a4a3-a734caeab499'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:36:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c8d7bc81-b4dc-4333-847d-ef777850abed tempest-CreateVolumesFromSnapshotTest-2050907273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c8d7bc81-b4dc-4333-847d-ef777850abed tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:18 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-c8d7bc81-b4dc-4333-847d-ef777850abed tempest-CreateVolumesFromSnapshotTest-2050907273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:36:18 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-c8d7bc81-b4dc-4333-847d-ef777850abed tempest-CreateVolumesFromSnapshotTest-2050907273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:36:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c8d7bc81-b4dc-4333-847d-ef777850abed tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c8d7bc81-b4dc-4333-847d-ef777850abed tempest-CreateVolumesFromSnapshotTest-2050907273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:18 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:36:18 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:18 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-cca848c6-720d-4946-a0e8-6389eece026b tempest-CinderUnicodeTest-2026399211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c53f9ce-a137-49aa-9bfe-07e86c6f34b8 1073741824" returned: 0 in 0.479s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-cca848c6-720d-4946-a0e8-6389eece026b tempest-CinderUnicodeTest-2026399211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c53f9ce-a137-49aa-9bfe-07e86c6f34b8 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:18 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c53f9ce-a137-49aa-9bfe-07e86c6f34b8 Sep 03 14:36:18 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1867e7e3-5acf-47d0-bbc9-c7443a823a27 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Acquiring lock "cinder-41a6fb0f-fd5c-4f76-b3e6-82d60287b19f-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:18 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:18 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c8d7bc81-b4dc-4333-847d-ef777850abed tempest-CreateVolumesFromSnapshotTest-2050907273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.279s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:18 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-c8d7bc81-b4dc-4333-847d-ef777850abed tempest-CreateVolumesFromSnapshotTest-2050907273 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:36:18 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-c8d7bc81-b4dc-4333-847d-ef777850abed tempest-CreateVolumesFromSnapshotTest-2050907273 None] Deleted volume successfully. Sep 03 14:36:18 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1867e7e3-5acf-47d0-bbc9-c7443a823a27 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "cinder-41a6fb0f-fd5c-4f76-b3e6-82d60287b19f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:18 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c8d7bc81-b4dc-4333-847d-ef777850abed tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "cinder-8cc5563d-a6e2-44fa-9eb0-af48013c6431-delete_volume" released by "delete_volume" :: held 1.276s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:18 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1867e7e3-5acf-47d0-bbc9-c7443a823a27 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Acquiring lock "cinder-quobyte-41a6fb0f-fd5c-4f76-b3e6-82d60287b19f" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:18 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-62135ea2-6189-4e11-8dbb-9638490800ea tempest-ProjectMemberTests-1350538287 None] Acquiring lock "cinder-5eb9d359-0052-43fa-98d1-14829d8932d3-delete_snapshot" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:18 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1867e7e3-5acf-47d0-bbc9-c7443a823a27 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "cinder-quobyte-41a6fb0f-fd5c-4f76-b3e6-82d60287b19f" acquired by "delete_volume" :: waited 0.025s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:18 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-62135ea2-6189-4e11-8dbb-9638490800ea tempest-ProjectMemberTests-1350538287 None] Lock "cinder-5eb9d359-0052-43fa-98d1-14829d8932d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:18 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-62135ea2-6189-4e11-8dbb-9638490800ea tempest-ProjectMemberTests-1350538287 None] Acquiring lock "cinder-quobyte-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:18 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[25cda649-a430-4674-a444-6f44fe209ef1]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1867e7e3-5acf-47d0-bbc9-c7443a823a27 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-41a6fb0f-fd5c-4f76-b3e6-82d60287b19f {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:18 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-62135ea2-6189-4e11-8dbb-9638490800ea tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:18 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-62135ea2-6189-4e11-8dbb-9638490800ea tempest-ProjectMemberTests-1350538287 None] Acquiring lock "cinder-quobyte-5eb9d359-0052-43fa-98d1-14829d8932d3" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:18 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-62135ea2-6189-4e11-8dbb-9638490800ea tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-5eb9d359-0052-43fa-98d1-14829d8932d3" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:18 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-62135ea2-6189-4e11-8dbb-9638490800ea tempest-ProjectMemberTests-1350538287 None] Deleting offline snapshot 5eb9d359-0052-43fa-98d1-14829d8932d3 of volume b066235a-72b7-42d2-8b07-5d7ef1d7bcfb {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:36:18 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-62135ea2-6189-4e11-8dbb-9638490800ea tempest-ProjectMemberTests-1350538287 None] snapshot_file for this snap is: volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb.5eb9d359-0052-43fa-98d1-14829d8932d3 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:36:18 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a702eb2-09b1-483f-848e-e56b9e663a6d]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-62135ea2-6189-4e11-8dbb-9638490800ea tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb.5eb9d359-0052-43fa-98d1-14829d8932d3 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:18 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-cca848c6-720d-4946-a0e8-6389eece026b tempest-CinderUnicodeTest-2026399211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c53f9ce-a137-49aa-9bfe-07e86c6f34b8" returned: 0 in 0.309s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:18 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-cca848c6-720d-4946-a0e8-6389eece026b tempest-CinderUnicodeTest-2026399211 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:36:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-cca848c6-720d-4946-a0e8-6389eece026b tempest-CinderUnicodeTest-2026399211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.340s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:18 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:36:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b9b39fe-3eaf-4cad-808a-3c126558a8e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fac0890f307b4fc8bde71b44bd4d8aa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:36:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:36:13Z,use_quota=True,user_id='c6b8400395394890827d4f0bcd267f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:36:18 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Creating volume 8b9b39fe-3eaf-4cad-808a-3c126558a8e0 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:36:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:18 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:36:18 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:36:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:18 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:36:18 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:36:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8b9b39fe-3eaf-4cad-808a-3c126558a8e0 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:18 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cca848c6-720d-4946-a0e8-6389eece026b tempest-CinderUnicodeTest-2026399211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad8a7d01-54ef-450d-8b38-f723cdc69e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c53f9ce-a137-49aa-9bfe-07e86c6f34b8', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:18 devstack sudo[107079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-41a6fb0f-fd5c-4f76-b3e6-82d60287b19f Sep 03 14:36:18 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:18 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8b9b39fe-3eaf-4cad-808a-3c126558a8e0 1073741824 Sep 03 14:36:18 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:18 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cca848c6-720d-4946-a0e8-6389eece026b tempest-CinderUnicodeTest-2026399211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75a60343-385e-4888-a011-6e65d190e012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:18 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-cca848c6-720d-4946-a0e8-6389eece026b tempest-CinderUnicodeTest-2026399211 None] Volume volume-5c53f9ce-a137-49aa-9bfe-07e86c6f34b8 (5c53f9ce-a137-49aa-9bfe-07e86c6f34b8): created successfully Sep 03 14:36:18 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cca848c6-720d-4946-a0e8-6389eece026b tempest-CinderUnicodeTest-2026399211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75a60343-385e-4888-a011-6e65d190e012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:18 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cca848c6-720d-4946-a0e8-6389eece026b tempest-CinderUnicodeTest-2026399211 None] Flow 'volume_create_manager' (14a77212-b579-40ba-971d-84479d75297b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:36:18 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-cca848c6-720d-4946-a0e8-6389eece026b tempest-CinderUnicodeTest-2026399211 None] Created volume successfully. Sep 03 14:36:18 devstack sudo[107081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb.5eb9d359-0052-43fa-98d1-14829d8932d3 Sep 03 14:36:18 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:19 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1867e7e3-5acf-47d0-bbc9-c7443a823a27 tempest-CreateVolumesFromSnapshotTest-2050907273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-41a6fb0f-fd5c-4f76-b3e6-82d60287b19f" returned: 0 in 0.397s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1867e7e3-5acf-47d0-bbc9-c7443a823a27 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-41a6fb0f-fd5c-4f76-b3e6-82d60287b19f {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:19 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-41a6fb0f-fd5c-4f76-b3e6-82d60287b19f Sep 03 14:36:19 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:19 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-62135ea2-6189-4e11-8dbb-9638490800ea tempest-ProjectMemberTests-1350538287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb.5eb9d359-0052-43fa-98d1-14829d8932d3" returned: 0 in 0.406s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:19 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-62135ea2-6189-4e11-8dbb-9638490800ea tempest-ProjectMemberTests-1350538287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:36:19 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee08a9ed-d71a-4a39-9e0b-a8f174f73bb8]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-62135ea2-6189-4e11-8dbb-9638490800ea tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:19 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8b9b39fe-3eaf-4cad-808a-3c126558a8e0 1073741824" returned: 0 in 0.452s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8b9b39fe-3eaf-4cad-808a-3c126558a8e0 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:19 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb Sep 03 14:36:19 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:19 devstack sudo[107100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8b9b39fe-3eaf-4cad-808a-3c126558a8e0 Sep 03 14:36:19 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:19 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1867e7e3-5acf-47d0-bbc9-c7443a823a27 tempest-CreateVolumesFromSnapshotTest-2050907273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-41a6fb0f-fd5c-4f76-b3e6-82d60287b19f" returned: 0 in 0.315s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:19 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1867e7e3-5acf-47d0-bbc9-c7443a823a27 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "cinder-quobyte-41a6fb0f-fd5c-4f76-b3e6-82d60287b19f" released by "delete_volume" :: held 0.766s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:19 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-1867e7e3-5acf-47d0-bbc9-c7443a823a27 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Created reservations ['cb73cc7f-337d-4380-8f15-2d467ab744b0', '590475f1-81f4-420a-8467-be0a5abb578e', '0724b6f1-79db-4c43-a77e-b8478eef24e0', '5654c532-9d11-41a7-a57d-784fe0efd03f'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:36:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1867e7e3-5acf-47d0-bbc9-c7443a823a27 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1867e7e3-5acf-47d0-bbc9-c7443a823a27 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:19 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-1867e7e3-5acf-47d0-bbc9-c7443a823a27 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:36:19 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-1867e7e3-5acf-47d0-bbc9-c7443a823a27 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:36:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1867e7e3-5acf-47d0-bbc9-c7443a823a27 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1867e7e3-5acf-47d0-bbc9-c7443a823a27 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:19 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:36:19 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:19 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-62135ea2-6189-4e11-8dbb-9638490800ea tempest-ProjectMemberTests-1350538287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb" returned: 0 in 0.460s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-62135ea2-6189-4e11-8dbb-9638490800ea tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb.5eb9d359-0052-43fa-98d1-14829d8932d3 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:19 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8b9b39fe-3eaf-4cad-808a-3c126558a8e0" returned: 0 in 0.383s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:19 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:36:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:19 devstack sudo[107111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb.5eb9d359-0052-43fa-98d1-14829d8932d3 Sep 03 14:36:19 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:19 devstack cinder-volume[87007]: DEBUG cinder.volume.volume_utils [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Attempting download of 613dce03-e064-4ac6-b0ce-f0c0dacea1b1 ((None, [{'url': 'file:///opt/stack/data/glance/images/613dce03-e064-4ac6-b0ce-f0c0dacea1b1', 'metadata': {}}])) to volume 8b9b39fe-3eaf-4cad-808a-3c126558a8e0. {{(pid=87007) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 14:36:19 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d38aca8a-0580-4c8b-822b-5445a4598c47 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Acquiring lock "cinder-df437fe5-25b5-416b-a624-173b19c74295-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:19 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d38aca8a-0580-4c8b-822b-5445a4598c47 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "cinder-df437fe5-25b5-416b-a624-173b19c74295-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:19 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[508c15c7-1bc6-4d1e-b96c-029da433c916]: (4, 'raw') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_613dce03-e064-4ac6-b0ce-f0c0dacea1b1_puyezfxy {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:19 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d38aca8a-0580-4c8b-822b-5445a4598c47 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Acquiring lock "cinder-quobyte-df437fe5-25b5-416b-a624-173b19c74295" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:19 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d38aca8a-0580-4c8b-822b-5445a4598c47 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "cinder-quobyte-df437fe5-25b5-416b-a624-173b19c74295" acquired by "delete_volume" :: waited 0.028s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:19 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f8aff2-1c50-43e8-9fd4-effbc52387be]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d38aca8a-0580-4c8b-822b-5445a4598c47 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-df437fe5-25b5-416b-a624-173b19c74295 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:19 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_613dce03-e064-4ac6-b0ce-f0c0dacea1b1_puyezfxy Sep 03 14:36:19 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:20 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1867e7e3-5acf-47d0-bbc9-c7443a823a27 tempest-CreateVolumesFromSnapshotTest-2050907273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.511s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-1867e7e3-5acf-47d0-bbc9-c7443a823a27 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:36:20 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-1867e7e3-5acf-47d0-bbc9-c7443a823a27 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Deleted volume successfully. Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1867e7e3-5acf-47d0-bbc9-c7443a823a27 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "cinder-41a6fb0f-fd5c-4f76-b3e6-82d60287b19f-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:20 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-df437fe5-25b5-416b-a624-173b19c74295 Sep 03 14:36:20 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-62135ea2-6189-4e11-8dbb-9638490800ea tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb.5eb9d359-0052-43fa-98d1-14829d8932d3" returned: 0 in 0.499s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-62135ea2-6189-4e11-8dbb-9638490800ea tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb.5eb9d359-0052-43fa-98d1-14829d8932d3 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:20 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:20 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb.5eb9d359-0052-43fa-98d1-14829d8932d3 Sep 03 14:36:20 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ae4ecdb-ca70-4272-bbfa-efd5073b8725 tempest-CinderUnicodeTest-2026399211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2ae4ecdb-ca70-4272-bbfa-efd5073b8725 tempest-CinderUnicodeTest-2026399211 None] Flow 'volume_create_manager' (9020a9a7-aa7a-40dd-ab83-411faa92047e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2ae4ecdb-ca70-4272-bbfa-efd5073b8725 tempest-CinderUnicodeTest-2026399211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97643394-c300-47af-9fe2-924c0bc15bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2ae4ecdb-ca70-4272-bbfa-efd5073b8725 tempest-CinderUnicodeTest-2026399211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97643394-c300-47af-9fe2-924c0bc15bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:36:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-170119588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=297ac0bc-9cb3-4b3f-a32e-9e9420db19ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3417d5f000444b3896cfd9dfd6df793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:36:20Z,use_quota=True,user_id='4eb287f555fb44799554f055e6852cf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:20 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2ae4ecdb-ca70-4272-bbfa-efd5073b8725 tempest-CinderUnicodeTest-2026399211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa0d9b81-995e-470d-95de-5ae90d6e29d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2ae4ecdb-ca70-4272-bbfa-efd5073b8725 tempest-CinderUnicodeTest-2026399211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa0d9b81-995e-470d-95de-5ae90d6e29d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2ae4ecdb-ca70-4272-bbfa-efd5073b8725 tempest-CinderUnicodeTest-2026399211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9478790-ad0d-47bf-854e-bddd04073c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2ae4ecdb-ca70-4272-bbfa-efd5073b8725 tempest-CinderUnicodeTest-2026399211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9478790-ad0d-47bf-854e-bddd04073c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '297ac0bc-9cb3-4b3f-a32e-9e9420db19ec', 'volume_name': 'volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2ae4ecdb-ca70-4272-bbfa-efd5073b8725 tempest-CinderUnicodeTest-2026399211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f62c3c21-f6b6-4df2-9ed9-96dfa39aa664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2ae4ecdb-ca70-4272-bbfa-efd5073b8725 tempest-CinderUnicodeTest-2026399211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f62c3c21-f6b6-4df2-9ed9-96dfa39aa664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2ae4ecdb-ca70-4272-bbfa-efd5073b8725 tempest-CinderUnicodeTest-2026399211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f668f42e-54ad-4f8c-9792-70666ededc13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:20 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-2ae4ecdb-ca70-4272-bbfa-efd5073b8725 tempest-CinderUnicodeTest-2026399211 None] Volume 297ac0bc-9cb3-4b3f-a32e-9e9420db19ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec', 'volume_size': 1} Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2ae4ecdb-ca70-4272-bbfa-efd5073b8725 tempest-CinderUnicodeTest-2026399211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2ae4ecdb-ca70-4272-bbfa-efd5073b8725 tempest-CinderUnicodeTest-2026399211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2ae4ecdb-ca70-4272-bbfa-efd5073b8725 tempest-CinderUnicodeTest-2026399211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:36:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-170119588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=297ac0bc-9cb3-4b3f-a32e-9e9420db19ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3417d5f000444b3896cfd9dfd6df793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:36:20Z,use_quota=True,user_id='4eb287f555fb44799554f055e6852cf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-2ae4ecdb-ca70-4272-bbfa-efd5073b8725 tempest-CinderUnicodeTest-2026399211 None] Creating volume 297ac0bc-9cb3-4b3f-a32e-9e9420db19ec {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2ae4ecdb-ca70-4272-bbfa-efd5073b8725 tempest-CinderUnicodeTest-2026399211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2ae4ecdb-ca70-4272-bbfa-efd5073b8725 tempest-CinderUnicodeTest-2026399211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2ae4ecdb-ca70-4272-bbfa-efd5073b8725 tempest-CinderUnicodeTest-2026399211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2ae4ecdb-ca70-4272-bbfa-efd5073b8725 tempest-CinderUnicodeTest-2026399211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2ae4ecdb-ca70-4272-bbfa-efd5073b8725 tempest-CinderUnicodeTest-2026399211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2ae4ecdb-ca70-4272-bbfa-efd5073b8725 tempest-CinderUnicodeTest-2026399211 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:36:20 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-2ae4ecdb-ca70-4272-bbfa-efd5073b8725 tempest-CinderUnicodeTest-2026399211 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2ae4ecdb-ca70-4272-bbfa-efd5073b8725 tempest-CinderUnicodeTest-2026399211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_613dce03-e064-4ac6-b0ce-f0c0dacea1b1_puyezfxy" returned: 0 in 0.506s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_613dce03-e064-4ac6-b0ce-f0c0dacea1b1_puyezfxy {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:20 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec 1073741824 Sep 03 14:36:20 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:20 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d38aca8a-0580-4c8b-822b-5445a4598c47 tempest-CreateVolumesFromSnapshotTest-2050907273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-df437fe5-25b5-416b-a624-173b19c74295" returned: 0 in 0.462s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d38aca8a-0580-4c8b-822b-5445a4598c47 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-df437fe5-25b5-416b-a624-173b19c74295 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:20 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-df437fe5-25b5-416b-a624-173b19c74295 Sep 03 14:36:20 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:20 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:20 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_613dce03-e064-4ac6-b0ce-f0c0dacea1b1_puyezfxy Sep 03 14:36:20 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-62135ea2-6189-4e11-8dbb-9638490800ea tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb.5eb9d359-0052-43fa-98d1-14829d8932d3" returned: 0 in 0.341s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-62135ea2-6189-4e11-8dbb-9638490800ea tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-5eb9d359-0052-43fa-98d1-14829d8932d3" released by "_delete_snapshot" :: held 1.843s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-62135ea2-6189-4e11-8dbb-9638490800ea tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb" released by "delete_snapshot" :: held 1.880s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-62135ea2-6189-4e11-8dbb-9638490800ea tempest-ProjectMemberTests-1350538287 None] Created reservations ['141facad-d493-425a-a625-f4505550c27d', 'db98931a-8711-4963-872a-6371d5ee872a', 'e51e333f-f151-4265-ba5e-15c103557c7f', 'b3149cf6-54d0-4df6-9b17-68101d21eefa'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:36:20 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-62135ea2-6189-4e11-8dbb-9638490800ea tempest-ProjectMemberTests-1350538287 None] Delete snapshot completed successfully. Sep 03 14:36:20 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-62135ea2-6189-4e11-8dbb-9638490800ea tempest-ProjectMemberTests-1350538287 None] Lock "cinder-5eb9d359-0052-43fa-98d1-14829d8932d3-delete_snapshot" released by "delete_snapshot" :: held 2.073s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_613dce03-e064-4ac6-b0ce-f0c0dacea1b1_puyezfxy" returned: 1 in 0.416s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_613dce03-e064-4ac6-b0ce-f0c0dacea1b1_puyezfxy' failed. Not Retrying. {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed536edd-ef3e-465d-84e8-6abd8d260a6d]: (4, 'raw') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_613dce03-e064-4ac6-b0ce-f0c0dacea1b1_vr3qyaw5devstack@QuobyteHD {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:20 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d38aca8a-0580-4c8b-822b-5445a4598c47 tempest-CreateVolumesFromSnapshotTest-2050907273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-df437fe5-25b5-416b-a624-173b19c74295" returned: 0 in 0.324s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d38aca8a-0580-4c8b-822b-5445a4598c47 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "cinder-quobyte-df437fe5-25b5-416b-a624-173b19c74295" released by "delete_volume" :: held 0.869s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-d38aca8a-0580-4c8b-822b-5445a4598c47 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Created reservations ['620dc8aa-494d-4cbe-bdc9-f5d762fe2955', '6f95c0b0-6cdd-4bef-8a59-aa51207fe323', 'aeb4d76f-1de8-4fbc-8ef7-b205d6427241', '73539e5f-f5b4-4b8a-9a70-0116a5628183'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:36:20 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_613dce03-e064-4ac6-b0ce-f0c0dacea1b1_vr3qyaw5devstack@QuobyteHD Sep 03 14:36:20 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d38aca8a-0580-4c8b-822b-5445a4598c47 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d38aca8a-0580-4c8b-822b-5445a4598c47 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d38aca8a-0580-4c8b-822b-5445a4598c47 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:36:20 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d38aca8a-0580-4c8b-822b-5445a4598c47 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d38aca8a-0580-4c8b-822b-5445a4598c47 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d38aca8a-0580-4c8b-822b-5445a4598c47 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d19f0f0d-903b-4d99-a202-161d8f0ea08b tempest-ProjectMemberTests-1350538287 None] Acquiring lock "cinder-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2ae4ecdb-ca70-4272-bbfa-efd5073b8725 tempest-CinderUnicodeTest-2026399211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec 1073741824" returned: 0 in 0.640s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:20 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:36:20 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:20 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d19f0f0d-903b-4d99-a202-161d8f0ea08b tempest-ProjectMemberTests-1350538287 None] Lock "cinder-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2ae4ecdb-ca70-4272-bbfa-efd5073b8725 tempest-CinderUnicodeTest-2026399211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:21 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d19f0f0d-903b-4d99-a202-161d8f0ea08b tempest-ProjectMemberTests-1350538287 None] Acquiring lock "cinder-quobyte-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:21 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d19f0f0d-903b-4d99-a202-161d8f0ea08b tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb" acquired by "delete_volume" :: waited 0.038s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:21 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec Sep 03 14:36:21 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:21 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7847e1b7-8599-4057-b8cb-a21e4872825c tempest-CreateVolumesFromSnapshotTest-2050907273 None] Acquiring lock "cinder-932da1d5-4629-417e-8fda-41a2a09e236c-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:21 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed52f78-d5f5-4768-8365-f4ae791c15a0]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d19f0f0d-903b-4d99-a202-161d8f0ea08b tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:21 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7847e1b7-8599-4057-b8cb-a21e4872825c tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "cinder-932da1d5-4629-417e-8fda-41a2a09e236c-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:21 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7847e1b7-8599-4057-b8cb-a21e4872825c tempest-CreateVolumesFromSnapshotTest-2050907273 None] Acquiring lock "cinder-quobyte-932da1d5-4629-417e-8fda-41a2a09e236c" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:21 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7847e1b7-8599-4057-b8cb-a21e4872825c tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "cinder-quobyte-932da1d5-4629-417e-8fda-41a2a09e236c" acquired by "delete_volume" :: waited 0.029s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:21 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_613dce03-e064-4ac6-b0ce-f0c0dacea1b1_vr3qyaw5devstack@QuobyteHD" returned: 0 in 0.563s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_613dce03-e064-4ac6-b0ce-f0c0dacea1b1_vr3qyaw5devstack@QuobyteHD {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:21 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d38aca8a-0580-4c8b-822b-5445a4598c47 tempest-CreateVolumesFromSnapshotTest-2050907273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.405s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:21 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-d38aca8a-0580-4c8b-822b-5445a4598c47 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:36:21 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb Sep 03 14:36:21 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:21 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4a7a1c-a10a-4a31-ad41-321956bdf72c]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7847e1b7-8599-4057-b8cb-a21e4872825c tempest-CreateVolumesFromSnapshotTest-2050907273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-932da1d5-4629-417e-8fda-41a2a09e236c {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:21 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-d38aca8a-0580-4c8b-822b-5445a4598c47 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Deleted volume successfully. Sep 03 14:36:21 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d38aca8a-0580-4c8b-822b-5445a4598c47 tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "cinder-df437fe5-25b5-416b-a624-173b19c74295-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:21 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2ae4ecdb-ca70-4272-bbfa-efd5073b8725 tempest-CinderUnicodeTest-2026399211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec" returned: 0 in 0.402s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:21 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-2ae4ecdb-ca70-4272-bbfa-efd5073b8725 tempest-CinderUnicodeTest-2026399211 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:36:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2ae4ecdb-ca70-4272-bbfa-efd5073b8725 tempest-CinderUnicodeTest-2026399211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:21 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2ae4ecdb-ca70-4272-bbfa-efd5073b8725 tempest-CinderUnicodeTest-2026399211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f668f42e-54ad-4f8c-9792-70666ededc13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:21 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2ae4ecdb-ca70-4272-bbfa-efd5073b8725 tempest-CinderUnicodeTest-2026399211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (137ac2ae-ff96-43b7-bea9-49933ee01492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:21 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-2ae4ecdb-ca70-4272-bbfa-efd5073b8725 tempest-CinderUnicodeTest-2026399211 None] Volume volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec (297ac0bc-9cb3-4b3f-a32e-9e9420db19ec): created successfully Sep 03 14:36:21 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2ae4ecdb-ca70-4272-bbfa-efd5073b8725 tempest-CinderUnicodeTest-2026399211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (137ac2ae-ff96-43b7-bea9-49933ee01492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:21 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-2ae4ecdb-ca70-4272-bbfa-efd5073b8725 tempest-CinderUnicodeTest-2026399211 None] Flow 'volume_create_manager' (9020a9a7-aa7a-40dd-ab83-411faa92047e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:36:21 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_613dce03-e064-4ac6-b0ce-f0c0dacea1b1_vr3qyaw5devstack@QuobyteHD Sep 03 14:36:21 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:21 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-2ae4ecdb-ca70-4272-bbfa-efd5073b8725 tempest-CinderUnicodeTest-2026399211 None] Created volume successfully. Sep 03 14:36:21 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-932da1d5-4629-417e-8fda-41a2a09e236c Sep 03 14:36:21 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:21 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d19f0f0d-903b-4d99-a202-161d8f0ea08b tempest-ProjectMemberTests-1350538287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb" returned: 0 in 0.451s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d19f0f0d-903b-4d99-a202-161d8f0ea08b tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:21 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb Sep 03 14:36:21 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:21 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_613dce03-e064-4ac6-b0ce-f0c0dacea1b1_vr3qyaw5devstack@QuobyteHD" returned: 1 in 0.407s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_613dce03-e064-4ac6-b0ce-f0c0dacea1b1_vr3qyaw5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 14:36:21 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] 613dce03-e064-4ac6-b0ce-f0c0dacea1b1 was raw, converting to qcow2 {{(pid=87007) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 14:36:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_613dce03-e064-4ac6-b0ce-f0c0dacea1b1_vr3qyaw5devstack@QuobyteHD /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8b9b39fe-3eaf-4cad-808a-3c126558a8e0 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:21 devstack sudo[107168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_613dce03-e064-4ac6-b0ce-f0c0dacea1b1_vr3qyaw5devstack@QuobyteHD /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8b9b39fe-3eaf-4cad-808a-3c126558a8e0 Sep 03 14:36:21 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:21 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7847e1b7-8599-4057-b8cb-a21e4872825c tempest-CreateVolumesFromSnapshotTest-2050907273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-932da1d5-4629-417e-8fda-41a2a09e236c" returned: 0 in 0.441s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7847e1b7-8599-4057-b8cb-a21e4872825c tempest-CreateVolumesFromSnapshotTest-2050907273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-932da1d5-4629-417e-8fda-41a2a09e236c {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:21 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-932da1d5-4629-417e-8fda-41a2a09e236c Sep 03 14:36:21 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:21 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d19f0f0d-903b-4d99-a202-161d8f0ea08b tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb" returned: 0 in 0.283s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:21 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d19f0f0d-903b-4d99-a202-161d8f0ea08b tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb" released by "delete_volume" :: held 0.843s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:21 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-d19f0f0d-903b-4d99-a202-161d8f0ea08b tempest-ProjectMemberTests-1350538287 None] Created reservations ['f8eecf3b-49cd-4c01-a12d-7328a0be34ca', '500ea6f4-1499-4790-8c5e-ee4b6565c614', '856be0bd-e0c2-4cf2-8c55-ca87f2c327e1', '3a6bccbb-3390-41e8-bcbb-3cfdb21f79ca'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d19f0f0d-903b-4d99-a202-161d8f0ea08b tempest-ProjectMemberTests-1350538287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d19f0f0d-903b-4d99-a202-161d8f0ea08b tempest-ProjectMemberTests-1350538287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d19f0f0d-903b-4d99-a202-161d8f0ea08b tempest-ProjectMemberTests-1350538287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d19f0f0d-903b-4d99-a202-161d8f0ea08b tempest-ProjectMemberTests-1350538287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d19f0f0d-903b-4d99-a202-161d8f0ea08b tempest-ProjectMemberTests-1350538287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d19f0f0d-903b-4d99-a202-161d8f0ea08b tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:22 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7847e1b7-8599-4057-b8cb-a21e4872825c tempest-CreateVolumesFromSnapshotTest-2050907273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-932da1d5-4629-417e-8fda-41a2a09e236c" returned: 0 in 0.283s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:22 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:36:22 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7847e1b7-8599-4057-b8cb-a21e4872825c tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "cinder-quobyte-932da1d5-4629-417e-8fda-41a2a09e236c" released by "delete_volume" :: held 0.799s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-7847e1b7-8599-4057-b8cb-a21e4872825c tempest-CreateVolumesFromSnapshotTest-2050907273 None] Created reservations ['286f8e2b-e718-4182-b8b8-e9783e68eab4', 'a697439c-a0f2-4e84-9a03-ed6d2484d4b5', 'e67336c0-ad63-4173-b1f5-4d9570db25a5', '6f54ee91-5c52-4b12-a6e2-7cc2b251d8d4'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7847e1b7-8599-4057-b8cb-a21e4872825c tempest-CreateVolumesFromSnapshotTest-2050907273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7847e1b7-8599-4057-b8cb-a21e4872825c tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-7847e1b7-8599-4057-b8cb-a21e4872825c tempest-CreateVolumesFromSnapshotTest-2050907273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-7847e1b7-8599-4057-b8cb-a21e4872825c tempest-CreateVolumesFromSnapshotTest-2050907273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7847e1b7-8599-4057-b8cb-a21e4872825c tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7847e1b7-8599-4057-b8cb-a21e4872825c tempest-CreateVolumesFromSnapshotTest-2050907273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:22 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:36:22 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:22 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_613dce03-e064-4ac6-b0ce-f0c0dacea1b1_vr3qyaw5devstack@QuobyteHD /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8b9b39fe-3eaf-4cad-808a-3c126558a8e0" returned: 0 in 0.579s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_613dce03-e064-4ac6-b0ce-f0c0dacea1b1_vr3qyaw5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8b9b39fe-3eaf-4cad-808a-3c126558a8e0 {{(pid=87007) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 14:36:22 devstack cinder-volume[87007]: INFO cinder.image.image_utils [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Converted 0.00 MB image at 0.00 MB/s Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8b9b39fe-3eaf-4cad-808a-3c126558a8e0 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:22 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d19f0f0d-903b-4d99-a202-161d8f0ea08b tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.320s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:22 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8b9b39fe-3eaf-4cad-808a-3c126558a8e0 1G Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-d19f0f0d-903b-4d99-a202-161d8f0ea08b tempest-ProjectMemberTests-1350538287 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:36:22 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:22 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-d19f0f0d-903b-4d99-a202-161d8f0ea08b tempest-ProjectMemberTests-1350538287 None] Deleted volume successfully. Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d19f0f0d-903b-4d99-a202-161d8f0ea08b tempest-ProjectMemberTests-1350538287 None] Lock "cinder-b066235a-72b7-42d2-8b07-5d7ef1d7bcfb-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-bd9255f5-b5ee-4be1-ad6f-b157f483e6ad tempest-CreateVolumesFromSnapshotTest-2050907273 None] Acquiring lock "cinder-df45cdc6-5629-4f30-b9eb-cb7cca8cff93-delete_snapshot" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-bd9255f5-b5ee-4be1-ad6f-b157f483e6ad tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "cinder-df45cdc6-5629-4f30-b9eb-cb7cca8cff93-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-bd9255f5-b5ee-4be1-ad6f-b157f483e6ad tempest-CreateVolumesFromSnapshotTest-2050907273 None] Acquiring lock "cinder-quobyte-3a124632-b007-4c13-b628-8570c81d19f0" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-bd9255f5-b5ee-4be1-ad6f-b157f483e6ad tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "cinder-quobyte-3a124632-b007-4c13-b628-8570c81d19f0" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-bd9255f5-b5ee-4be1-ad6f-b157f483e6ad tempest-CreateVolumesFromSnapshotTest-2050907273 None] Acquiring lock "cinder-quobyte-df45cdc6-5629-4f30-b9eb-cb7cca8cff93" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-bd9255f5-b5ee-4be1-ad6f-b157f483e6ad tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "cinder-quobyte-df45cdc6-5629-4f30-b9eb-cb7cca8cff93" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-bd9255f5-b5ee-4be1-ad6f-b157f483e6ad tempest-CreateVolumesFromSnapshotTest-2050907273 None] Deleting offline snapshot df45cdc6-5629-4f30-b9eb-cb7cca8cff93 of volume 3a124632-b007-4c13-b628-8570c81d19f0 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-bd9255f5-b5ee-4be1-ad6f-b157f483e6ad tempest-CreateVolumesFromSnapshotTest-2050907273 None] snapshot_file for this snap is: volume-3a124632-b007-4c13-b628-8570c81d19f0.df45cdc6-5629-4f30-b9eb-cb7cca8cff93 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb2426b-5d82-403d-a1a2-976cf304eb59]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bd9255f5-b5ee-4be1-ad6f-b157f483e6ad tempest-CreateVolumesFromSnapshotTest-2050907273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a124632-b007-4c13-b628-8570c81d19f0.df45cdc6-5629-4f30-b9eb-cb7cca8cff93 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:22 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7847e1b7-8599-4057-b8cb-a21e4872825c tempest-CreateVolumesFromSnapshotTest-2050907273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.423s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-7847e1b7-8599-4057-b8cb-a21e4872825c tempest-CreateVolumesFromSnapshotTest-2050907273 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:36:22 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-7847e1b7-8599-4057-b8cb-a21e4872825c tempest-CreateVolumesFromSnapshotTest-2050907273 None] Deleted volume successfully. Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7847e1b7-8599-4057-b8cb-a21e4872825c tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "cinder-932da1d5-4629-417e-8fda-41a2a09e236c-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:22 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8b9b39fe-3eaf-4cad-808a-3c126558a8e0 1G" returned: 0 in 0.477s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG cinder.volume.volume_utils [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Downloaded image 613dce03-e064-4ac6-b0ce-f0c0dacea1b1 ((None, [{'url': 'file:///opt/stack/data/glance/images/613dce03-e064-4ac6-b0ce-f0c0dacea1b1', 'metadata': {}}])) to volume 8b9b39fe-3eaf-4cad-808a-3c126558a8e0 successfully. {{(pid=87007) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Temporary image 613dce03-e064-4ac6-b0ce-f0c0dacea1b1 for user c6b8400395394890827d4f0bcd267f32 is deleted. {{(pid=87007) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG cinder.volume.volume_utils [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Marking volume 8b9b39fe-3eaf-4cad-808a-3c126558a8e0 as bootable. {{(pid=87007) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Copying metadata from image 613dce03-e064-4ac6-b0ce-f0c0dacea1b1 to 8b9b39fe-3eaf-4cad-808a-3c126558a8e0. {{(pid=87007) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Creating volume glance metadata for volume 8b9b39fe-3eaf-4cad-808a-3c126558a8e0 backed by image 613dce03-e064-4ac6-b0ce-f0c0dacea1b1 with: {'image_id': '613dce03-e064-4ac6-b0ce-f0c0dacea1b1', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '97a3878f136334447c051decf912044d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87007) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 14:36:22 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a124632-b007-4c13-b628-8570c81d19f0.df45cdc6-5629-4f30-b9eb-cb7cca8cff93 Sep 03 14:36:22 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7c55f38-071a-45ee-9d1e-b37a49a08786 tempest-ProjectMemberTests-1350538287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f7c55f38-071a-45ee-9d1e-b37a49a08786 tempest-ProjectMemberTests-1350538287 None] Flow 'volume_create_manager' (15e844a3-cb75-47d3-9c98-13e447f2bd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f7c55f38-071a-45ee-9d1e-b37a49a08786 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (687fdfe3-e89f-45c8-ac27-080cd2f41413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f7c55f38-071a-45ee-9d1e-b37a49a08786 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (687fdfe3-e89f-45c8-ac27-080cd2f41413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-686384371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec5377cf-f803-440b-a9f3-5e44d019cae4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bdc07719fdf40189d19adf3cf793220',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:36:23Z,use_quota=True,user_id='c0e0fc3b02a64f5b9b037ade3f94a724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f7c55f38-071a-45ee-9d1e-b37a49a08786 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c609bb8-be0a-420c-aced-1bff55390a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f7c55f38-071a-45ee-9d1e-b37a49a08786 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c609bb8-be0a-420c-aced-1bff55390a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f7c55f38-071a-45ee-9d1e-b37a49a08786 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c9c9320-6549-482d-9661-acb1df9d5db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f7c55f38-071a-45ee-9d1e-b37a49a08786 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c9c9320-6549-482d-9661-acb1df9d5db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec5377cf-f803-440b-a9f3-5e44d019cae4', 'volume_name': 'volume-ec5377cf-f803-440b-a9f3-5e44d019cae4', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f7c55f38-071a-45ee-9d1e-b37a49a08786 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2f8de4c-4454-4030-aeb9-ca5173272455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f7c55f38-071a-45ee-9d1e-b37a49a08786 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2f8de4c-4454-4030-aeb9-ca5173272455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f7c55f38-071a-45ee-9d1e-b37a49a08786 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b7d6064-b472-45b0-913a-1bd5c7286f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:22 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-f7c55f38-071a-45ee-9d1e-b37a49a08786 tempest-ProjectMemberTests-1350538287 None] Volume ec5377cf-f803-440b-a9f3-5e44d019cae4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec5377cf-f803-440b-a9f3-5e44d019cae4', 'volume_size': 1} Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f7c55f38-071a-45ee-9d1e-b37a49a08786 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f7c55f38-071a-45ee-9d1e-b37a49a08786 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f7c55f38-071a-45ee-9d1e-b37a49a08786 tempest-ProjectMemberTests-1350538287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-686384371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec5377cf-f803-440b-a9f3-5e44d019cae4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bdc07719fdf40189d19adf3cf793220',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:36:23Z,use_quota=True,user_id='c0e0fc3b02a64f5b9b037ade3f94a724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-f7c55f38-071a-45ee-9d1e-b37a49a08786 tempest-ProjectMemberTests-1350538287 None] Creating volume ec5377cf-f803-440b-a9f3-5e44d019cae4 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f7c55f38-071a-45ee-9d1e-b37a49a08786 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f7c55f38-071a-45ee-9d1e-b37a49a08786 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:22 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f7c55f38-071a-45ee-9d1e-b37a49a08786 tempest-ProjectMemberTests-1350538287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:36:23 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f7c55f38-071a-45ee-9d1e-b37a49a08786 tempest-ProjectMemberTests-1350538287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:36:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f7c55f38-071a-45ee-9d1e-b37a49a08786 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:23 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f7c55f38-071a-45ee-9d1e-b37a49a08786 tempest-ProjectMemberTests-1350538287 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:36:23 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-f7c55f38-071a-45ee-9d1e-b37a49a08786 tempest-ProjectMemberTests-1350538287 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:36:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f7c55f38-071a-45ee-9d1e-b37a49a08786 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec5377cf-f803-440b-a9f3-5e44d019cae4 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:23 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec5377cf-f803-440b-a9f3-5e44d019cae4 1073741824 Sep 03 14:36:23 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-43d4c3f8-ab88-46f6-a46e-fa1862739ec8 tempest-CinderUnicodeTest-2026399211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:23 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e713b7f3-1aca-4acd-a55b-5d7707df98b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b9b39fe-3eaf-4cad-808a-3c126558a8e0', 'volume_size': 1, 'image_id': '613dce03-e064-4ac6-b0ce-f0c0dacea1b1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/613dce03-e064-4ac6-b0ce-f0c0dacea1b1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '97a3878f136334447c051decf912044d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fac0890f307b4fc8bde71b44bd4d8aa5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ffcdfe2fd72bdcabb4a856c3ae6d1abe3abe9a8044702f9e36d3a6d9a375badb0ac6b40c0487464d1d283e073f114251c250881d2926dd971f9b9942fcc1b8e7', 'id': '613dce03-e064-4ac6-b0ce-f0c0dacea1b1', 'created_at': datetime.datetime(2026, 9, 3, 12, 36, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 12, 36, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/613dce03-e064-4ac6-b0ce-f0c0dacea1b1/file', 'properties': {}}, 'image_service': }' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:23 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c1b202f-b942-4847-a8fa-bda05f229002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:23 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Volume volume-8b9b39fe-3eaf-4cad-808a-3c126558a8e0 (8b9b39fe-3eaf-4cad-808a-3c126558a8e0): created successfully Sep 03 14:36:23 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c1b202f-b942-4847-a8fa-bda05f229002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:23 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Flow 'volume_create_manager' (f248d347-33c6-486b-9fee-c9c1a5e3c657) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:36:23 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-b00aa267-07cd-4b79-b987-dacc494ee8d4 tempest-VolumeImageDependencyTests-850067079 None] Created volume successfully. Sep 03 14:36:23 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bd9255f5-b5ee-4be1-ad6f-b157f483e6ad tempest-CreateVolumesFromSnapshotTest-2050907273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a124632-b007-4c13-b628-8570c81d19f0.df45cdc6-5629-4f30-b9eb-cb7cca8cff93" returned: 0 in 0.472s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:23 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-bd9255f5-b5ee-4be1-ad6f-b157f483e6ad tempest-CreateVolumesFromSnapshotTest-2050907273 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a124632-b007-4c13-b628-8570c81d19f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:36:23 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[48660d58-731c-4b53-ad8f-ee633394dd1c]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bd9255f5-b5ee-4be1-ad6f-b157f483e6ad tempest-CreateVolumesFromSnapshotTest-2050907273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a124632-b007-4c13-b628-8570c81d19f0 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:23 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a124632-b007-4c13-b628-8570c81d19f0 Sep 03 14:36:23 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:23 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f7c55f38-071a-45ee-9d1e-b37a49a08786 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec5377cf-f803-440b-a9f3-5e44d019cae4 1073741824" returned: 0 in 0.460s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f7c55f38-071a-45ee-9d1e-b37a49a08786 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec5377cf-f803-440b-a9f3-5e44d019cae4 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:23 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bd9255f5-b5ee-4be1-ad6f-b157f483e6ad tempest-CreateVolumesFromSnapshotTest-2050907273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a124632-b007-4c13-b628-8570c81d19f0" returned: 0 in 0.369s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bd9255f5-b5ee-4be1-ad6f-b157f483e6ad tempest-CreateVolumesFromSnapshotTest-2050907273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a124632-b007-4c13-b628-8570c81d19f0.df45cdc6-5629-4f30-b9eb-cb7cca8cff93 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:23 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec5377cf-f803-440b-a9f3-5e44d019cae4 Sep 03 14:36:23 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:23 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a124632-b007-4c13-b628-8570c81d19f0.df45cdc6-5629-4f30-b9eb-cb7cca8cff93 Sep 03 14:36:23 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:23 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f7c55f38-071a-45ee-9d1e-b37a49a08786 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec5377cf-f803-440b-a9f3-5e44d019cae4" returned: 0 in 0.264s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:23 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f7c55f38-071a-45ee-9d1e-b37a49a08786 tempest-ProjectMemberTests-1350538287 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:36:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f7c55f38-071a-45ee-9d1e-b37a49a08786 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-43d4c3f8-ab88-46f6-a46e-fa1862739ec8 tempest-CinderUnicodeTest-2026399211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.724s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:23 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f7c55f38-071a-45ee-9d1e-b37a49a08786 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b7d6064-b472-45b0-913a-1bd5c7286f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec5377cf-f803-440b-a9f3-5e44d019cae4', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:23 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f7c55f38-071a-45ee-9d1e-b37a49a08786 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d368f3c-ae63-492d-93f1-d6b44fef219f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:23 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-43d4c3f8-ab88-46f6-a46e-fa1862739ec8 tempest-CinderUnicodeTest-2026399211 None] Creating offline snapshot 9aa6ad1c-20f5-4920-8765-db79d469f4a6 of volume 297ac0bc-9cb3-4b3f-a32e-9e9420db19ec {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:36:23 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-f7c55f38-071a-45ee-9d1e-b37a49a08786 tempest-ProjectMemberTests-1350538287 None] Volume volume-ec5377cf-f803-440b-a9f3-5e44d019cae4 (ec5377cf-f803-440b-a9f3-5e44d019cae4): created successfully Sep 03 14:36:23 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f7c55f38-071a-45ee-9d1e-b37a49a08786 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d368f3c-ae63-492d-93f1-d6b44fef219f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:23 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f7c55f38-071a-45ee-9d1e-b37a49a08786 tempest-ProjectMemberTests-1350538287 None] Flow 'volume_create_manager' (15e844a3-cb75-47d3-9c98-13e447f2bd1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:36:23 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0fce23-5047-46f8-8d7a-500a6820eb0d]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-43d4c3f8-ab88-46f6-a46e-fa1862739ec8 tempest-CinderUnicodeTest-2026399211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:23 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-f7c55f38-071a-45ee-9d1e-b37a49a08786 tempest-ProjectMemberTests-1350538287 None] Created volume successfully. Sep 03 14:36:23 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bd9255f5-b5ee-4be1-ad6f-b157f483e6ad tempest-CreateVolumesFromSnapshotTest-2050907273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a124632-b007-4c13-b628-8570c81d19f0.df45cdc6-5629-4f30-b9eb-cb7cca8cff93" returned: 0 in 0.398s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bd9255f5-b5ee-4be1-ad6f-b157f483e6ad tempest-CreateVolumesFromSnapshotTest-2050907273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a124632-b007-4c13-b628-8570c81d19f0.df45cdc6-5629-4f30-b9eb-cb7cca8cff93 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:23 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a124632-b007-4c13-b628-8570c81d19f0.df45cdc6-5629-4f30-b9eb-cb7cca8cff93 Sep 03 14:36:23 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:23 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec Sep 03 14:36:23 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:24 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a4f4e67b-57ca-4a31-b274-673813e5956a tempest-VolumeImageDependencyTests-850067079 None] Acquiring lock "cinder-8b9b39fe-3eaf-4cad-808a-3c126558a8e0-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:24 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a4f4e67b-57ca-4a31-b274-673813e5956a tempest-VolumeImageDependencyTests-850067079 None] Lock "cinder-8b9b39fe-3eaf-4cad-808a-3c126558a8e0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:24 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a4f4e67b-57ca-4a31-b274-673813e5956a tempest-VolumeImageDependencyTests-850067079 None] Acquiring lock "cinder-quobyte-8b9b39fe-3eaf-4cad-808a-3c126558a8e0" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:24 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a4f4e67b-57ca-4a31-b274-673813e5956a tempest-VolumeImageDependencyTests-850067079 None] Lock "cinder-quobyte-8b9b39fe-3eaf-4cad-808a-3c126558a8e0" acquired by "delete_volume" :: waited 0.017s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:24 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b006c5f6-c068-468d-beff-8f758c6f5d2a]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a4f4e67b-57ca-4a31-b274-673813e5956a tempest-VolumeImageDependencyTests-850067079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8b9b39fe-3eaf-4cad-808a-3c126558a8e0 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:24 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bd9255f5-b5ee-4be1-ad6f-b157f483e6ad tempest-CreateVolumesFromSnapshotTest-2050907273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a124632-b007-4c13-b628-8570c81d19f0.df45cdc6-5629-4f30-b9eb-cb7cca8cff93" returned: 0 in 0.289s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:24 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-bd9255f5-b5ee-4be1-ad6f-b157f483e6ad tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "cinder-quobyte-df45cdc6-5629-4f30-b9eb-cb7cca8cff93" released by "_delete_snapshot" :: held 1.663s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:24 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-bd9255f5-b5ee-4be1-ad6f-b157f483e6ad tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "cinder-quobyte-3a124632-b007-4c13-b628-8570c81d19f0" released by "delete_snapshot" :: held 1.694s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:24 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8b9b39fe-3eaf-4cad-808a-3c126558a8e0 Sep 03 14:36:24 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:24 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-43d4c3f8-ab88-46f6-a46e-fa1862739ec8 tempest-CinderUnicodeTest-2026399211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec" returned: 0 in 0.420s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-43d4c3f8-ab88-46f6-a46e-fa1862739ec8 tempest-CinderUnicodeTest-2026399211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec.9aa6ad1c-20f5-4920-8765-db79d469f4a6 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:24 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec.9aa6ad1c-20f5-4920-8765-db79d469f4a6 1G Sep 03 14:36:24 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:24 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-bd9255f5-b5ee-4be1-ad6f-b157f483e6ad tempest-CreateVolumesFromSnapshotTest-2050907273 None] Created reservations ['f82deecc-fe58-4c3c-a757-4c55dc76fb72', '79b3809e-057d-488c-9c1c-665b2b270273', 'c862a158-eb48-4fcd-b4ce-2e97f0bf528b', 'cc03eb2f-dea7-4ff0-a913-e870dab3aa61'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:36:24 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-bd9255f5-b5ee-4be1-ad6f-b157f483e6ad tempest-CreateVolumesFromSnapshotTest-2050907273 None] Delete snapshot completed successfully. Sep 03 14:36:24 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-bd9255f5-b5ee-4be1-ad6f-b157f483e6ad tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "cinder-df45cdc6-5629-4f30-b9eb-cb7cca8cff93-delete_snapshot" released by "delete_snapshot" :: held 1.885s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:24 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a4f4e67b-57ca-4a31-b274-673813e5956a tempest-VolumeImageDependencyTests-850067079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8b9b39fe-3eaf-4cad-808a-3c126558a8e0" returned: 0 in 0.371s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a4f4e67b-57ca-4a31-b274-673813e5956a tempest-VolumeImageDependencyTests-850067079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8b9b39fe-3eaf-4cad-808a-3c126558a8e0 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:24 devstack sudo[107234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8b9b39fe-3eaf-4cad-808a-3c126558a8e0 Sep 03 14:36:24 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:24 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-43d4c3f8-ab88-46f6-a46e-fa1862739ec8 tempest-CinderUnicodeTest-2026399211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec.9aa6ad1c-20f5-4920-8765-db79d469f4a6 1G" returned: 0 in 0.407s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-43d4c3f8-ab88-46f6-a46e-fa1862739ec8 tempest-CinderUnicodeTest-2026399211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec.9aa6ad1c-20f5-4920-8765-db79d469f4a6 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:24 devstack sudo[107237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec.9aa6ad1c-20f5-4920-8765-db79d469f4a6 Sep 03 14:36:24 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:24 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b9876ae3-43ee-4b11-9b39-4129f52da65b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Acquiring lock "cinder-3a124632-b007-4c13-b628-8570c81d19f0-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:24 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a4f4e67b-57ca-4a31-b274-673813e5956a tempest-VolumeImageDependencyTests-850067079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8b9b39fe-3eaf-4cad-808a-3c126558a8e0" returned: 0 in 0.285s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:24 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b9876ae3-43ee-4b11-9b39-4129f52da65b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "cinder-3a124632-b007-4c13-b628-8570c81d19f0-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:24 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a4f4e67b-57ca-4a31-b274-673813e5956a tempest-VolumeImageDependencyTests-850067079 None] Lock "cinder-quobyte-8b9b39fe-3eaf-4cad-808a-3c126558a8e0" released by "delete_volume" :: held 0.731s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:24 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b9876ae3-43ee-4b11-9b39-4129f52da65b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Acquiring lock "cinder-quobyte-3a124632-b007-4c13-b628-8570c81d19f0" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:24 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b9876ae3-43ee-4b11-9b39-4129f52da65b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "cinder-quobyte-3a124632-b007-4c13-b628-8570c81d19f0" acquired by "delete_volume" :: waited 0.027s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:24 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3571d628-3e0a-4976-b63a-6331fa43999e]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b9876ae3-43ee-4b11-9b39-4129f52da65b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a124632-b007-4c13-b628-8570c81d19f0 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:24 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-a4f4e67b-57ca-4a31-b274-673813e5956a tempest-VolumeImageDependencyTests-850067079 None] Created reservations ['93ff79f3-18a8-4c9a-87b2-bb2af4b79563', '1a6f06a9-c9d5-408b-97ac-38a85c9ce0f2', '8301e1f8-39dc-4e37-8f12-30ffeb0d90f9', 'e5633a62-189c-4730-aaa0-a4b53a48642a'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:36:25 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-43d4c3f8-ab88-46f6-a46e-fa1862739ec8 tempest-CinderUnicodeTest-2026399211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec.9aa6ad1c-20f5-4920-8765-db79d469f4a6" returned: 0 in 0.354s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:25 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-43d4c3f8-ab88-46f6-a46e-fa1862739ec8 tempest-CinderUnicodeTest-2026399211 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec.9aa6ad1c-20f5-4920-8765-db79d469f4a6 is being set with open permissions: ugo+rw Sep 03 14:36:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-43d4c3f8-ab88-46f6-a46e-fa1862739ec8 tempest-CinderUnicodeTest-2026399211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec.9aa6ad1c-20f5-4920-8765-db79d469f4a6 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:25 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec.9aa6ad1c-20f5-4920-8765-db79d469f4a6 Sep 03 14:36:25 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:25 devstack sudo[107243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a124632-b007-4c13-b628-8570c81d19f0 Sep 03 14:36:25 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a4f4e67b-57ca-4a31-b274-673813e5956a tempest-VolumeImageDependencyTests-850067079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a4f4e67b-57ca-4a31-b274-673813e5956a tempest-VolumeImageDependencyTests-850067079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:25 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a4f4e67b-57ca-4a31-b274-673813e5956a tempest-VolumeImageDependencyTests-850067079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:36:25 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a4f4e67b-57ca-4a31-b274-673813e5956a tempest-VolumeImageDependencyTests-850067079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:36:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a4f4e67b-57ca-4a31-b274-673813e5956a tempest-VolumeImageDependencyTests-850067079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a4f4e67b-57ca-4a31-b274-673813e5956a tempest-VolumeImageDependencyTests-850067079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:25 devstack sudo[107247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:36:25 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6e38d842-8d0f-4f7b-9b6e-8851b9392cf5 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:25 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-43d4c3f8-ab88-46f6-a46e-fa1862739ec8 tempest-CinderUnicodeTest-2026399211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec.9aa6ad1c-20f5-4920-8765-db79d469f4a6" returned: 0 in 0.381s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:25 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b9876ae3-43ee-4b11-9b39-4129f52da65b tempest-CreateVolumesFromSnapshotTest-2050907273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a124632-b007-4c13-b628-8570c81d19f0" returned: 0 in 0.487s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b9876ae3-43ee-4b11-9b39-4129f52da65b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a124632-b007-4c13-b628-8570c81d19f0 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:25 devstack sudo[107259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a124632-b007-4c13-b628-8570c81d19f0 Sep 03 14:36:25 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-43d4c3f8-ab88-46f6-a46e-fa1862739ec8 tempest-CinderUnicodeTest-2026399211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:25 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec.info Sep 03 14:36:25 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:25 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a4f4e67b-57ca-4a31-b274-673813e5956a tempest-VolumeImageDependencyTests-850067079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.403s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:25 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-a4f4e67b-57ca-4a31-b274-673813e5956a tempest-VolumeImageDependencyTests-850067079 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:36:25 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-a4f4e67b-57ca-4a31-b274-673813e5956a tempest-VolumeImageDependencyTests-850067079 None] Deleted volume successfully. Sep 03 14:36:25 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-a4f4e67b-57ca-4a31-b274-673813e5956a tempest-VolumeImageDependencyTests-850067079 None] Lock "cinder-8b9b39fe-3eaf-4cad-808a-3c126558a8e0-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:25 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b9876ae3-43ee-4b11-9b39-4129f52da65b tempest-CreateVolumesFromSnapshotTest-2050907273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-3a124632-b007-4c13-b628-8570c81d19f0" returned: 0 in 0.308s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:25 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b9876ae3-43ee-4b11-9b39-4129f52da65b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "cinder-quobyte-3a124632-b007-4c13-b628-8570c81d19f0" released by "delete_volume" :: held 0.868s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:25 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-43d4c3f8-ab88-46f6-a46e-fa1862739ec8 tempest-CinderUnicodeTest-2026399211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec.info" returned: 0 in 0.288s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:25 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-43d4c3f8-ab88-46f6-a46e-fa1862739ec8 tempest-CinderUnicodeTest-2026399211 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec.info is being set with open permissions: ugo+rw Sep 03 14:36:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-43d4c3f8-ab88-46f6-a46e-fa1862739ec8 tempest-CinderUnicodeTest-2026399211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:25 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec.info Sep 03 14:36:25 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:25 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-b9876ae3-43ee-4b11-9b39-4129f52da65b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Created reservations ['7bd81dfc-b84b-4c0d-a9b4-04c4dc0b8dcf', 'e4dea960-6880-48ff-9930-f31f164ef47c', '713d6455-b29f-45bd-8da6-1652a6067eb8', 'ebb796b9-8329-4828-9f54-ee0f47d060f4'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:36:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b9876ae3-43ee-4b11-9b39-4129f52da65b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b9876ae3-43ee-4b11-9b39-4129f52da65b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:25 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b9876ae3-43ee-4b11-9b39-4129f52da65b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:36:25 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b9876ae3-43ee-4b11-9b39-4129f52da65b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:36:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b9876ae3-43ee-4b11-9b39-4129f52da65b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b9876ae3-43ee-4b11-9b39-4129f52da65b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:25 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:36:25 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:26 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-43d4c3f8-ab88-46f6-a46e-fa1862739ec8 tempest-CinderUnicodeTest-2026399211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec.info" returned: 0 in 0.282s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-43d4c3f8-ab88-46f6-a46e-fa1862739ec8 tempest-CinderUnicodeTest-2026399211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.324s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6e38d842-8d0f-4f7b-9b6e-8851b9392cf5 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.866s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:26 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-6e38d842-8d0f-4f7b-9b6e-8851b9392cf5 tempest-ProjectMemberTests-1350538287 None] Creating offline snapshot d4b5fff8-190e-420f-b519-e4bb6342a676 of volume ec5377cf-f803-440b-a9f3-5e44d019cae4 {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:36:26 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-43d4c3f8-ab88-46f6-a46e-fa1862739ec8 tempest-CinderUnicodeTest-2026399211 None] Create snapshot completed successfully Sep 03 14:36:26 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[263bbc58-cf3a-4123-b3e4-7c4471a5bf9f]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6e38d842-8d0f-4f7b-9b6e-8851b9392cf5 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec5377cf-f803-440b-a9f3-5e44d019cae4 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:26 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b9876ae3-43ee-4b11-9b39-4129f52da65b tempest-CreateVolumesFromSnapshotTest-2050907273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.280s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:26 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-b9876ae3-43ee-4b11-9b39-4129f52da65b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:36:26 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-b9876ae3-43ee-4b11-9b39-4129f52da65b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Deleted volume successfully. Sep 03 14:36:26 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b9876ae3-43ee-4b11-9b39-4129f52da65b tempest-CreateVolumesFromSnapshotTest-2050907273 None] Lock "cinder-3a124632-b007-4c13-b628-8570c81d19f0-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:26 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec5377cf-f803-440b-a9f3-5e44d019cae4 Sep 03 14:36:26 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:26 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6e38d842-8d0f-4f7b-9b6e-8851b9392cf5 tempest-ProjectMemberTests-1350538287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec5377cf-f803-440b-a9f3-5e44d019cae4" returned: 0 in 0.454s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6e38d842-8d0f-4f7b-9b6e-8851b9392cf5 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec5377cf-f803-440b-a9f3-5e44d019cae4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec5377cf-f803-440b-a9f3-5e44d019cae4.d4b5fff8-190e-420f-b519-e4bb6342a676 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:26 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec5377cf-f803-440b-a9f3-5e44d019cae4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec5377cf-f803-440b-a9f3-5e44d019cae4.d4b5fff8-190e-420f-b519-e4bb6342a676 1G Sep 03 14:36:26 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:27 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6e38d842-8d0f-4f7b-9b6e-8851b9392cf5 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec5377cf-f803-440b-a9f3-5e44d019cae4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec5377cf-f803-440b-a9f3-5e44d019cae4.d4b5fff8-190e-420f-b519-e4bb6342a676 1G" returned: 0 in 0.580s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6e38d842-8d0f-4f7b-9b6e-8851b9392cf5 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec5377cf-f803-440b-a9f3-5e44d019cae4 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec5377cf-f803-440b-a9f3-5e44d019cae4.d4b5fff8-190e-420f-b519-e4bb6342a676 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:27 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec5377cf-f803-440b-a9f3-5e44d019cae4 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec5377cf-f803-440b-a9f3-5e44d019cae4.d4b5fff8-190e-420f-b519-e4bb6342a676 Sep 03 14:36:27 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:27 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-be335dfb-20a9-4d7b-8879-0bbd10a52e98 tempest-CinderUnicodeTest-2026399211 None] Acquiring lock "cinder-9aa6ad1c-20f5-4920-8765-db79d469f4a6-delete_snapshot" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:27 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-be335dfb-20a9-4d7b-8879-0bbd10a52e98 tempest-CinderUnicodeTest-2026399211 None] Lock "cinder-9aa6ad1c-20f5-4920-8765-db79d469f4a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:27 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-be335dfb-20a9-4d7b-8879-0bbd10a52e98 tempest-CinderUnicodeTest-2026399211 None] Acquiring lock "cinder-quobyte-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:27 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-be335dfb-20a9-4d7b-8879-0bbd10a52e98 tempest-CinderUnicodeTest-2026399211 None] Lock "cinder-quobyte-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:27 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-be335dfb-20a9-4d7b-8879-0bbd10a52e98 tempest-CinderUnicodeTest-2026399211 None] Acquiring lock "cinder-quobyte-9aa6ad1c-20f5-4920-8765-db79d469f4a6" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:27 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-be335dfb-20a9-4d7b-8879-0bbd10a52e98 tempest-CinderUnicodeTest-2026399211 None] Lock "cinder-quobyte-9aa6ad1c-20f5-4920-8765-db79d469f4a6" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:27 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-be335dfb-20a9-4d7b-8879-0bbd10a52e98 tempest-CinderUnicodeTest-2026399211 None] Deleting offline snapshot 9aa6ad1c-20f5-4920-8765-db79d469f4a6 of volume 297ac0bc-9cb3-4b3f-a32e-9e9420db19ec {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:36:27 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-be335dfb-20a9-4d7b-8879-0bbd10a52e98 tempest-CinderUnicodeTest-2026399211 None] snapshot_file for this snap is: volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec.9aa6ad1c-20f5-4920-8765-db79d469f4a6 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:36:27 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0bd7c6-32ee-4240-a99a-040663e5cc06]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-be335dfb-20a9-4d7b-8879-0bbd10a52e98 tempest-CinderUnicodeTest-2026399211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec.9aa6ad1c-20f5-4920-8765-db79d469f4a6 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:27 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec.9aa6ad1c-20f5-4920-8765-db79d469f4a6 Sep 03 14:36:27 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:27 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6e38d842-8d0f-4f7b-9b6e-8851b9392cf5 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec5377cf-f803-440b-a9f3-5e44d019cae4 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec5377cf-f803-440b-a9f3-5e44d019cae4.d4b5fff8-190e-420f-b519-e4bb6342a676" returned: 0 in 0.452s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:27 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-6e38d842-8d0f-4f7b-9b6e-8851b9392cf5 tempest-ProjectMemberTests-1350538287 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec5377cf-f803-440b-a9f3-5e44d019cae4.d4b5fff8-190e-420f-b519-e4bb6342a676 is being set with open permissions: ugo+rw Sep 03 14:36:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6e38d842-8d0f-4f7b-9b6e-8851b9392cf5 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec5377cf-f803-440b-a9f3-5e44d019cae4.d4b5fff8-190e-420f-b519-e4bb6342a676 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:27 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec5377cf-f803-440b-a9f3-5e44d019cae4.d4b5fff8-190e-420f-b519-e4bb6342a676 Sep 03 14:36:27 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:27 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-be335dfb-20a9-4d7b-8879-0bbd10a52e98 tempest-CinderUnicodeTest-2026399211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec.9aa6ad1c-20f5-4920-8765-db79d469f4a6" returned: 0 in 0.449s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:27 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-be335dfb-20a9-4d7b-8879-0bbd10a52e98 tempest-CinderUnicodeTest-2026399211 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:36:27 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db42387-6b4d-45a9-8683-7675b2fa9163]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-be335dfb-20a9-4d7b-8879-0bbd10a52e98 tempest-CinderUnicodeTest-2026399211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:27 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6e38d842-8d0f-4f7b-9b6e-8851b9392cf5 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec5377cf-f803-440b-a9f3-5e44d019cae4.d4b5fff8-190e-420f-b519-e4bb6342a676" returned: 0 in 0.291s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6e38d842-8d0f-4f7b-9b6e-8851b9392cf5 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec5377cf-f803-440b-a9f3-5e44d019cae4.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:28 devstack sudo[107303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec5377cf-f803-440b-a9f3-5e44d019cae4.info Sep 03 14:36:28 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:28 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec Sep 03 14:36:28 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:28 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6e38d842-8d0f-4f7b-9b6e-8851b9392cf5 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec5377cf-f803-440b-a9f3-5e44d019cae4.info" returned: 0 in 0.331s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:28 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-6e38d842-8d0f-4f7b-9b6e-8851b9392cf5 tempest-ProjectMemberTests-1350538287 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec5377cf-f803-440b-a9f3-5e44d019cae4.info is being set with open permissions: ugo+rw Sep 03 14:36:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6e38d842-8d0f-4f7b-9b6e-8851b9392cf5 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec5377cf-f803-440b-a9f3-5e44d019cae4.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:28 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec5377cf-f803-440b-a9f3-5e44d019cae4.info Sep 03 14:36:28 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:28 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-be335dfb-20a9-4d7b-8879-0bbd10a52e98 tempest-CinderUnicodeTest-2026399211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec" returned: 0 in 0.499s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-be335dfb-20a9-4d7b-8879-0bbd10a52e98 tempest-CinderUnicodeTest-2026399211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec.9aa6ad1c-20f5-4920-8765-db79d469f4a6 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:28 devstack sudo[107312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec.9aa6ad1c-20f5-4920-8765-db79d469f4a6 Sep 03 14:36:28 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:28 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6e38d842-8d0f-4f7b-9b6e-8851b9392cf5 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec5377cf-f803-440b-a9f3-5e44d019cae4.info" returned: 0 in 0.316s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6e38d842-8d0f-4f7b-9b6e-8851b9392cf5 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.563s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:28 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-6e38d842-8d0f-4f7b-9b6e-8851b9392cf5 tempest-ProjectMemberTests-1350538287 None] Create snapshot completed successfully Sep 03 14:36:28 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-be335dfb-20a9-4d7b-8879-0bbd10a52e98 tempest-CinderUnicodeTest-2026399211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec.9aa6ad1c-20f5-4920-8765-db79d469f4a6" returned: 0 in 0.415s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-be335dfb-20a9-4d7b-8879-0bbd10a52e98 tempest-CinderUnicodeTest-2026399211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec.9aa6ad1c-20f5-4920-8765-db79d469f4a6 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:28 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec.9aa6ad1c-20f5-4920-8765-db79d469f4a6 Sep 03 14:36:28 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:29 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-be335dfb-20a9-4d7b-8879-0bbd10a52e98 tempest-CinderUnicodeTest-2026399211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec.9aa6ad1c-20f5-4920-8765-db79d469f4a6" returned: 0 in 0.261s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:29 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-be335dfb-20a9-4d7b-8879-0bbd10a52e98 tempest-CinderUnicodeTest-2026399211 None] Lock "cinder-quobyte-9aa6ad1c-20f5-4920-8765-db79d469f4a6" released by "_delete_snapshot" :: held 1.769s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:29 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-be335dfb-20a9-4d7b-8879-0bbd10a52e98 tempest-CinderUnicodeTest-2026399211 None] Lock "cinder-quobyte-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec" released by "delete_snapshot" :: held 1.805s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:29 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-be335dfb-20a9-4d7b-8879-0bbd10a52e98 tempest-CinderUnicodeTest-2026399211 None] Created reservations ['3b7e6b3b-facc-479c-a090-326c50b9396b', 'bc1b6e90-43e7-4b93-a96c-f6510ca4c58c', 'c4e05bf9-d13b-400d-9f97-f319cf21eeae', 'e5375a5c-75d2-4f81-a24e-d162b1fb026a'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:36:29 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-be335dfb-20a9-4d7b-8879-0bbd10a52e98 tempest-CinderUnicodeTest-2026399211 None] Delete snapshot completed successfully. Sep 03 14:36:29 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-be335dfb-20a9-4d7b-8879-0bbd10a52e98 tempest-CinderUnicodeTest-2026399211 None] Lock "cinder-9aa6ad1c-20f5-4920-8765-db79d469f4a6-delete_snapshot" released by "delete_snapshot" :: held 1.982s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:29 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-fb68d5a6-564f-43f1-ae41-e20983233962 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "cinder-d4b5fff8-190e-420f-b519-e4bb6342a676-delete_snapshot" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:29 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-fb68d5a6-564f-43f1-ae41-e20983233962 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-d4b5fff8-190e-420f-b519-e4bb6342a676-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:29 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-fb68d5a6-564f-43f1-ae41-e20983233962 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "cinder-quobyte-ec5377cf-f803-440b-a9f3-5e44d019cae4" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:29 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-fb68d5a6-564f-43f1-ae41-e20983233962 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-ec5377cf-f803-440b-a9f3-5e44d019cae4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:29 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-fb68d5a6-564f-43f1-ae41-e20983233962 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "cinder-quobyte-d4b5fff8-190e-420f-b519-e4bb6342a676" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:29 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-fb68d5a6-564f-43f1-ae41-e20983233962 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-d4b5fff8-190e-420f-b519-e4bb6342a676" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:29 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-fb68d5a6-564f-43f1-ae41-e20983233962 tempest-ProjectMemberTests-1350538287 None] Deleting offline snapshot d4b5fff8-190e-420f-b519-e4bb6342a676 of volume ec5377cf-f803-440b-a9f3-5e44d019cae4 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:36:29 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-fb68d5a6-564f-43f1-ae41-e20983233962 tempest-ProjectMemberTests-1350538287 None] snapshot_file for this snap is: volume-ec5377cf-f803-440b-a9f3-5e44d019cae4.d4b5fff8-190e-420f-b519-e4bb6342a676 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:36:29 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63e2b80-bbcb-422d-84f2-ac2363ef67b9]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fb68d5a6-564f-43f1-ae41-e20983233962 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec5377cf-f803-440b-a9f3-5e44d019cae4.d4b5fff8-190e-420f-b519-e4bb6342a676 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:29 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-0f94c636-878e-41f3-b180-b70708d1eeb1 tempest-CinderUnicodeTest-2026399211 None] Acquiring lock "cinder-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:29 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-0f94c636-878e-41f3-b180-b70708d1eeb1 tempest-CinderUnicodeTest-2026399211 None] Lock "cinder-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:29 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec5377cf-f803-440b-a9f3-5e44d019cae4.d4b5fff8-190e-420f-b519-e4bb6342a676 Sep 03 14:36:29 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:29 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-0f94c636-878e-41f3-b180-b70708d1eeb1 tempest-CinderUnicodeTest-2026399211 None] Acquiring lock "cinder-quobyte-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:29 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-0f94c636-878e-41f3-b180-b70708d1eeb1 tempest-CinderUnicodeTest-2026399211 None] Lock "cinder-quobyte-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec" acquired by "delete_volume" :: waited 0.027s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:29 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b7dd7e-23a4-41cb-8af9-ed131ee4379b]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0f94c636-878e-41f3-b180-b70708d1eeb1 tempest-CinderUnicodeTest-2026399211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:29 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec Sep 03 14:36:29 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:29 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fb68d5a6-564f-43f1-ae41-e20983233962 tempest-ProjectMemberTests-1350538287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec5377cf-f803-440b-a9f3-5e44d019cae4.d4b5fff8-190e-420f-b519-e4bb6342a676" returned: 0 in 0.477s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:29 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-fb68d5a6-564f-43f1-ae41-e20983233962 tempest-ProjectMemberTests-1350538287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec5377cf-f803-440b-a9f3-5e44d019cae4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:36:30 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf42cbd-1a52-460c-ba9c-0aa8b1435156]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fb68d5a6-564f-43f1-ae41-e20983233962 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec5377cf-f803-440b-a9f3-5e44d019cae4 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:30 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec5377cf-f803-440b-a9f3-5e44d019cae4 Sep 03 14:36:30 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:30 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-dd4e38ec-1645-45c8-8633-01f98b7ff938 tempest-ProjectAdminTests-1062613341 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8406867980957, 'free_capacity_gb': 1773.8406867980957, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87007) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 03 14:36:30 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0f94c636-878e-41f3-b180-b70708d1eeb1 tempest-CinderUnicodeTest-2026399211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec" returned: 0 in 0.452s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0f94c636-878e-41f3-b180-b70708d1eeb1 tempest-CinderUnicodeTest-2026399211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:30 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec Sep 03 14:36:30 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:30 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fb68d5a6-564f-43f1-ae41-e20983233962 tempest-ProjectMemberTests-1350538287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec5377cf-f803-440b-a9f3-5e44d019cae4" returned: 0 in 0.420s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fb68d5a6-564f-43f1-ae41-e20983233962 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec5377cf-f803-440b-a9f3-5e44d019cae4.d4b5fff8-190e-420f-b519-e4bb6342a676 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:30 devstack sudo[107339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec5377cf-f803-440b-a9f3-5e44d019cae4.d4b5fff8-190e-420f-b519-e4bb6342a676 Sep 03 14:36:30 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:30 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0f94c636-878e-41f3-b180-b70708d1eeb1 tempest-CinderUnicodeTest-2026399211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec" returned: 0 in 0.321s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:30 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-0f94c636-878e-41f3-b180-b70708d1eeb1 tempest-CinderUnicodeTest-2026399211 None] Lock "cinder-quobyte-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec" released by "delete_volume" :: held 0.851s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:30 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-0f94c636-878e-41f3-b180-b70708d1eeb1 tempest-CinderUnicodeTest-2026399211 None] Created reservations ['17ca9b70-2ce9-4496-93b1-4589cc64cc55', 'ac2df603-645c-49e0-9345-b4ebc8a1cbbf', '83c2e40e-b3c4-4464-8ee9-b0288e3dc5e8', '5bf0cd90-ffb8-4273-8e49-a68f0df3f31c'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:36:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-0f94c636-878e-41f3-b180-b70708d1eeb1 tempest-CinderUnicodeTest-2026399211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-0f94c636-878e-41f3-b180-b70708d1eeb1 tempest-CinderUnicodeTest-2026399211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:30 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-0f94c636-878e-41f3-b180-b70708d1eeb1 tempest-CinderUnicodeTest-2026399211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:36:30 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-0f94c636-878e-41f3-b180-b70708d1eeb1 tempest-CinderUnicodeTest-2026399211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:36:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-0f94c636-878e-41f3-b180-b70708d1eeb1 tempest-CinderUnicodeTest-2026399211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0f94c636-878e-41f3-b180-b70708d1eeb1 tempest-CinderUnicodeTest-2026399211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:30 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:36:30 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:30 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9ee37beb-58bb-4c85-92a1-5204b0e28afb tempest-CinderUnicodeTest-2026399211 None] Acquiring lock "cinder-5c53f9ce-a137-49aa-9bfe-07e86c6f34b8-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:30 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9ee37beb-58bb-4c85-92a1-5204b0e28afb tempest-CinderUnicodeTest-2026399211 None] Lock "cinder-5c53f9ce-a137-49aa-9bfe-07e86c6f34b8-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:30 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fb68d5a6-564f-43f1-ae41-e20983233962 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec5377cf-f803-440b-a9f3-5e44d019cae4.d4b5fff8-190e-420f-b519-e4bb6342a676" returned: 0 in 0.531s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fb68d5a6-564f-43f1-ae41-e20983233962 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec5377cf-f803-440b-a9f3-5e44d019cae4.d4b5fff8-190e-420f-b519-e4bb6342a676 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:30 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9ee37beb-58bb-4c85-92a1-5204b0e28afb tempest-CinderUnicodeTest-2026399211 None] Acquiring lock "cinder-quobyte-5c53f9ce-a137-49aa-9bfe-07e86c6f34b8" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:31 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9ee37beb-58bb-4c85-92a1-5204b0e28afb tempest-CinderUnicodeTest-2026399211 None] Lock "cinder-quobyte-5c53f9ce-a137-49aa-9bfe-07e86c6f34b8" acquired by "delete_volume" :: waited 0.024s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:31 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec5377cf-f803-440b-a9f3-5e44d019cae4.d4b5fff8-190e-420f-b519-e4bb6342a676 Sep 03 14:36:31 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:31 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d604a7bf-5346-4604-8616-61a04c490367]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9ee37beb-58bb-4c85-92a1-5204b0e28afb tempest-CinderUnicodeTest-2026399211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c53f9ce-a137-49aa-9bfe-07e86c6f34b8 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:31 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0f94c636-878e-41f3-b180-b70708d1eeb1 tempest-CinderUnicodeTest-2026399211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.364s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:31 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-0f94c636-878e-41f3-b180-b70708d1eeb1 tempest-CinderUnicodeTest-2026399211 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:36:31 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-0f94c636-878e-41f3-b180-b70708d1eeb1 tempest-CinderUnicodeTest-2026399211 None] Deleted volume successfully. Sep 03 14:36:31 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-0f94c636-878e-41f3-b180-b70708d1eeb1 tempest-CinderUnicodeTest-2026399211 None] Lock "cinder-297ac0bc-9cb3-4b3f-a32e-9e9420db19ec-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:31 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c53f9ce-a137-49aa-9bfe-07e86c6f34b8 Sep 03 14:36:31 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:31 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fb68d5a6-564f-43f1-ae41-e20983233962 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec5377cf-f803-440b-a9f3-5e44d019cae4.d4b5fff8-190e-420f-b519-e4bb6342a676" returned: 0 in 0.389s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:31 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-fb68d5a6-564f-43f1-ae41-e20983233962 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-d4b5fff8-190e-420f-b519-e4bb6342a676" released by "_delete_snapshot" :: held 1.953s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:31 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-fb68d5a6-564f-43f1-ae41-e20983233962 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-ec5377cf-f803-440b-a9f3-5e44d019cae4" released by "delete_snapshot" :: held 1.984s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:31 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-fb68d5a6-564f-43f1-ae41-e20983233962 tempest-ProjectMemberTests-1350538287 None] Created reservations ['7394ba5d-342d-4bfe-b5ac-be73f51ca68c', '2d45bb1e-47ba-40b9-8ce6-d33abf698d8c', '3d1a5f36-83e5-4e8d-8a07-df3fbb85e8a5', '4d9d2231-bf9d-4521-a342-789583c72649'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:36:31 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9ee37beb-58bb-4c85-92a1-5204b0e28afb tempest-CinderUnicodeTest-2026399211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c53f9ce-a137-49aa-9bfe-07e86c6f34b8" returned: 0 in 0.489s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9ee37beb-58bb-4c85-92a1-5204b0e28afb tempest-CinderUnicodeTest-2026399211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c53f9ce-a137-49aa-9bfe-07e86c6f34b8 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:31 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c53f9ce-a137-49aa-9bfe-07e86c6f34b8 Sep 03 14:36:31 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:31 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-fb68d5a6-564f-43f1-ae41-e20983233962 tempest-ProjectMemberTests-1350538287 None] Delete snapshot completed successfully. Sep 03 14:36:31 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-fb68d5a6-564f-43f1-ae41-e20983233962 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-d4b5fff8-190e-420f-b519-e4bb6342a676-delete_snapshot" released by "delete_snapshot" :: held 2.172s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:31 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-77e0af62-b6cb-490f-a7aa-10507808d245 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "cinder-ec5377cf-f803-440b-a9f3-5e44d019cae4-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:31 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-77e0af62-b6cb-490f-a7aa-10507808d245 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-ec5377cf-f803-440b-a9f3-5e44d019cae4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:31 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-77e0af62-b6cb-490f-a7aa-10507808d245 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "cinder-quobyte-ec5377cf-f803-440b-a9f3-5e44d019cae4" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:31 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-77e0af62-b6cb-490f-a7aa-10507808d245 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-ec5377cf-f803-440b-a9f3-5e44d019cae4" acquired by "delete_volume" :: waited 0.017s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:31 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:31 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0193da29-53b6-4429-b9fd-db6e269a1749]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-77e0af62-b6cb-490f-a7aa-10507808d245 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec5377cf-f803-440b-a9f3-5e44d019cae4 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9ee37beb-58bb-4c85-92a1-5204b0e28afb tempest-CinderUnicodeTest-2026399211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-5c53f9ce-a137-49aa-9bfe-07e86c6f34b8" returned: 0 in 0.436s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:32 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9ee37beb-58bb-4c85-92a1-5204b0e28afb tempest-CinderUnicodeTest-2026399211 None] Lock "cinder-quobyte-5c53f9ce-a137-49aa-9bfe-07e86c6f34b8" released by "delete_volume" :: held 0.996s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:32 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-9ee37beb-58bb-4c85-92a1-5204b0e28afb tempest-CinderUnicodeTest-2026399211 None] Created reservations ['90288521-d692-446d-8aba-e4f955a2aadc', 'e5108a2f-349d-4e96-b159-18e2a15c12f6', 'b96db2b9-cbcb-4235-ae04-191f63520c48', '2cd6e1d8-61d4-4851-94bb-721f5d162254'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:36:32 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec5377cf-f803-440b-a9f3-5e44d019cae4 Sep 03 14:36:32 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-9ee37beb-58bb-4c85-92a1-5204b0e28afb tempest-CinderUnicodeTest-2026399211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-9ee37beb-58bb-4c85-92a1-5204b0e28afb tempest-CinderUnicodeTest-2026399211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:32 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-9ee37beb-58bb-4c85-92a1-5204b0e28afb tempest-CinderUnicodeTest-2026399211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:36:32 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-9ee37beb-58bb-4c85-92a1-5204b0e28afb tempest-CinderUnicodeTest-2026399211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:36:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-9ee37beb-58bb-4c85-92a1-5204b0e28afb tempest-CinderUnicodeTest-2026399211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9ee37beb-58bb-4c85-92a1-5204b0e28afb tempest-CinderUnicodeTest-2026399211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:32 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:36:32 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:32 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-77e0af62-b6cb-490f-a7aa-10507808d245 tempest-ProjectMemberTests-1350538287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec5377cf-f803-440b-a9f3-5e44d019cae4" returned: 0 in 0.459s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-77e0af62-b6cb-490f-a7aa-10507808d245 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec5377cf-f803-440b-a9f3-5e44d019cae4 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:32 devstack sudo[107370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec5377cf-f803-440b-a9f3-5e44d019cae4 Sep 03 14:36:32 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:32 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9ee37beb-58bb-4c85-92a1-5204b0e28afb tempest-CinderUnicodeTest-2026399211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.312s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:32 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-9ee37beb-58bb-4c85-92a1-5204b0e28afb tempest-CinderUnicodeTest-2026399211 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:36:32 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-9ee37beb-58bb-4c85-92a1-5204b0e28afb tempest-CinderUnicodeTest-2026399211 None] Deleted volume successfully. Sep 03 14:36:32 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9ee37beb-58bb-4c85-92a1-5204b0e28afb tempest-CinderUnicodeTest-2026399211 None] Lock "cinder-5c53f9ce-a137-49aa-9bfe-07e86c6f34b8-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:32 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-77e0af62-b6cb-490f-a7aa-10507808d245 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-ec5377cf-f803-440b-a9f3-5e44d019cae4" returned: 0 in 0.279s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:32 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-77e0af62-b6cb-490f-a7aa-10507808d245 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-ec5377cf-f803-440b-a9f3-5e44d019cae4" released by "delete_volume" :: held 0.824s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:32 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-77e0af62-b6cb-490f-a7aa-10507808d245 tempest-ProjectMemberTests-1350538287 None] Created reservations ['f697746f-40b2-4faf-aa01-1a939327bf83', 'b027738f-ae8d-4383-9e83-512d3b1702af', 'b9563321-d199-4f34-81fe-fbe01758faa9', '7e2027a6-9aaf-4a22-bc51-c1cbe4197a2f'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:36:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-77e0af62-b6cb-490f-a7aa-10507808d245 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-77e0af62-b6cb-490f-a7aa-10507808d245 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:32 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-77e0af62-b6cb-490f-a7aa-10507808d245 tempest-ProjectMemberTests-1350538287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:36:32 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-77e0af62-b6cb-490f-a7aa-10507808d245 tempest-ProjectMemberTests-1350538287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:36:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-77e0af62-b6cb-490f-a7aa-10507808d245 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-77e0af62-b6cb-490f-a7aa-10507808d245 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:32 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:36:32 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:33 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:33 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-77e0af62-b6cb-490f-a7aa-10507808d245 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.314s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:33 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-77e0af62-b6cb-490f-a7aa-10507808d245 tempest-ProjectMemberTests-1350538287 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:36:33 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-77e0af62-b6cb-490f-a7aa-10507808d245 tempest-ProjectMemberTests-1350538287 None] Deleted volume successfully. Sep 03 14:36:33 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-77e0af62-b6cb-490f-a7aa-10507808d245 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-ec5377cf-f803-440b-a9f3-5e44d019cae4-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:33 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a92854e-bf04-493b-b4a8-db4a52a21288 tempest-ProjectMemberTests-1350538287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:36:33 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6a92854e-bf04-493b-b4a8-db4a52a21288 tempest-ProjectMemberTests-1350538287 None] Flow 'volume_create_manager' (942f2d77-b63b-4df3-929f-36e88f5c70b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:36:33 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6a92854e-bf04-493b-b4a8-db4a52a21288 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (847f1141-741a-42ee-ac8f-f449ec560e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:33 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6a92854e-bf04-493b-b4a8-db4a52a21288 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (847f1141-741a-42ee-ac8f-f449ec560e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1061034717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36b7ad6b-0931-4fdb-b3c0-21166311b2d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bdc07719fdf40189d19adf3cf793220',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:36:34Z,use_quota=True,user_id='c0e0fc3b02a64f5b9b037ade3f94a724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:33 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6a92854e-bf04-493b-b4a8-db4a52a21288 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a95615b3-c84f-4750-93e2-31697903821b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:33 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6a92854e-bf04-493b-b4a8-db4a52a21288 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a95615b3-c84f-4750-93e2-31697903821b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:33 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6a92854e-bf04-493b-b4a8-db4a52a21288 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2db889e-a955-43e8-be53-e81876431ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:33 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6a92854e-bf04-493b-b4a8-db4a52a21288 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2db889e-a955-43e8-be53-e81876431ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36b7ad6b-0931-4fdb-b3c0-21166311b2d3', 'volume_name': 'volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:33 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6a92854e-bf04-493b-b4a8-db4a52a21288 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05c5f489-ee2b-4cd5-ba6c-f6693d1c7e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:33 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6a92854e-bf04-493b-b4a8-db4a52a21288 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05c5f489-ee2b-4cd5-ba6c-f6693d1c7e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:33 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6a92854e-bf04-493b-b4a8-db4a52a21288 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (153f7fbe-5061-4c1a-a721-64eeeb1e29f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:33 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-6a92854e-bf04-493b-b4a8-db4a52a21288 tempest-ProjectMemberTests-1350538287 None] Volume 36b7ad6b-0931-4fdb-b3c0-21166311b2d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3', 'volume_size': 1} Sep 03 14:36:33 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6a92854e-bf04-493b-b4a8-db4a52a21288 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:33 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6a92854e-bf04-493b-b4a8-db4a52a21288 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:33 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-6a92854e-bf04-493b-b4a8-db4a52a21288 tempest-ProjectMemberTests-1350538287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1061034717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36b7ad6b-0931-4fdb-b3c0-21166311b2d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bdc07719fdf40189d19adf3cf793220',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:36:34Z,use_quota=True,user_id='c0e0fc3b02a64f5b9b037ade3f94a724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:36:33 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-6a92854e-bf04-493b-b4a8-db4a52a21288 tempest-ProjectMemberTests-1350538287 None] Creating volume 36b7ad6b-0931-4fdb-b3c0-21166311b2d3 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:36:33 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6a92854e-bf04-493b-b4a8-db4a52a21288 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:33 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6a92854e-bf04-493b-b4a8-db4a52a21288 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:33 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-6a92854e-bf04-493b-b4a8-db4a52a21288 tempest-ProjectMemberTests-1350538287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:36:33 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-6a92854e-bf04-493b-b4a8-db4a52a21288 tempest-ProjectMemberTests-1350538287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:36:33 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6a92854e-bf04-493b-b4a8-db4a52a21288 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:33 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-6a92854e-bf04-493b-b4a8-db4a52a21288 tempest-ProjectMemberTests-1350538287 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:36:33 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-6a92854e-bf04-493b-b4a8-db4a52a21288 tempest-ProjectMemberTests-1350538287 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:36:33 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6a92854e-bf04-493b-b4a8-db4a52a21288 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:33 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3 1073741824 Sep 03 14:36:33 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:34 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6a92854e-bf04-493b-b4a8-db4a52a21288 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3 1073741824" returned: 0 in 0.622s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6a92854e-bf04-493b-b4a8-db4a52a21288 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:34 devstack sudo[107381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3 Sep 03 14:36:34 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:34 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6a92854e-bf04-493b-b4a8-db4a52a21288 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3" returned: 0 in 0.276s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:34 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-6a92854e-bf04-493b-b4a8-db4a52a21288 tempest-ProjectMemberTests-1350538287 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:36:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6a92854e-bf04-493b-b4a8-db4a52a21288 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:34 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6a92854e-bf04-493b-b4a8-db4a52a21288 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (153f7fbe-5061-4c1a-a721-64eeeb1e29f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:34 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6a92854e-bf04-493b-b4a8-db4a52a21288 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d529eb1d-73ce-49df-862a-a083ee252bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:34 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-6a92854e-bf04-493b-b4a8-db4a52a21288 tempest-ProjectMemberTests-1350538287 None] Volume volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3 (36b7ad6b-0931-4fdb-b3c0-21166311b2d3): created successfully Sep 03 14:36:34 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6a92854e-bf04-493b-b4a8-db4a52a21288 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d529eb1d-73ce-49df-862a-a083ee252bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:34 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-6a92854e-bf04-493b-b4a8-db4a52a21288 tempest-ProjectMemberTests-1350538287 None] Flow 'volume_create_manager' (942f2d77-b63b-4df3-929f-36e88f5c70b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:36:34 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-6a92854e-bf04-493b-b4a8-db4a52a21288 tempest-ProjectMemberTests-1350538287 None] Created volume successfully. Sep 03 14:36:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ba596a99-4672-4afc-9d11-19f8fd654941 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ba596a99-4672-4afc-9d11-19f8fd654941 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:35 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-ba596a99-4672-4afc-9d11-19f8fd654941 tempest-ProjectMemberTests-1350538287 None] Creating offline snapshot addc387b-d07e-4a4e-9d98-b7f85e8790c3 of volume 36b7ad6b-0931-4fdb-b3c0-21166311b2d3 {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:36:35 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2642373-35a9-42e2-9f59-b47e11ce6d99]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:35 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ba596a99-4672-4afc-9d11-19f8fd654941 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:36 devstack sudo[107384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3 Sep 03 14:36:36 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:36 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ba596a99-4672-4afc-9d11-19f8fd654941 tempest-ProjectMemberTests-1350538287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3" returned: 0 in 0.399s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ba596a99-4672-4afc-9d11-19f8fd654941 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3.addc387b-d07e-4a4e-9d98-b7f85e8790c3 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:36 devstack sudo[107390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3.addc387b-d07e-4a4e-9d98-b7f85e8790c3 1G Sep 03 14:36:36 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:36 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ba596a99-4672-4afc-9d11-19f8fd654941 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3.addc387b-d07e-4a4e-9d98-b7f85e8790c3 1G" returned: 0 in 0.512s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:36 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ba596a99-4672-4afc-9d11-19f8fd654941 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3.addc387b-d07e-4a4e-9d98-b7f85e8790c3 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:36 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3.addc387b-d07e-4a4e-9d98-b7f85e8790c3 Sep 03 14:36:36 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:37 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ba596a99-4672-4afc-9d11-19f8fd654941 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3.addc387b-d07e-4a4e-9d98-b7f85e8790c3" returned: 0 in 0.425s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:37 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-ba596a99-4672-4afc-9d11-19f8fd654941 tempest-ProjectMemberTests-1350538287 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3.addc387b-d07e-4a4e-9d98-b7f85e8790c3 is being set with open permissions: ugo+rw Sep 03 14:36:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ba596a99-4672-4afc-9d11-19f8fd654941 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3.addc387b-d07e-4a4e-9d98-b7f85e8790c3 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:37 devstack sudo[107403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3.addc387b-d07e-4a4e-9d98-b7f85e8790c3 Sep 03 14:36:37 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:37 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ba596a99-4672-4afc-9d11-19f8fd654941 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3.addc387b-d07e-4a4e-9d98-b7f85e8790c3" returned: 0 in 0.351s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ba596a99-4672-4afc-9d11-19f8fd654941 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:37 devstack sudo[107406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3.info Sep 03 14:36:37 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:37 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ba596a99-4672-4afc-9d11-19f8fd654941 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3.info" returned: 0 in 0.278s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:37 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-ba596a99-4672-4afc-9d11-19f8fd654941 tempest-ProjectMemberTests-1350538287 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3.info is being set with open permissions: ugo+rw Sep 03 14:36:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ba596a99-4672-4afc-9d11-19f8fd654941 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:37 devstack sudo[107409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3.info Sep 03 14:36:37 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:38 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ba596a99-4672-4afc-9d11-19f8fd654941 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3.info" returned: 0 in 0.297s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ba596a99-4672-4afc-9d11-19f8fd654941 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.367s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:38 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-ba596a99-4672-4afc-9d11-19f8fd654941 tempest-ProjectMemberTests-1350538287 None] Create snapshot completed successfully Sep 03 14:36:39 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-13ed882c-634b-410a-b9f9-9487011de0d8 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "cinder-addc387b-d07e-4a4e-9d98-b7f85e8790c3-delete_snapshot" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:39 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-13ed882c-634b-410a-b9f9-9487011de0d8 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-addc387b-d07e-4a4e-9d98-b7f85e8790c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:39 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-13ed882c-634b-410a-b9f9-9487011de0d8 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "cinder-quobyte-36b7ad6b-0931-4fdb-b3c0-21166311b2d3" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:39 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-13ed882c-634b-410a-b9f9-9487011de0d8 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-36b7ad6b-0931-4fdb-b3c0-21166311b2d3" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:39 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-13ed882c-634b-410a-b9f9-9487011de0d8 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "cinder-quobyte-addc387b-d07e-4a4e-9d98-b7f85e8790c3" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:39 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-13ed882c-634b-410a-b9f9-9487011de0d8 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-addc387b-d07e-4a4e-9d98-b7f85e8790c3" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:39 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-13ed882c-634b-410a-b9f9-9487011de0d8 tempest-ProjectMemberTests-1350538287 None] Deleting offline snapshot addc387b-d07e-4a4e-9d98-b7f85e8790c3 of volume 36b7ad6b-0931-4fdb-b3c0-21166311b2d3 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:36:39 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-13ed882c-634b-410a-b9f9-9487011de0d8 tempest-ProjectMemberTests-1350538287 None] snapshot_file for this snap is: volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3.addc387b-d07e-4a4e-9d98-b7f85e8790c3 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:36:39 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7d4ad8-814c-4433-962c-2376edc10843]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-13ed882c-634b-410a-b9f9-9487011de0d8 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3.addc387b-d07e-4a4e-9d98-b7f85e8790c3 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:39 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3.addc387b-d07e-4a4e-9d98-b7f85e8790c3 Sep 03 14:36:39 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:39 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-13ed882c-634b-410a-b9f9-9487011de0d8 tempest-ProjectMemberTests-1350538287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3.addc387b-d07e-4a4e-9d98-b7f85e8790c3" returned: 0 in 0.392s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:39 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-13ed882c-634b-410a-b9f9-9487011de0d8 tempest-ProjectMemberTests-1350538287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:36:39 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7398feb2-e41a-4a96-9c4c-9d504f09cbb8]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-13ed882c-634b-410a-b9f9-9487011de0d8 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:39 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3 Sep 03 14:36:39 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:40 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-13ed882c-634b-410a-b9f9-9487011de0d8 tempest-ProjectMemberTests-1350538287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3" returned: 0 in 0.391s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-13ed882c-634b-410a-b9f9-9487011de0d8 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3.addc387b-d07e-4a4e-9d98-b7f85e8790c3 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:40 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3.addc387b-d07e-4a4e-9d98-b7f85e8790c3 Sep 03 14:36:40 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:40 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-13ed882c-634b-410a-b9f9-9487011de0d8 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3.addc387b-d07e-4a4e-9d98-b7f85e8790c3" returned: 0 in 0.454s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-13ed882c-634b-410a-b9f9-9487011de0d8 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3.addc387b-d07e-4a4e-9d98-b7f85e8790c3 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:40 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3.addc387b-d07e-4a4e-9d98-b7f85e8790c3 Sep 03 14:36:40 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:40 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-13ed882c-634b-410a-b9f9-9487011de0d8 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3.addc387b-d07e-4a4e-9d98-b7f85e8790c3" returned: 0 in 0.313s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:40 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-13ed882c-634b-410a-b9f9-9487011de0d8 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-addc387b-d07e-4a4e-9d98-b7f85e8790c3" released by "_delete_snapshot" :: held 1.676s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:40 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-13ed882c-634b-410a-b9f9-9487011de0d8 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-36b7ad6b-0931-4fdb-b3c0-21166311b2d3" released by "delete_snapshot" :: held 1.705s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:40 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:SELECT=225,cinder:UPDATE=328,cinder:DELETE=30,cinder:INSERT=89 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:36:40 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:SELECT=250,cinder:UPDATE=307,cinder:INSERT=82,cinder:DELETE=27 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:36:41 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-13ed882c-634b-410a-b9f9-9487011de0d8 tempest-ProjectMemberTests-1350538287 None] Created reservations ['48f77eec-6c98-454e-9c8b-de93073d0e70', '6de467e2-f488-4acc-9330-042d19195289', '0e0cc14d-c454-47c7-8314-30505f6dca10', '2b9321e7-a4b3-4d50-bee1-46696afc5d9b'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:36:41 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-13ed882c-634b-410a-b9f9-9487011de0d8 tempest-ProjectMemberTests-1350538287 None] Delete snapshot completed successfully. Sep 03 14:36:41 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-13ed882c-634b-410a-b9f9-9487011de0d8 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-addc387b-d07e-4a4e-9d98-b7f85e8790c3-delete_snapshot" released by "delete_snapshot" :: held 1.942s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:41 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9af209bd-dc3d-45aa-ab65-3b11d8288c30 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "cinder-36b7ad6b-0931-4fdb-b3c0-21166311b2d3-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:41 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9af209bd-dc3d-45aa-ab65-3b11d8288c30 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-36b7ad6b-0931-4fdb-b3c0-21166311b2d3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:41 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9af209bd-dc3d-45aa-ab65-3b11d8288c30 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "cinder-quobyte-36b7ad6b-0931-4fdb-b3c0-21166311b2d3" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:41 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9af209bd-dc3d-45aa-ab65-3b11d8288c30 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-36b7ad6b-0931-4fdb-b3c0-21166311b2d3" acquired by "delete_volume" :: waited 0.024s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:41 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a12813-25a9-40ef-ac7b-52a150820eb2]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9af209bd-dc3d-45aa-ab65-3b11d8288c30 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:41 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-96e582bc-265b-40ed-b54a-090a74f7f84f tempest-ProjectReaderTests-1549199481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:36:41 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3 Sep 03 14:36:41 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-96e582bc-265b-40ed-b54a-090a74f7f84f tempest-ProjectReaderTests-1549199481 None] Flow 'volume_create_manager' (f3a0c0c4-7325-4bcb-9db5-722102a1bd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:36:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-96e582bc-265b-40ed-b54a-090a74f7f84f tempest-ProjectReaderTests-1549199481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ff8ee8a-7e12-468c-b72d-76b4239fee27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-96e582bc-265b-40ed-b54a-090a74f7f84f tempest-ProjectReaderTests-1549199481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ff8ee8a-7e12-468c-b72d-76b4239fee27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:36:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1544058491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6376dcc2-9cda-4a5b-9d19-306760482161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19128db13d014081bf2c983b36fd7685',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:36:42Z,use_quota=True,user_id='4b45c1735ead449c9469db38931e6c80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-96e582bc-265b-40ed-b54a-090a74f7f84f tempest-ProjectReaderTests-1549199481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c591a58a-ddee-43d5-98f8-87a533e072d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-96e582bc-265b-40ed-b54a-090a74f7f84f tempest-ProjectReaderTests-1549199481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c591a58a-ddee-43d5-98f8-87a533e072d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-96e582bc-265b-40ed-b54a-090a74f7f84f tempest-ProjectReaderTests-1549199481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5b3485d-0821-451c-9a76-b5b4a051a1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-96e582bc-265b-40ed-b54a-090a74f7f84f tempest-ProjectReaderTests-1549199481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5b3485d-0821-451c-9a76-b5b4a051a1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6376dcc2-9cda-4a5b-9d19-306760482161', 'volume_name': 'volume-6376dcc2-9cda-4a5b-9d19-306760482161', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-96e582bc-265b-40ed-b54a-090a74f7f84f tempest-ProjectReaderTests-1549199481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3a2b735-cbd4-4a0d-8ba3-c892237d4af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-96e582bc-265b-40ed-b54a-090a74f7f84f tempest-ProjectReaderTests-1549199481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3a2b735-cbd4-4a0d-8ba3-c892237d4af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-96e582bc-265b-40ed-b54a-090a74f7f84f tempest-ProjectReaderTests-1549199481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (634cb0b2-f239-4deb-bb2a-c0ad8f904de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:41 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-96e582bc-265b-40ed-b54a-090a74f7f84f tempest-ProjectReaderTests-1549199481 None] Volume 6376dcc2-9cda-4a5b-9d19-306760482161: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6376dcc2-9cda-4a5b-9d19-306760482161', 'volume_size': 1} Sep 03 14:36:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-96e582bc-265b-40ed-b54a-090a74f7f84f tempest-ProjectReaderTests-1549199481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-96e582bc-265b-40ed-b54a-090a74f7f84f tempest-ProjectReaderTests-1549199481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-96e582bc-265b-40ed-b54a-090a74f7f84f tempest-ProjectReaderTests-1549199481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:36:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1544058491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6376dcc2-9cda-4a5b-9d19-306760482161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19128db13d014081bf2c983b36fd7685',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:36:42Z,use_quota=True,user_id='4b45c1735ead449c9469db38931e6c80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:36:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-96e582bc-265b-40ed-b54a-090a74f7f84f tempest-ProjectReaderTests-1549199481 None] Creating volume 6376dcc2-9cda-4a5b-9d19-306760482161 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:36:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-96e582bc-265b-40ed-b54a-090a74f7f84f tempest-ProjectReaderTests-1549199481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-96e582bc-265b-40ed-b54a-090a74f7f84f tempest-ProjectReaderTests-1549199481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-96e582bc-265b-40ed-b54a-090a74f7f84f tempest-ProjectReaderTests-1549199481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:36:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-96e582bc-265b-40ed-b54a-090a74f7f84f tempest-ProjectReaderTests-1549199481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:36:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-96e582bc-265b-40ed-b54a-090a74f7f84f tempest-ProjectReaderTests-1549199481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-96e582bc-265b-40ed-b54a-090a74f7f84f tempest-ProjectReaderTests-1549199481 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:36:41 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-96e582bc-265b-40ed-b54a-090a74f7f84f tempest-ProjectReaderTests-1549199481 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:36:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-96e582bc-265b-40ed-b54a-090a74f7f84f tempest-ProjectReaderTests-1549199481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6376dcc2-9cda-4a5b-9d19-306760482161 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:42 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6376dcc2-9cda-4a5b-9d19-306760482161 1073741824 Sep 03 14:36:42 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:42 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9af209bd-dc3d-45aa-ab65-3b11d8288c30 tempest-ProjectMemberTests-1350538287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3" returned: 0 in 0.424s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9af209bd-dc3d-45aa-ab65-3b11d8288c30 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:42 devstack sudo[107439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3 Sep 03 14:36:42 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:42 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:42 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-96e582bc-265b-40ed-b54a-090a74f7f84f tempest-ProjectReaderTests-1549199481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6376dcc2-9cda-4a5b-9d19-306760482161 1073741824" returned: 0 in 0.474s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9af209bd-dc3d-45aa-ab65-3b11d8288c30 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-36b7ad6b-0931-4fdb-b3c0-21166311b2d3" returned: 0 in 0.290s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:42 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9af209bd-dc3d-45aa-ab65-3b11d8288c30 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-36b7ad6b-0931-4fdb-b3c0-21166311b2d3" released by "delete_volume" :: held 0.785s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-96e582bc-265b-40ed-b54a-090a74f7f84f tempest-ProjectReaderTests-1549199481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6376dcc2-9cda-4a5b-9d19-306760482161 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:42 devstack sudo[107446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6376dcc2-9cda-4a5b-9d19-306760482161 Sep 03 14:36:42 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:42 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-9af209bd-dc3d-45aa-ab65-3b11d8288c30 tempest-ProjectMemberTests-1350538287 None] Created reservations ['add3548c-30c5-4f96-87cc-cb6dfc8025d3', '1c60a03a-8045-4ef4-a892-aef58b1183b5', 'b2cf596b-4a1c-4ec9-9de9-4f7f4cd0f4cd', 'ac0b75f0-c952-4fc1-b84b-46d08e15d449'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:36:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-9af209bd-dc3d-45aa-ab65-3b11d8288c30 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-9af209bd-dc3d-45aa-ab65-3b11d8288c30 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:42 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-9af209bd-dc3d-45aa-ab65-3b11d8288c30 tempest-ProjectMemberTests-1350538287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:36:42 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-9af209bd-dc3d-45aa-ab65-3b11d8288c30 tempest-ProjectMemberTests-1350538287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:36:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-9af209bd-dc3d-45aa-ab65-3b11d8288c30 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9af209bd-dc3d-45aa-ab65-3b11d8288c30 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:42 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:36:42 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:42 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-96e582bc-265b-40ed-b54a-090a74f7f84f tempest-ProjectReaderTests-1549199481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6376dcc2-9cda-4a5b-9d19-306760482161" returned: 0 in 0.355s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:42 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-96e582bc-265b-40ed-b54a-090a74f7f84f tempest-ProjectReaderTests-1549199481 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:36:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-96e582bc-265b-40ed-b54a-090a74f7f84f tempest-ProjectReaderTests-1549199481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-96e582bc-265b-40ed-b54a-090a74f7f84f tempest-ProjectReaderTests-1549199481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (634cb0b2-f239-4deb-bb2a-c0ad8f904de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6376dcc2-9cda-4a5b-9d19-306760482161', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-96e582bc-265b-40ed-b54a-090a74f7f84f tempest-ProjectReaderTests-1549199481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89f1551c-d653-403f-ba4e-9edf77355a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:42 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-96e582bc-265b-40ed-b54a-090a74f7f84f tempest-ProjectReaderTests-1549199481 None] Volume volume-6376dcc2-9cda-4a5b-9d19-306760482161 (6376dcc2-9cda-4a5b-9d19-306760482161): created successfully Sep 03 14:36:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-96e582bc-265b-40ed-b54a-090a74f7f84f tempest-ProjectReaderTests-1549199481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89f1551c-d653-403f-ba4e-9edf77355a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-96e582bc-265b-40ed-b54a-090a74f7f84f tempest-ProjectReaderTests-1549199481 None] Flow 'volume_create_manager' (f3a0c0c4-7325-4bcb-9db5-722102a1bd40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:36:42 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9af209bd-dc3d-45aa-ab65-3b11d8288c30 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.357s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:43 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-9af209bd-dc3d-45aa-ab65-3b11d8288c30 tempest-ProjectMemberTests-1350538287 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:36:43 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-96e582bc-265b-40ed-b54a-090a74f7f84f tempest-ProjectReaderTests-1549199481 None] Created volume successfully. Sep 03 14:36:43 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-9af209bd-dc3d-45aa-ab65-3b11d8288c30 tempest-ProjectMemberTests-1350538287 None] Deleted volume successfully. Sep 03 14:36:43 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-9af209bd-dc3d-45aa-ab65-3b11d8288c30 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-36b7ad6b-0931-4fdb-b3c0-21166311b2d3-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:43 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-c197f51d-3aa7-4fd9-ab5f-660b8c5dcfd8 tempest-ProjectMemberTests-1350538287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:36:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c197f51d-3aa7-4fd9-ab5f-660b8c5dcfd8 tempest-ProjectMemberTests-1350538287 None] Flow 'volume_create_manager' (c711f222-e584-41c1-aef9-cf75722e9575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:36:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c197f51d-3aa7-4fd9-ab5f-660b8c5dcfd8 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19a35003-9abb-4c74-b11d-34801e93c2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c197f51d-3aa7-4fd9-ab5f-660b8c5dcfd8 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19a35003-9abb-4c74-b11d-34801e93c2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-873400430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da7b9966-1d03-41f2-98d2-ccaa55baad9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bdc07719fdf40189d19adf3cf793220',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:36:43Z,use_quota=True,user_id='c0e0fc3b02a64f5b9b037ade3f94a724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c197f51d-3aa7-4fd9-ab5f-660b8c5dcfd8 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ad90a6d-2237-411a-ad72-a4f2630695e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c197f51d-3aa7-4fd9-ab5f-660b8c5dcfd8 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ad90a6d-2237-411a-ad72-a4f2630695e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c197f51d-3aa7-4fd9-ab5f-660b8c5dcfd8 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd3b15c3-6683-458d-bbf5-aa2adc148027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c197f51d-3aa7-4fd9-ab5f-660b8c5dcfd8 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd3b15c3-6683-458d-bbf5-aa2adc148027) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da7b9966-1d03-41f2-98d2-ccaa55baad9a', 'volume_name': 'volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c197f51d-3aa7-4fd9-ab5f-660b8c5dcfd8 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cb5de9e-4ac4-4acf-8549-93ea3494c0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c197f51d-3aa7-4fd9-ab5f-660b8c5dcfd8 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cb5de9e-4ac4-4acf-8549-93ea3494c0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:43 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c197f51d-3aa7-4fd9-ab5f-660b8c5dcfd8 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0a3c56d-4b66-4aed-9f2e-408269034f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:43 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-c197f51d-3aa7-4fd9-ab5f-660b8c5dcfd8 tempest-ProjectMemberTests-1350538287 None] Volume da7b9966-1d03-41f2-98d2-ccaa55baad9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a', 'volume_size': 1} Sep 03 14:36:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c197f51d-3aa7-4fd9-ab5f-660b8c5dcfd8 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c197f51d-3aa7-4fd9-ab5f-660b8c5dcfd8 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:43 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-c197f51d-3aa7-4fd9-ab5f-660b8c5dcfd8 tempest-ProjectMemberTests-1350538287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-873400430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da7b9966-1d03-41f2-98d2-ccaa55baad9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bdc07719fdf40189d19adf3cf793220',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:36:43Z,use_quota=True,user_id='c0e0fc3b02a64f5b9b037ade3f94a724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:36:43 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-c197f51d-3aa7-4fd9-ab5f-660b8c5dcfd8 tempest-ProjectMemberTests-1350538287 None] Creating volume da7b9966-1d03-41f2-98d2-ccaa55baad9a {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:36:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c197f51d-3aa7-4fd9-ab5f-660b8c5dcfd8 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c197f51d-3aa7-4fd9-ab5f-660b8c5dcfd8 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:43 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-c197f51d-3aa7-4fd9-ab5f-660b8c5dcfd8 tempest-ProjectMemberTests-1350538287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:36:43 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-c197f51d-3aa7-4fd9-ab5f-660b8c5dcfd8 tempest-ProjectMemberTests-1350538287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:36:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c197f51d-3aa7-4fd9-ab5f-660b8c5dcfd8 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:43 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-c197f51d-3aa7-4fd9-ab5f-660b8c5dcfd8 tempest-ProjectMemberTests-1350538287 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:36:43 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-c197f51d-3aa7-4fd9-ab5f-660b8c5dcfd8 tempest-ProjectMemberTests-1350538287 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:36:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c197f51d-3aa7-4fd9-ab5f-660b8c5dcfd8 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:43 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a 1073741824 Sep 03 14:36:43 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:43 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c197f51d-3aa7-4fd9-ab5f-660b8c5dcfd8 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a 1073741824" returned: 0 in 0.524s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c197f51d-3aa7-4fd9-ab5f-660b8c5dcfd8 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:44 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a Sep 03 14:36:44 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:44 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b2516f62-17d0-4cd7-be6c-d0449d7bce44 tempest-ProjectReaderTests-1549199481 None] Acquiring lock "cinder-6376dcc2-9cda-4a5b-9d19-306760482161-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:44 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b2516f62-17d0-4cd7-be6c-d0449d7bce44 tempest-ProjectReaderTests-1549199481 None] Lock "cinder-6376dcc2-9cda-4a5b-9d19-306760482161-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:44 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-4552d5c0-13cf-4e79-9e6f-e6495708dab4 tempest-ProjectReaderTests-1377105507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:36:44 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4552d5c0-13cf-4e79-9e6f-e6495708dab4 tempest-ProjectReaderTests-1377105507 None] Flow 'volume_create_manager' (ef667d4b-0c22-4f6c-bfb4-4ddbcc824169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:36:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4552d5c0-13cf-4e79-9e6f-e6495708dab4 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e7efab3-fd54-48e9-a124-392cb3646a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c197f51d-3aa7-4fd9-ab5f-660b8c5dcfd8 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a" returned: 0 in 0.322s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:44 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-c197f51d-3aa7-4fd9-ab5f-660b8c5dcfd8 tempest-ProjectMemberTests-1350538287 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:36:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c197f51d-3aa7-4fd9-ab5f-660b8c5dcfd8 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4552d5c0-13cf-4e79-9e6f-e6495708dab4 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e7efab3-fd54-48e9-a124-392cb3646a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2081399411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8edc7097-c5b3-432f-9d8a-7807f658bf1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c292af184774cb8a8630b73867fc4c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:36:44Z,use_quota=True,user_id='61387dc863c743a9af4844c7b603de31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4552d5c0-13cf-4e79-9e6f-e6495708dab4 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfce4c72-1610-4951-aecf-b010f70ef000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4552d5c0-13cf-4e79-9e6f-e6495708dab4 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfce4c72-1610-4951-aecf-b010f70ef000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4552d5c0-13cf-4e79-9e6f-e6495708dab4 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c57a525-f175-4ee6-8563-da1c6867c4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4552d5c0-13cf-4e79-9e6f-e6495708dab4 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c57a525-f175-4ee6-8563-da1c6867c4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8edc7097-c5b3-432f-9d8a-7807f658bf1c', 'volume_name': 'volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4552d5c0-13cf-4e79-9e6f-e6495708dab4 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7fafe87-6cfa-4b56-ad90-bb00d8effcfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4552d5c0-13cf-4e79-9e6f-e6495708dab4 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7fafe87-6cfa-4b56-ad90-bb00d8effcfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4552d5c0-13cf-4e79-9e6f-e6495708dab4 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86ea7e25-6d2c-428a-9f90-564399626892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:44 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-4552d5c0-13cf-4e79-9e6f-e6495708dab4 tempest-ProjectReaderTests-1377105507 None] Volume 8edc7097-c5b3-432f-9d8a-7807f658bf1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c', 'volume_size': 1} Sep 03 14:36:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4552d5c0-13cf-4e79-9e6f-e6495708dab4 tempest-ProjectReaderTests-1377105507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4552d5c0-13cf-4e79-9e6f-e6495708dab4 tempest-ProjectReaderTests-1377105507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:44 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-4552d5c0-13cf-4e79-9e6f-e6495708dab4 tempest-ProjectReaderTests-1377105507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2081399411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8edc7097-c5b3-432f-9d8a-7807f658bf1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c292af184774cb8a8630b73867fc4c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:36:44Z,use_quota=True,user_id='61387dc863c743a9af4844c7b603de31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:36:44 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-4552d5c0-13cf-4e79-9e6f-e6495708dab4 tempest-ProjectReaderTests-1377105507 None] Creating volume 8edc7097-c5b3-432f-9d8a-7807f658bf1c {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:36:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4552d5c0-13cf-4e79-9e6f-e6495708dab4 tempest-ProjectReaderTests-1377105507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4552d5c0-13cf-4e79-9e6f-e6495708dab4 tempest-ProjectReaderTests-1377105507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:44 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-4552d5c0-13cf-4e79-9e6f-e6495708dab4 tempest-ProjectReaderTests-1377105507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:36:44 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-4552d5c0-13cf-4e79-9e6f-e6495708dab4 tempest-ProjectReaderTests-1377105507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:36:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4552d5c0-13cf-4e79-9e6f-e6495708dab4 tempest-ProjectReaderTests-1377105507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:44 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-4552d5c0-13cf-4e79-9e6f-e6495708dab4 tempest-ProjectReaderTests-1377105507 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:36:44 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-4552d5c0-13cf-4e79-9e6f-e6495708dab4 tempest-ProjectReaderTests-1377105507 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:36:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4552d5c0-13cf-4e79-9e6f-e6495708dab4 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:44 devstack sudo[107462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c 1073741824 Sep 03 14:36:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c197f51d-3aa7-4fd9-ab5f-660b8c5dcfd8 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0a3c56d-4b66-4aed-9f2e-408269034f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:44 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c197f51d-3aa7-4fd9-ab5f-660b8c5dcfd8 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (151b8e33-7b14-4fe5-b99a-34c5789652c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:44 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b2516f62-17d0-4cd7-be6c-d0449d7bce44 tempest-ProjectReaderTests-1549199481 None] Acquiring lock "cinder-quobyte-6376dcc2-9cda-4a5b-9d19-306760482161" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:44 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-c197f51d-3aa7-4fd9-ab5f-660b8c5dcfd8 tempest-ProjectMemberTests-1350538287 None] Volume volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a (da7b9966-1d03-41f2-98d2-ccaa55baad9a): created successfully Sep 03 14:36:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c197f51d-3aa7-4fd9-ab5f-660b8c5dcfd8 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (151b8e33-7b14-4fe5-b99a-34c5789652c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:44 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-c197f51d-3aa7-4fd9-ab5f-660b8c5dcfd8 tempest-ProjectMemberTests-1350538287 None] Flow 'volume_create_manager' (c711f222-e584-41c1-aef9-cf75722e9575) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:36:44 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b2516f62-17d0-4cd7-be6c-d0449d7bce44 tempest-ProjectReaderTests-1549199481 None] Lock "cinder-quobyte-6376dcc2-9cda-4a5b-9d19-306760482161" acquired by "delete_volume" :: waited 0.029s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:44 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-c197f51d-3aa7-4fd9-ab5f-660b8c5dcfd8 tempest-ProjectMemberTests-1350538287 None] Created volume successfully. Sep 03 14:36:44 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec52bc4-e8e1-40cb-9c6f-41a5d03800e7]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b2516f62-17d0-4cd7-be6c-d0449d7bce44 tempest-ProjectReaderTests-1549199481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6376dcc2-9cda-4a5b-9d19-306760482161 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:44 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6376dcc2-9cda-4a5b-9d19-306760482161 Sep 03 14:36:44 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:44 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4552d5c0-13cf-4e79-9e6f-e6495708dab4 tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c 1073741824" returned: 0 in 0.425s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4552d5c0-13cf-4e79-9e6f-e6495708dab4 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:44 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b2516f62-17d0-4cd7-be6c-d0449d7bce44 tempest-ProjectReaderTests-1549199481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6376dcc2-9cda-4a5b-9d19-306760482161" returned: 0 in 0.375s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b2516f62-17d0-4cd7-be6c-d0449d7bce44 tempest-ProjectReaderTests-1549199481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6376dcc2-9cda-4a5b-9d19-306760482161 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:44 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c Sep 03 14:36:44 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:44 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6376dcc2-9cda-4a5b-9d19-306760482161 Sep 03 14:36:44 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:45 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4552d5c0-13cf-4e79-9e6f-e6495708dab4 tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c" returned: 0 in 0.254s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:45 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-4552d5c0-13cf-4e79-9e6f-e6495708dab4 tempest-ProjectReaderTests-1377105507 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:36:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4552d5c0-13cf-4e79-9e6f-e6495708dab4 tempest-ProjectReaderTests-1377105507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:45 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4552d5c0-13cf-4e79-9e6f-e6495708dab4 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86ea7e25-6d2c-428a-9f90-564399626892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4552d5c0-13cf-4e79-9e6f-e6495708dab4 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff0f8b8b-5837-42ee-a8fe-5680cfc9cefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b2516f62-17d0-4cd7-be6c-d0449d7bce44 tempest-ProjectReaderTests-1549199481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6376dcc2-9cda-4a5b-9d19-306760482161" returned: 0 in 0.270s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:45 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b2516f62-17d0-4cd7-be6c-d0449d7bce44 tempest-ProjectReaderTests-1549199481 None] Lock "cinder-quobyte-6376dcc2-9cda-4a5b-9d19-306760482161" released by "delete_volume" :: held 0.690s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:45 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-4552d5c0-13cf-4e79-9e6f-e6495708dab4 tempest-ProjectReaderTests-1377105507 None] Volume volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c (8edc7097-c5b3-432f-9d8a-7807f658bf1c): created successfully Sep 03 14:36:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4552d5c0-13cf-4e79-9e6f-e6495708dab4 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff0f8b8b-5837-42ee-a8fe-5680cfc9cefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-4552d5c0-13cf-4e79-9e6f-e6495708dab4 tempest-ProjectReaderTests-1377105507 None] Flow 'volume_create_manager' (ef667d4b-0c22-4f6c-bfb4-4ddbcc824169) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:36:45 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-4552d5c0-13cf-4e79-9e6f-e6495708dab4 tempest-ProjectReaderTests-1377105507 None] Created volume successfully. Sep 03 14:36:45 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-b2516f62-17d0-4cd7-be6c-d0449d7bce44 tempest-ProjectReaderTests-1549199481 None] Created reservations ['72211707-8c17-47c4-abfc-50f898930ca3', '5ce5cebd-958e-4b86-bec9-2b22082df961', 'af869344-2e9e-48c3-88b2-a4d1f3b6577d', '89bdf3de-b047-4c72-83b1-9399b448c165'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:36:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b2516f62-17d0-4cd7-be6c-d0449d7bce44 tempest-ProjectReaderTests-1549199481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b2516f62-17d0-4cd7-be6c-d0449d7bce44 tempest-ProjectReaderTests-1549199481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:45 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b2516f62-17d0-4cd7-be6c-d0449d7bce44 tempest-ProjectReaderTests-1549199481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:36:45 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b2516f62-17d0-4cd7-be6c-d0449d7bce44 tempest-ProjectReaderTests-1549199481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:36:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b2516f62-17d0-4cd7-be6c-d0449d7bce44 tempest-ProjectReaderTests-1549199481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b2516f62-17d0-4cd7-be6c-d0449d7bce44 tempest-ProjectReaderTests-1549199481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:45 devstack sudo[107479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:36:45 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:45 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b2516f62-17d0-4cd7-be6c-d0449d7bce44 tempest-ProjectReaderTests-1549199481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.288s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:45 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-b2516f62-17d0-4cd7-be6c-d0449d7bce44 tempest-ProjectReaderTests-1549199481 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:36:45 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-b2516f62-17d0-4cd7-be6c-d0449d7bce44 tempest-ProjectReaderTests-1549199481 None] Deleted volume successfully. Sep 03 14:36:45 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-b2516f62-17d0-4cd7-be6c-d0449d7bce44 tempest-ProjectReaderTests-1549199481 None] Lock "cinder-6376dcc2-9cda-4a5b-9d19-306760482161-delete_volume" released by "delete_volume" :: held 1.373s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c50aabf3-341e-45f1-b762-552c9c6dbfea tempest-ProjectMemberTests-1350538287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c50aabf3-341e-45f1-b762-552c9c6dbfea tempest-ProjectMemberTests-1350538287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:45 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-c50aabf3-341e-45f1-b762-552c9c6dbfea tempest-ProjectMemberTests-1350538287 None] Creating offline snapshot 1a6e716f-80a2-4c24-90d8-b562b8174c12 of volume da7b9966-1d03-41f2-98d2-ccaa55baad9a {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:36:45 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[63acca76-f98b-41f4-bad3-5580d2360b4a]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c50aabf3-341e-45f1-b762-552c9c6dbfea tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:45 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a Sep 03 14:36:45 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:45 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-913821e2-4207-4b1c-939a-ae0f0fc59ee4 tempest-ProjectReaderTests-1549199481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:36:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-913821e2-4207-4b1c-939a-ae0f0fc59ee4 tempest-ProjectReaderTests-1549199481 None] Flow 'volume_create_manager' (dd142c22-0593-4f0d-bbaa-23fd3a138184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:36:46 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-913821e2-4207-4b1c-939a-ae0f0fc59ee4 tempest-ProjectReaderTests-1549199481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f5fa9c4-53ee-4249-9f08-46b09f385fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:46 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-913821e2-4207-4b1c-939a-ae0f0fc59ee4 tempest-ProjectReaderTests-1549199481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f5fa9c4-53ee-4249-9f08-46b09f385fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-113976636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f308d65-2b4d-4c20-b37a-15ab3fdbc2a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19128db13d014081bf2c983b36fd7685',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:36:46Z,use_quota=True,user_id='4b45c1735ead449c9469db38931e6c80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:46 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-913821e2-4207-4b1c-939a-ae0f0fc59ee4 tempest-ProjectReaderTests-1549199481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (895bfd5f-a085-4353-9753-32377770cd78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:46 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-913821e2-4207-4b1c-939a-ae0f0fc59ee4 tempest-ProjectReaderTests-1549199481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (895bfd5f-a085-4353-9753-32377770cd78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:46 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-913821e2-4207-4b1c-939a-ae0f0fc59ee4 tempest-ProjectReaderTests-1549199481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b953e96e-cfcf-47fe-ab3b-e5bf304dbcde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:46 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-913821e2-4207-4b1c-939a-ae0f0fc59ee4 tempest-ProjectReaderTests-1549199481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b953e96e-cfcf-47fe-ab3b-e5bf304dbcde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f308d65-2b4d-4c20-b37a-15ab3fdbc2a8', 'volume_name': 'volume-4f308d65-2b4d-4c20-b37a-15ab3fdbc2a8', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:46 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-913821e2-4207-4b1c-939a-ae0f0fc59ee4 tempest-ProjectReaderTests-1549199481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (541f7978-6760-4ce5-b0bc-531ac7cd3670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:46 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-913821e2-4207-4b1c-939a-ae0f0fc59ee4 tempest-ProjectReaderTests-1549199481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (541f7978-6760-4ce5-b0bc-531ac7cd3670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:46 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-913821e2-4207-4b1c-939a-ae0f0fc59ee4 tempest-ProjectReaderTests-1549199481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1e6cfba-ea24-409f-8676-a66c7b867302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:46 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-913821e2-4207-4b1c-939a-ae0f0fc59ee4 tempest-ProjectReaderTests-1549199481 None] Volume 4f308d65-2b4d-4c20-b37a-15ab3fdbc2a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f308d65-2b4d-4c20-b37a-15ab3fdbc2a8', 'volume_size': 1} Sep 03 14:36:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-913821e2-4207-4b1c-939a-ae0f0fc59ee4 tempest-ProjectReaderTests-1549199481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:46 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c50aabf3-341e-45f1-b762-552c9c6dbfea tempest-ProjectMemberTests-1350538287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a" returned: 0 in 0.436s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c50aabf3-341e-45f1-b762-552c9c6dbfea tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a.1a6e716f-80a2-4c24-90d8-b562b8174c12 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:46 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a.1a6e716f-80a2-4c24-90d8-b562b8174c12 1G Sep 03 14:36:46 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1384b556-988c-4e92-a8d4-35deff8e4d71 tempest-ProjectReaderTests-1377105507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:46 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c50aabf3-341e-45f1-b762-552c9c6dbfea tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a.1a6e716f-80a2-4c24-90d8-b562b8174c12 1G" returned: 0 in 0.393s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c50aabf3-341e-45f1-b762-552c9c6dbfea tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a.1a6e716f-80a2-4c24-90d8-b562b8174c12 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:46 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a.1a6e716f-80a2-4c24-90d8-b562b8174c12 Sep 03 14:36:46 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:46 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c50aabf3-341e-45f1-b762-552c9c6dbfea tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a.1a6e716f-80a2-4c24-90d8-b562b8174c12" returned: 0 in 0.288s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:46 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-c50aabf3-341e-45f1-b762-552c9c6dbfea tempest-ProjectMemberTests-1350538287 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a.1a6e716f-80a2-4c24-90d8-b562b8174c12 is being set with open permissions: ugo+rw Sep 03 14:36:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c50aabf3-341e-45f1-b762-552c9c6dbfea tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a.1a6e716f-80a2-4c24-90d8-b562b8174c12 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:46 devstack sudo[107500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a.1a6e716f-80a2-4c24-90d8-b562b8174c12 Sep 03 14:36:46 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:47 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c50aabf3-341e-45f1-b762-552c9c6dbfea tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a.1a6e716f-80a2-4c24-90d8-b562b8174c12" returned: 0 in 0.238s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c50aabf3-341e-45f1-b762-552c9c6dbfea tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:47 devstack sudo[107503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a.info Sep 03 14:36:47 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:47 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c50aabf3-341e-45f1-b762-552c9c6dbfea tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a.info" returned: 0 in 0.252s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:47 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-c50aabf3-341e-45f1-b762-552c9c6dbfea tempest-ProjectMemberTests-1350538287 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a.info is being set with open permissions: ugo+rw Sep 03 14:36:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c50aabf3-341e-45f1-b762-552c9c6dbfea tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:47 devstack sudo[107506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a.info Sep 03 14:36:47 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:47 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c50aabf3-341e-45f1-b762-552c9c6dbfea tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a.info" returned: 0 in 0.242s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c50aabf3-341e-45f1-b762-552c9c6dbfea tempest-ProjectMemberTests-1350538287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.944s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-913821e2-4207-4b1c-939a-ae0f0fc59ee4 tempest-ProjectReaderTests-1549199481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.647s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:47 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-913821e2-4207-4b1c-939a-ae0f0fc59ee4 tempest-ProjectReaderTests-1549199481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-113976636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f308d65-2b4d-4c20-b37a-15ab3fdbc2a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19128db13d014081bf2c983b36fd7685',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:36:46Z,use_quota=True,user_id='4b45c1735ead449c9469db38931e6c80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:36:47 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-913821e2-4207-4b1c-939a-ae0f0fc59ee4 tempest-ProjectReaderTests-1549199481 None] Creating volume 4f308d65-2b4d-4c20-b37a-15ab3fdbc2a8 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:36:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-913821e2-4207-4b1c-939a-ae0f0fc59ee4 tempest-ProjectReaderTests-1549199481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-913821e2-4207-4b1c-939a-ae0f0fc59ee4 tempest-ProjectReaderTests-1549199481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:47 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-913821e2-4207-4b1c-939a-ae0f0fc59ee4 tempest-ProjectReaderTests-1549199481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:36:47 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-913821e2-4207-4b1c-939a-ae0f0fc59ee4 tempest-ProjectReaderTests-1549199481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:36:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-913821e2-4207-4b1c-939a-ae0f0fc59ee4 tempest-ProjectReaderTests-1549199481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:47 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-913821e2-4207-4b1c-939a-ae0f0fc59ee4 tempest-ProjectReaderTests-1549199481 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:36:47 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-913821e2-4207-4b1c-939a-ae0f0fc59ee4 tempest-ProjectReaderTests-1549199481 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:36:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-913821e2-4207-4b1c-939a-ae0f0fc59ee4 tempest-ProjectReaderTests-1549199481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4f308d65-2b4d-4c20-b37a-15ab3fdbc2a8 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:47 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4f308d65-2b4d-4c20-b37a-15ab3fdbc2a8 1073741824 Sep 03 14:36:47 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:47 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-c50aabf3-341e-45f1-b762-552c9c6dbfea tempest-ProjectMemberTests-1350538287 None] Create snapshot completed successfully Sep 03 14:36:47 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-87a10e4b-3c88-4ad2-89c4-98ab6498e3c0 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "cinder-1a6e716f-80a2-4c24-90d8-b562b8174c12-delete_snapshot" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:47 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-87a10e4b-3c88-4ad2-89c4-98ab6498e3c0 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-1a6e716f-80a2-4c24-90d8-b562b8174c12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:47 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-87a10e4b-3c88-4ad2-89c4-98ab6498e3c0 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "cinder-quobyte-da7b9966-1d03-41f2-98d2-ccaa55baad9a" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:47 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-87a10e4b-3c88-4ad2-89c4-98ab6498e3c0 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-da7b9966-1d03-41f2-98d2-ccaa55baad9a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:47 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-87a10e4b-3c88-4ad2-89c4-98ab6498e3c0 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "cinder-quobyte-1a6e716f-80a2-4c24-90d8-b562b8174c12" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:48 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-87a10e4b-3c88-4ad2-89c4-98ab6498e3c0 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-1a6e716f-80a2-4c24-90d8-b562b8174c12" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:48 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-87a10e4b-3c88-4ad2-89c4-98ab6498e3c0 tempest-ProjectMemberTests-1350538287 None] Deleting offline snapshot 1a6e716f-80a2-4c24-90d8-b562b8174c12 of volume da7b9966-1d03-41f2-98d2-ccaa55baad9a {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:36:48 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-87a10e4b-3c88-4ad2-89c4-98ab6498e3c0 tempest-ProjectMemberTests-1350538287 None] snapshot_file for this snap is: volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a.1a6e716f-80a2-4c24-90d8-b562b8174c12 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:36:48 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[255305e8-82be-4706-85a3-8ab0eed45319]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-87a10e4b-3c88-4ad2-89c4-98ab6498e3c0 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a.1a6e716f-80a2-4c24-90d8-b562b8174c12 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:48 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a.1a6e716f-80a2-4c24-90d8-b562b8174c12 Sep 03 14:36:48 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:48 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-913821e2-4207-4b1c-939a-ae0f0fc59ee4 tempest-ProjectReaderTests-1549199481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4f308d65-2b4d-4c20-b37a-15ab3fdbc2a8 1073741824" returned: 0 in 0.516s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-913821e2-4207-4b1c-939a-ae0f0fc59ee4 tempest-ProjectReaderTests-1549199481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4f308d65-2b4d-4c20-b37a-15ab3fdbc2a8 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:48 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4f308d65-2b4d-4c20-b37a-15ab3fdbc2a8 Sep 03 14:36:48 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:48 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-87a10e4b-3c88-4ad2-89c4-98ab6498e3c0 tempest-ProjectMemberTests-1350538287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a.1a6e716f-80a2-4c24-90d8-b562b8174c12" returned: 0 in 0.389s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:48 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-87a10e4b-3c88-4ad2-89c4-98ab6498e3c0 tempest-ProjectMemberTests-1350538287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:36:48 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0712a6f0-4ff7-48b0-9d3c-431a3440d30d]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-87a10e4b-3c88-4ad2-89c4-98ab6498e3c0 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:48 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-913821e2-4207-4b1c-939a-ae0f0fc59ee4 tempest-ProjectReaderTests-1549199481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4f308d65-2b4d-4c20-b37a-15ab3fdbc2a8" returned: 0 in 0.275s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:48 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-913821e2-4207-4b1c-939a-ae0f0fc59ee4 tempest-ProjectReaderTests-1549199481 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:36:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-913821e2-4207-4b1c-939a-ae0f0fc59ee4 tempest-ProjectReaderTests-1549199481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1384b556-988c-4e92-a8d4-35deff8e4d71 tempest-ProjectReaderTests-1377105507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.091s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:48 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-1384b556-988c-4e92-a8d4-35deff8e4d71 tempest-ProjectReaderTests-1377105507 None] Creating offline snapshot 5e9044ef-5112-46d8-901d-f56825ab78fb of volume 8edc7097-c5b3-432f-9d8a-7807f658bf1c {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:36:48 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a Sep 03 14:36:48 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:48 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-913821e2-4207-4b1c-939a-ae0f0fc59ee4 tempest-ProjectReaderTests-1549199481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1e6cfba-ea24-409f-8676-a66c7b867302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f308d65-2b4d-4c20-b37a-15ab3fdbc2a8', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:48 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-913821e2-4207-4b1c-939a-ae0f0fc59ee4 tempest-ProjectReaderTests-1549199481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bf4c1e9-f484-4ff8-9abc-95ed246f851f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:48 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[087daec5-b7c8-4eb5-a90c-75549c2df80b]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1384b556-988c-4e92-a8d4-35deff8e4d71 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:48 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-913821e2-4207-4b1c-939a-ae0f0fc59ee4 tempest-ProjectReaderTests-1549199481 None] Volume volume-4f308d65-2b4d-4c20-b37a-15ab3fdbc2a8 (4f308d65-2b4d-4c20-b37a-15ab3fdbc2a8): created successfully Sep 03 14:36:48 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-913821e2-4207-4b1c-939a-ae0f0fc59ee4 tempest-ProjectReaderTests-1549199481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bf4c1e9-f484-4ff8-9abc-95ed246f851f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:48 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-913821e2-4207-4b1c-939a-ae0f0fc59ee4 tempest-ProjectReaderTests-1549199481 None] Flow 'volume_create_manager' (dd142c22-0593-4f0d-bbaa-23fd3a138184) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:36:48 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-913821e2-4207-4b1c-939a-ae0f0fc59ee4 tempest-ProjectReaderTests-1549199481 None] Created volume successfully. Sep 03 14:36:48 devstack sudo[107525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c Sep 03 14:36:48 devstack sudo[107525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:48 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-87a10e4b-3c88-4ad2-89c4-98ab6498e3c0 tempest-ProjectMemberTests-1350538287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a" returned: 0 in 0.429s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-87a10e4b-3c88-4ad2-89c4-98ab6498e3c0 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a.1a6e716f-80a2-4c24-90d8-b562b8174c12 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:48 devstack sudo[107530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a.1a6e716f-80a2-4c24-90d8-b562b8174c12 Sep 03 14:36:48 devstack sudo[107530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:49 devstack sudo[107525]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1384b556-988c-4e92-a8d4-35deff8e4d71 tempest-ProjectReaderTests-1377105507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c" returned: 0 in 0.410s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1384b556-988c-4e92-a8d4-35deff8e4d71 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c.5e9044ef-5112-46d8-901d-f56825ab78fb 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:49 devstack sudo[107535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c.5e9044ef-5112-46d8-901d-f56825ab78fb 1G Sep 03 14:36:49 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:49 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-45235042-f158-483c-a8d4-84a863c06f93 tempest-ProjectReaderTests-1549199481 None] Acquiring lock "cinder-4f308d65-2b4d-4c20-b37a-15ab3fdbc2a8-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:49 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-45235042-f158-483c-a8d4-84a863c06f93 tempest-ProjectReaderTests-1549199481 None] Lock "cinder-4f308d65-2b4d-4c20-b37a-15ab3fdbc2a8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:49 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-45235042-f158-483c-a8d4-84a863c06f93 tempest-ProjectReaderTests-1549199481 None] Acquiring lock "cinder-quobyte-4f308d65-2b4d-4c20-b37a-15ab3fdbc2a8" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:49 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-45235042-f158-483c-a8d4-84a863c06f93 tempest-ProjectReaderTests-1549199481 None] Lock "cinder-quobyte-4f308d65-2b4d-4c20-b37a-15ab3fdbc2a8" acquired by "delete_volume" :: waited 0.019s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:49 devstack sudo[107530]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-87a10e4b-3c88-4ad2-89c4-98ab6498e3c0 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a.1a6e716f-80a2-4c24-90d8-b562b8174c12" returned: 0 in 0.475s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-87a10e4b-3c88-4ad2-89c4-98ab6498e3c0 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a.1a6e716f-80a2-4c24-90d8-b562b8174c12 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:49 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d395ae0-d3fa-4c80-8b7e-3898e65523ba]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-45235042-f158-483c-a8d4-84a863c06f93 tempest-ProjectReaderTests-1549199481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4f308d65-2b4d-4c20-b37a-15ab3fdbc2a8 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:49 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a.1a6e716f-80a2-4c24-90d8-b562b8174c12 Sep 03 14:36:49 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:49 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4f308d65-2b4d-4c20-b37a-15ab3fdbc2a8 Sep 03 14:36:49 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:49 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1384b556-988c-4e92-a8d4-35deff8e4d71 tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c.5e9044ef-5112-46d8-901d-f56825ab78fb 1G" returned: 0 in 0.604s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1384b556-988c-4e92-a8d4-35deff8e4d71 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c.5e9044ef-5112-46d8-901d-f56825ab78fb {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:49 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:49 devstack sudo[107549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c.5e9044ef-5112-46d8-901d-f56825ab78fb Sep 03 14:36:49 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-87a10e4b-3c88-4ad2-89c4-98ab6498e3c0 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a.1a6e716f-80a2-4c24-90d8-b562b8174c12" returned: 0 in 0.295s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:49 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-87a10e4b-3c88-4ad2-89c4-98ab6498e3c0 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-1a6e716f-80a2-4c24-90d8-b562b8174c12" released by "_delete_snapshot" :: held 1.709s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:49 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-87a10e4b-3c88-4ad2-89c4-98ab6498e3c0 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-da7b9966-1d03-41f2-98d2-ccaa55baad9a" released by "delete_snapshot" :: held 1.735s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:49 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-87a10e4b-3c88-4ad2-89c4-98ab6498e3c0 tempest-ProjectMemberTests-1350538287 None] Created reservations ['f4e8e7ed-fde0-4517-92ee-bfe35a53ae21', 'ed185b00-eecc-4cd3-98c7-67bd5c042bb4', 'd08c843a-09b0-40bc-a6fa-6343d29f30e3', '88dea6a3-3a0d-476d-a7d0-9b277ca74a3b'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:36:49 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-45235042-f158-483c-a8d4-84a863c06f93 tempest-ProjectReaderTests-1549199481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4f308d65-2b4d-4c20-b37a-15ab3fdbc2a8" returned: 0 in 0.421s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-45235042-f158-483c-a8d4-84a863c06f93 tempest-ProjectReaderTests-1549199481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4f308d65-2b4d-4c20-b37a-15ab3fdbc2a8 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:49 devstack sudo[107554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4f308d65-2b4d-4c20-b37a-15ab3fdbc2a8 Sep 03 14:36:49 devstack sudo[107554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:49 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-87a10e4b-3c88-4ad2-89c4-98ab6498e3c0 tempest-ProjectMemberTests-1350538287 None] Delete snapshot completed successfully. Sep 03 14:36:49 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-87a10e4b-3c88-4ad2-89c4-98ab6498e3c0 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-1a6e716f-80a2-4c24-90d8-b562b8174c12-delete_snapshot" released by "delete_snapshot" :: held 1.943s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:49 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1384b556-988c-4e92-a8d4-35deff8e4d71 tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c.5e9044ef-5112-46d8-901d-f56825ab78fb" returned: 0 in 0.340s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:49 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-1384b556-988c-4e92-a8d4-35deff8e4d71 tempest-ProjectReaderTests-1377105507 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c.5e9044ef-5112-46d8-901d-f56825ab78fb is being set with open permissions: ugo+rw Sep 03 14:36:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1384b556-988c-4e92-a8d4-35deff8e4d71 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c.5e9044ef-5112-46d8-901d-f56825ab78fb {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:50 devstack sudo[107560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c.5e9044ef-5112-46d8-901d-f56825ab78fb Sep 03 14:36:50 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:50 devstack sudo[107554]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-45235042-f158-483c-a8d4-84a863c06f93 tempest-ProjectReaderTests-1549199481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4f308d65-2b4d-4c20-b37a-15ab3fdbc2a8" returned: 0 in 0.313s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:50 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-4991c77e-cb95-42bb-8cbf-978fbf1f1e94 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "cinder-da7b9966-1d03-41f2-98d2-ccaa55baad9a-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:50 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-45235042-f158-483c-a8d4-84a863c06f93 tempest-ProjectReaderTests-1549199481 None] Lock "cinder-quobyte-4f308d65-2b4d-4c20-b37a-15ab3fdbc2a8" released by "delete_volume" :: held 0.804s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:50 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-4991c77e-cb95-42bb-8cbf-978fbf1f1e94 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-da7b9966-1d03-41f2-98d2-ccaa55baad9a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:50 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-4991c77e-cb95-42bb-8cbf-978fbf1f1e94 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "cinder-quobyte-da7b9966-1d03-41f2-98d2-ccaa55baad9a" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:50 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-45235042-f158-483c-a8d4-84a863c06f93 tempest-ProjectReaderTests-1549199481 None] Created reservations ['d9a9fabb-0143-406f-82ab-33c1615e7f22', 'f0177360-7534-4eff-9d93-7d48ed6cdf30', '796ae5bf-843d-4bb9-9e9a-ce2e60008f05', '9f1b1af0-ad4b-45cd-933a-1afea1f43335'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:36:50 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-4991c77e-cb95-42bb-8cbf-978fbf1f1e94 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-da7b9966-1d03-41f2-98d2-ccaa55baad9a" acquired by "delete_volume" :: waited 0.024s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:50 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4245242-792c-4f1e-9650-7e1747c68eb4]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4991c77e-cb95-42bb-8cbf-978fbf1f1e94 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:50 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1384b556-988c-4e92-a8d4-35deff8e4d71 tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c.5e9044ef-5112-46d8-901d-f56825ab78fb" returned: 0 in 0.354s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1384b556-988c-4e92-a8d4-35deff8e4d71 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:50 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c.info Sep 03 14:36:50 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-45235042-f158-483c-a8d4-84a863c06f93 tempest-ProjectReaderTests-1549199481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-45235042-f158-483c-a8d4-84a863c06f93 tempest-ProjectReaderTests-1549199481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:50 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-45235042-f158-483c-a8d4-84a863c06f93 tempest-ProjectReaderTests-1549199481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:36:50 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-45235042-f158-483c-a8d4-84a863c06f93 tempest-ProjectReaderTests-1549199481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:36:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-45235042-f158-483c-a8d4-84a863c06f93 tempest-ProjectReaderTests-1549199481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-45235042-f158-483c-a8d4-84a863c06f93 tempest-ProjectReaderTests-1549199481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:50 devstack sudo[107564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a Sep 03 14:36:50 devstack sudo[107564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:50 devstack sudo[107567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:36:50 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:50 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-45235042-f158-483c-a8d4-84a863c06f93 tempest-ProjectReaderTests-1549199481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.318s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:50 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-45235042-f158-483c-a8d4-84a863c06f93 tempest-ProjectReaderTests-1549199481 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:36:50 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-45235042-f158-483c-a8d4-84a863c06f93 tempest-ProjectReaderTests-1549199481 None] Deleted volume successfully. Sep 03 14:36:50 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1384b556-988c-4e92-a8d4-35deff8e4d71 tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c.info" returned: 0 in 0.443s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:50 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-1384b556-988c-4e92-a8d4-35deff8e4d71 tempest-ProjectReaderTests-1377105507 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c.info is being set with open permissions: ugo+rw Sep 03 14:36:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1384b556-988c-4e92-a8d4-35deff8e4d71 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:50 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-45235042-f158-483c-a8d4-84a863c06f93 tempest-ProjectReaderTests-1549199481 None] Lock "cinder-4f308d65-2b4d-4c20-b37a-15ab3fdbc2a8-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:50 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c.info Sep 03 14:36:50 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:50 devstack sudo[107564]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4991c77e-cb95-42bb-8cbf-978fbf1f1e94 tempest-ProjectMemberTests-1350538287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a" returned: 0 in 0.621s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4991c77e-cb95-42bb-8cbf-978fbf1f1e94 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:50 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a Sep 03 14:36:50 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:51 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1384b556-988c-4e92-a8d4-35deff8e4d71 tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c.info" returned: 0 in 0.306s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1384b556-988c-4e92-a8d4-35deff8e4d71 tempest-ProjectReaderTests-1377105507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.573s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:51 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-1384b556-988c-4e92-a8d4-35deff8e4d71 tempest-ProjectReaderTests-1377105507 None] Create snapshot completed successfully Sep 03 14:36:51 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4991c77e-cb95-42bb-8cbf-978fbf1f1e94 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da7b9966-1d03-41f2-98d2-ccaa55baad9a" returned: 0 in 0.312s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:51 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-4991c77e-cb95-42bb-8cbf-978fbf1f1e94 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-da7b9966-1d03-41f2-98d2-ccaa55baad9a" released by "delete_volume" :: held 1.013s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:51 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-4991c77e-cb95-42bb-8cbf-978fbf1f1e94 tempest-ProjectMemberTests-1350538287 None] Created reservations ['cc73f860-7022-44e7-93e4-7d0767c13a08', '61bb3e2b-edc6-48eb-9fb2-32a8a93031aa', '3b50d09c-6d3a-449b-9281-8a47f81ed6e7', 'dbf8b50f-7949-4b25-aba0-cadc30e517b3'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:36:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4991c77e-cb95-42bb-8cbf-978fbf1f1e94 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4991c77e-cb95-42bb-8cbf-978fbf1f1e94 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-4991c77e-cb95-42bb-8cbf-978fbf1f1e94 tempest-ProjectMemberTests-1350538287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:36:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-4991c77e-cb95-42bb-8cbf-978fbf1f1e94 tempest-ProjectMemberTests-1350538287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:36:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-4991c77e-cb95-42bb-8cbf-978fbf1f1e94 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4991c77e-cb95-42bb-8cbf-978fbf1f1e94 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:51 devstack sudo[107583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:36:51 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:51 devstack cinder-volume[87007]: DEBUG oslo_service.periodic_task [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87007) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 14:36:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:36:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:36:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:51 devstack sudo[107585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:36:51 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:51 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-4991c77e-cb95-42bb-8cbf-978fbf1f1e94 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.313s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:51 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-4991c77e-cb95-42bb-8cbf-978fbf1f1e94 tempest-ProjectMemberTests-1350538287 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:36:51 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-4991c77e-cb95-42bb-8cbf-978fbf1f1e94 tempest-ProjectMemberTests-1350538287 None] Deleted volume successfully. Sep 03 14:36:51 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-4991c77e-cb95-42bb-8cbf-978fbf1f1e94 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-da7b9966-1d03-41f2-98d2-ccaa55baad9a-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:51 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.357s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:51 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:36:51 devstack cinder-volume[87007]: DEBUG oslo_service.periodic_task [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running periodic task VolumeManager._thread_info {{(pid=87007) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 14:36:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] thread count: 28 {{(pid=87007) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 14:36:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] thread info: [<_MainThread(MainThread, started 123689171054720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87007) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 14:36:52 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8e71a622-7a81-4ca5-b531-5f5c32fc6c16 tempest-ProjectReaderTests-1377105507 None] Acquiring lock "cinder-5e9044ef-5112-46d8-901d-f56825ab78fb-delete_snapshot" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:52 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8e71a622-7a81-4ca5-b531-5f5c32fc6c16 tempest-ProjectReaderTests-1377105507 None] Lock "cinder-5e9044ef-5112-46d8-901d-f56825ab78fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:52 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8e71a622-7a81-4ca5-b531-5f5c32fc6c16 tempest-ProjectReaderTests-1377105507 None] Acquiring lock "cinder-quobyte-8edc7097-c5b3-432f-9d8a-7807f658bf1c" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:52 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8e71a622-7a81-4ca5-b531-5f5c32fc6c16 tempest-ProjectReaderTests-1377105507 None] Lock "cinder-quobyte-8edc7097-c5b3-432f-9d8a-7807f658bf1c" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:52 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8e71a622-7a81-4ca5-b531-5f5c32fc6c16 tempest-ProjectReaderTests-1377105507 None] Acquiring lock "cinder-quobyte-5e9044ef-5112-46d8-901d-f56825ab78fb" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:52 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8e71a622-7a81-4ca5-b531-5f5c32fc6c16 tempest-ProjectReaderTests-1377105507 None] Lock "cinder-quobyte-5e9044ef-5112-46d8-901d-f56825ab78fb" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:52 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-8e71a622-7a81-4ca5-b531-5f5c32fc6c16 tempest-ProjectReaderTests-1377105507 None] Deleting offline snapshot 5e9044ef-5112-46d8-901d-f56825ab78fb of volume 8edc7097-c5b3-432f-9d8a-7807f658bf1c {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:36:52 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-8e71a622-7a81-4ca5-b531-5f5c32fc6c16 tempest-ProjectReaderTests-1377105507 None] snapshot_file for this snap is: volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c.5e9044ef-5112-46d8-901d-f56825ab78fb {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:36:52 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[726a874e-4401-41aa-a2af-1f265595c329]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8e71a622-7a81-4ca5-b531-5f5c32fc6c16 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c.5e9044ef-5112-46d8-901d-f56825ab78fb {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:52 devstack sudo[107589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c.5e9044ef-5112-46d8-901d-f56825ab78fb Sep 03 14:36:52 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:52 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8e71a622-7a81-4ca5-b531-5f5c32fc6c16 tempest-ProjectReaderTests-1377105507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c.5e9044ef-5112-46d8-901d-f56825ab78fb" returned: 0 in 0.488s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:52 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-8e71a622-7a81-4ca5-b531-5f5c32fc6c16 tempest-ProjectReaderTests-1377105507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:36:52 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78ef471-7a7b-42cf-a7ec-73db74803291]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:52 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8e71a622-7a81-4ca5-b531-5f5c32fc6c16 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:52 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c Sep 03 14:36:52 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:52 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c3ba1d0-b834-49a3-be75-aa2073b5d0d7 tempest-ProjectMemberTests-1350538287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:36:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7c3ba1d0-b834-49a3-be75-aa2073b5d0d7 tempest-ProjectMemberTests-1350538287 None] Flow 'volume_create_manager' (50b894a0-ca3d-4646-9c2b-ad60a1416400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:36:52 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7c3ba1d0-b834-49a3-be75-aa2073b5d0d7 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db3c82ef-b628-4ebd-acf5-ebeb2d2a1a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:53 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7c3ba1d0-b834-49a3-be75-aa2073b5d0d7 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db3c82ef-b628-4ebd-acf5-ebeb2d2a1a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:36:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-605879433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b178a98e-b6be-4ea2-b19b-94123169225b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bdc07719fdf40189d19adf3cf793220',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:36:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:36:53Z,use_quota=True,user_id='c0e0fc3b02a64f5b9b037ade3f94a724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:53 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7c3ba1d0-b834-49a3-be75-aa2073b5d0d7 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbd7663c-c4ca-45e9-8599-df8930d33679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:53 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7c3ba1d0-b834-49a3-be75-aa2073b5d0d7 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbd7663c-c4ca-45e9-8599-df8930d33679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:53 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7c3ba1d0-b834-49a3-be75-aa2073b5d0d7 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d54422df-f65d-4cce-8db3-989e862a0b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:53 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7c3ba1d0-b834-49a3-be75-aa2073b5d0d7 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d54422df-f65d-4cce-8db3-989e862a0b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b178a98e-b6be-4ea2-b19b-94123169225b', 'volume_name': 'volume-b178a98e-b6be-4ea2-b19b-94123169225b', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:53 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7c3ba1d0-b834-49a3-be75-aa2073b5d0d7 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e35fe5cb-74b1-4ae5-8383-0633b0065ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:53 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7c3ba1d0-b834-49a3-be75-aa2073b5d0d7 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e35fe5cb-74b1-4ae5-8383-0633b0065ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:53 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7c3ba1d0-b834-49a3-be75-aa2073b5d0d7 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (571dfc5e-46a3-4f27-a1f7-e4411969a28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:53 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-7c3ba1d0-b834-49a3-be75-aa2073b5d0d7 tempest-ProjectMemberTests-1350538287 None] Volume b178a98e-b6be-4ea2-b19b-94123169225b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b178a98e-b6be-4ea2-b19b-94123169225b', 'volume_size': 1} Sep 03 14:36:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7c3ba1d0-b834-49a3-be75-aa2073b5d0d7 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7c3ba1d0-b834-49a3-be75-aa2073b5d0d7 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:53 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-7c3ba1d0-b834-49a3-be75-aa2073b5d0d7 tempest-ProjectMemberTests-1350538287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:36:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-605879433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b178a98e-b6be-4ea2-b19b-94123169225b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bdc07719fdf40189d19adf3cf793220',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:36:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:36:53Z,use_quota=True,user_id='c0e0fc3b02a64f5b9b037ade3f94a724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:36:53 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-7c3ba1d0-b834-49a3-be75-aa2073b5d0d7 tempest-ProjectMemberTests-1350538287 None] Creating volume b178a98e-b6be-4ea2-b19b-94123169225b {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:36:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7c3ba1d0-b834-49a3-be75-aa2073b5d0d7 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7c3ba1d0-b834-49a3-be75-aa2073b5d0d7 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:53 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-7c3ba1d0-b834-49a3-be75-aa2073b5d0d7 tempest-ProjectMemberTests-1350538287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:36:53 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-7c3ba1d0-b834-49a3-be75-aa2073b5d0d7 tempest-ProjectMemberTests-1350538287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:36:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7c3ba1d0-b834-49a3-be75-aa2073b5d0d7 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:53 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-7c3ba1d0-b834-49a3-be75-aa2073b5d0d7 tempest-ProjectMemberTests-1350538287 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:36:53 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-7c3ba1d0-b834-49a3-be75-aa2073b5d0d7 tempest-ProjectMemberTests-1350538287 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:36:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7c3ba1d0-b834-49a3-be75-aa2073b5d0d7 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b178a98e-b6be-4ea2-b19b-94123169225b 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:53 devstack sudo[107596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b178a98e-b6be-4ea2-b19b-94123169225b 1073741824 Sep 03 14:36:53 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:53 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8e71a622-7a81-4ca5-b531-5f5c32fc6c16 tempest-ProjectReaderTests-1377105507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c" returned: 0 in 0.411s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8e71a622-7a81-4ca5-b531-5f5c32fc6c16 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c.5e9044ef-5112-46d8-901d-f56825ab78fb {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:53 devstack sudo[107601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c.5e9044ef-5112-46d8-901d-f56825ab78fb Sep 03 14:36:53 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:53 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7c3ba1d0-b834-49a3-be75-aa2073b5d0d7 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b178a98e-b6be-4ea2-b19b-94123169225b 1073741824" returned: 0 in 0.425s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:53 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8e71a622-7a81-4ca5-b531-5f5c32fc6c16 tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c.5e9044ef-5112-46d8-901d-f56825ab78fb" returned: 0 in 0.358s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8e71a622-7a81-4ca5-b531-5f5c32fc6c16 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c.5e9044ef-5112-46d8-901d-f56825ab78fb {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7c3ba1d0-b834-49a3-be75-aa2073b5d0d7 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b178a98e-b6be-4ea2-b19b-94123169225b {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:53 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c.5e9044ef-5112-46d8-901d-f56825ab78fb Sep 03 14:36:53 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:53 devstack sudo[107612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b178a98e-b6be-4ea2-b19b-94123169225b Sep 03 14:36:53 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:53 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8e71a622-7a81-4ca5-b531-5f5c32fc6c16 tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c.5e9044ef-5112-46d8-901d-f56825ab78fb" returned: 0 in 0.264s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:53 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7c3ba1d0-b834-49a3-be75-aa2073b5d0d7 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b178a98e-b6be-4ea2-b19b-94123169225b" returned: 0 in 0.270s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:53 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-7c3ba1d0-b834-49a3-be75-aa2073b5d0d7 tempest-ProjectMemberTests-1350538287 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:36:53 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-7c3ba1d0-b834-49a3-be75-aa2073b5d0d7 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:53 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8e71a622-7a81-4ca5-b531-5f5c32fc6c16 tempest-ProjectReaderTests-1377105507 None] Lock "cinder-quobyte-5e9044ef-5112-46d8-901d-f56825ab78fb" released by "_delete_snapshot" :: held 1.660s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:53 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8e71a622-7a81-4ca5-b531-5f5c32fc6c16 tempest-ProjectReaderTests-1377105507 None] Lock "cinder-quobyte-8edc7097-c5b3-432f-9d8a-7807f658bf1c" released by "delete_snapshot" :: held 1.695s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:53 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7c3ba1d0-b834-49a3-be75-aa2073b5d0d7 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (571dfc5e-46a3-4f27-a1f7-e4411969a28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b178a98e-b6be-4ea2-b19b-94123169225b', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:53 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7c3ba1d0-b834-49a3-be75-aa2073b5d0d7 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a809c1fa-833e-45d1-98c1-4319b412453f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:53 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-7c3ba1d0-b834-49a3-be75-aa2073b5d0d7 tempest-ProjectMemberTests-1350538287 None] Volume volume-b178a98e-b6be-4ea2-b19b-94123169225b (b178a98e-b6be-4ea2-b19b-94123169225b): created successfully Sep 03 14:36:53 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7c3ba1d0-b834-49a3-be75-aa2073b5d0d7 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a809c1fa-833e-45d1-98c1-4319b412453f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:53 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-7c3ba1d0-b834-49a3-be75-aa2073b5d0d7 tempest-ProjectMemberTests-1350538287 None] Flow 'volume_create_manager' (50b894a0-ca3d-4646-9c2b-ad60a1416400) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:36:53 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-7c3ba1d0-b834-49a3-be75-aa2073b5d0d7 tempest-ProjectMemberTests-1350538287 None] Created volume successfully. Sep 03 14:36:53 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-8e71a622-7a81-4ca5-b531-5f5c32fc6c16 tempest-ProjectReaderTests-1377105507 None] Created reservations ['61cd46ac-16a2-4107-9a06-f95f848d97a3', 'f2bf6e0a-0571-446f-a408-abe06d349baa', 'efe19c21-5668-4606-b7e8-c9839b4679be', '326e229b-df0f-4aa3-a19b-b56a2ace3dd1'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:36:54 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-8e71a622-7a81-4ca5-b531-5f5c32fc6c16 tempest-ProjectReaderTests-1377105507 None] Delete snapshot completed successfully. Sep 03 14:36:54 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8e71a622-7a81-4ca5-b531-5f5c32fc6c16 tempest-ProjectReaderTests-1377105507 None] Lock "cinder-5e9044ef-5112-46d8-901d-f56825ab78fb-delete_snapshot" released by "delete_snapshot" :: held 1.940s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1d55aecd-9661-4d85-8612-949bfc8f9dd8 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1d55aecd-9661-4d85-8612-949bfc8f9dd8 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:54 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-1d55aecd-9661-4d85-8612-949bfc8f9dd8 tempest-ProjectMemberTests-1350538287 None] Creating offline snapshot aa5b7ec9-0552-4b28-ac2b-fc656ebcabaa of volume b178a98e-b6be-4ea2-b19b-94123169225b {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:36:54 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d2af93-79a4-453a-bbf2-ebf5900c8426]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1d55aecd-9661-4d85-8612-949bfc8f9dd8 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b178a98e-b6be-4ea2-b19b-94123169225b {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:54 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1b8246d6-bcb5-49ef-aba9-c679edcc9d0b tempest-ProjectReaderTests-1377105507 None] Acquiring lock "cinder-8edc7097-c5b3-432f-9d8a-7807f658bf1c-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:54 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1b8246d6-bcb5-49ef-aba9-c679edcc9d0b tempest-ProjectReaderTests-1377105507 None] Lock "cinder-8edc7097-c5b3-432f-9d8a-7807f658bf1c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:54 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1b8246d6-bcb5-49ef-aba9-c679edcc9d0b tempest-ProjectReaderTests-1377105507 None] Acquiring lock "cinder-quobyte-8edc7097-c5b3-432f-9d8a-7807f658bf1c" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:54 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1b8246d6-bcb5-49ef-aba9-c679edcc9d0b tempest-ProjectReaderTests-1377105507 None] Lock "cinder-quobyte-8edc7097-c5b3-432f-9d8a-7807f658bf1c" acquired by "delete_volume" :: waited 0.026s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:54 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b178a98e-b6be-4ea2-b19b-94123169225b Sep 03 14:36:54 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:54 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4362fc7-02d9-4859-8ed7-38f1b8a89b13]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1b8246d6-bcb5-49ef-aba9-c679edcc9d0b tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:54 devstack sudo[107618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c Sep 03 14:36:54 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:54 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1d55aecd-9661-4d85-8612-949bfc8f9dd8 tempest-ProjectMemberTests-1350538287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b178a98e-b6be-4ea2-b19b-94123169225b" returned: 0 in 0.420s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1d55aecd-9661-4d85-8612-949bfc8f9dd8 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b178a98e-b6be-4ea2-b19b-94123169225b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b178a98e-b6be-4ea2-b19b-94123169225b.aa5b7ec9-0552-4b28-ac2b-fc656ebcabaa 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:54 devstack sudo[107623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b178a98e-b6be-4ea2-b19b-94123169225b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b178a98e-b6be-4ea2-b19b-94123169225b.aa5b7ec9-0552-4b28-ac2b-fc656ebcabaa 1G Sep 03 14:36:54 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:54 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1b8246d6-bcb5-49ef-aba9-c679edcc9d0b tempest-ProjectReaderTests-1377105507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c" returned: 0 in 0.415s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:54 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1b8246d6-bcb5-49ef-aba9-c679edcc9d0b tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:54 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c Sep 03 14:36:54 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:55 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1d55aecd-9661-4d85-8612-949bfc8f9dd8 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b178a98e-b6be-4ea2-b19b-94123169225b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b178a98e-b6be-4ea2-b19b-94123169225b.aa5b7ec9-0552-4b28-ac2b-fc656ebcabaa 1G" returned: 0 in 0.416s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1d55aecd-9661-4d85-8612-949bfc8f9dd8 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b178a98e-b6be-4ea2-b19b-94123169225b -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b178a98e-b6be-4ea2-b19b-94123169225b.aa5b7ec9-0552-4b28-ac2b-fc656ebcabaa {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:55 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1b8246d6-bcb5-49ef-aba9-c679edcc9d0b tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-8edc7097-c5b3-432f-9d8a-7807f658bf1c" returned: 0 in 0.254s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:55 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b178a98e-b6be-4ea2-b19b-94123169225b -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b178a98e-b6be-4ea2-b19b-94123169225b.aa5b7ec9-0552-4b28-ac2b-fc656ebcabaa Sep 03 14:36:55 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:55 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1b8246d6-bcb5-49ef-aba9-c679edcc9d0b tempest-ProjectReaderTests-1377105507 None] Lock "cinder-quobyte-8edc7097-c5b3-432f-9d8a-7807f658bf1c" released by "delete_volume" :: held 0.746s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:55 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-1b8246d6-bcb5-49ef-aba9-c679edcc9d0b tempest-ProjectReaderTests-1377105507 None] Created reservations ['8b40eff0-33b2-443d-9677-2e2c24b19d14', 'a2c3bad8-bc17-411b-8392-de1d7d88b5ba', 'dc2ccbf3-4e44-4220-8a06-91256c6ee571', '9f14d9ce-1e00-449c-97a4-1bcc72e0725c'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:36:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1b8246d6-bcb5-49ef-aba9-c679edcc9d0b tempest-ProjectReaderTests-1377105507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1b8246d6-bcb5-49ef-aba9-c679edcc9d0b tempest-ProjectReaderTests-1377105507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:55 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-1b8246d6-bcb5-49ef-aba9-c679edcc9d0b tempest-ProjectReaderTests-1377105507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:36:55 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-1b8246d6-bcb5-49ef-aba9-c679edcc9d0b tempest-ProjectReaderTests-1377105507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:36:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1b8246d6-bcb5-49ef-aba9-c679edcc9d0b tempest-ProjectReaderTests-1377105507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1b8246d6-bcb5-49ef-aba9-c679edcc9d0b tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:55 devstack sudo[107636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:36:55 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:55 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1d55aecd-9661-4d85-8612-949bfc8f9dd8 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b178a98e-b6be-4ea2-b19b-94123169225b -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b178a98e-b6be-4ea2-b19b-94123169225b.aa5b7ec9-0552-4b28-ac2b-fc656ebcabaa" returned: 0 in 0.300s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:55 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-1d55aecd-9661-4d85-8612-949bfc8f9dd8 tempest-ProjectMemberTests-1350538287 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b178a98e-b6be-4ea2-b19b-94123169225b.aa5b7ec9-0552-4b28-ac2b-fc656ebcabaa is being set with open permissions: ugo+rw Sep 03 14:36:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1d55aecd-9661-4d85-8612-949bfc8f9dd8 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b178a98e-b6be-4ea2-b19b-94123169225b.aa5b7ec9-0552-4b28-ac2b-fc656ebcabaa {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:55 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b178a98e-b6be-4ea2-b19b-94123169225b.aa5b7ec9-0552-4b28-ac2b-fc656ebcabaa Sep 03 14:36:55 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:55 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1b8246d6-bcb5-49ef-aba9-c679edcc9d0b tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.280s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:55 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-1b8246d6-bcb5-49ef-aba9-c679edcc9d0b tempest-ProjectReaderTests-1377105507 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:36:55 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-1b8246d6-bcb5-49ef-aba9-c679edcc9d0b tempest-ProjectReaderTests-1377105507 None] Deleted volume successfully. Sep 03 14:36:55 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1b8246d6-bcb5-49ef-aba9-c679edcc9d0b tempest-ProjectReaderTests-1377105507 None] Lock "cinder-8edc7097-c5b3-432f-9d8a-7807f658bf1c-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:55 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1d55aecd-9661-4d85-8612-949bfc8f9dd8 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b178a98e-b6be-4ea2-b19b-94123169225b.aa5b7ec9-0552-4b28-ac2b-fc656ebcabaa" returned: 0 in 0.268s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1d55aecd-9661-4d85-8612-949bfc8f9dd8 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b178a98e-b6be-4ea2-b19b-94123169225b.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:55 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b178a98e-b6be-4ea2-b19b-94123169225b.info Sep 03 14:36:55 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:56 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1d55aecd-9661-4d85-8612-949bfc8f9dd8 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b178a98e-b6be-4ea2-b19b-94123169225b.info" returned: 0 in 0.317s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:56 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-1d55aecd-9661-4d85-8612-949bfc8f9dd8 tempest-ProjectMemberTests-1350538287 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b178a98e-b6be-4ea2-b19b-94123169225b.info is being set with open permissions: ugo+rw Sep 03 14:36:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1d55aecd-9661-4d85-8612-949bfc8f9dd8 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b178a98e-b6be-4ea2-b19b-94123169225b.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:56 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-278aea08-7ae0-40cc-b557-2898a194b0f8 tempest-ProjectReaderTests-1377105507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:36:56 devstack sudo[107648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b178a98e-b6be-4ea2-b19b-94123169225b.info Sep 03 14:36:56 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:56 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-278aea08-7ae0-40cc-b557-2898a194b0f8 tempest-ProjectReaderTests-1377105507 None] Flow 'volume_create_manager' (f1f106ea-2ecf-48fa-af4f-1a47b3e2b704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:36:56 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-278aea08-7ae0-40cc-b557-2898a194b0f8 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20a6fa6f-b698-49ab-bf11-bf9778d728f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:56 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-278aea08-7ae0-40cc-b557-2898a194b0f8 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20a6fa6f-b698-49ab-bf11-bf9778d728f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-925644789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99676ebb-0164-4bf8-a234-d354f2d8a8de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c292af184774cb8a8630b73867fc4c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:36:56Z,use_quota=True,user_id='61387dc863c743a9af4844c7b603de31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:56 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-278aea08-7ae0-40cc-b557-2898a194b0f8 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8a43265-6ad8-4a04-9098-ac9498e9c8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:56 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-278aea08-7ae0-40cc-b557-2898a194b0f8 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8a43265-6ad8-4a04-9098-ac9498e9c8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:56 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-278aea08-7ae0-40cc-b557-2898a194b0f8 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (399900a3-2913-4f5e-b486-dbfa70ea3fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:56 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-278aea08-7ae0-40cc-b557-2898a194b0f8 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (399900a3-2913-4f5e-b486-dbfa70ea3fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99676ebb-0164-4bf8-a234-d354f2d8a8de', 'volume_name': 'volume-99676ebb-0164-4bf8-a234-d354f2d8a8de', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:56 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-278aea08-7ae0-40cc-b557-2898a194b0f8 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf733fbf-cfb4-44ac-a373-a6d0603959e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:56 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-278aea08-7ae0-40cc-b557-2898a194b0f8 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf733fbf-cfb4-44ac-a373-a6d0603959e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:56 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-278aea08-7ae0-40cc-b557-2898a194b0f8 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55bf63e5-c4b0-4b4d-84fc-079a675ff34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:56 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-278aea08-7ae0-40cc-b557-2898a194b0f8 tempest-ProjectReaderTests-1377105507 None] Volume 99676ebb-0164-4bf8-a234-d354f2d8a8de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99676ebb-0164-4bf8-a234-d354f2d8a8de', 'volume_size': 1} Sep 03 14:36:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-278aea08-7ae0-40cc-b557-2898a194b0f8 tempest-ProjectReaderTests-1377105507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:56 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1d55aecd-9661-4d85-8612-949bfc8f9dd8 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b178a98e-b6be-4ea2-b19b-94123169225b.info" returned: 0 in 0.274s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1d55aecd-9661-4d85-8612-949bfc8f9dd8 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.098s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-278aea08-7ae0-40cc-b557-2898a194b0f8 tempest-ProjectReaderTests-1377105507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.184s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:56 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-278aea08-7ae0-40cc-b557-2898a194b0f8 tempest-ProjectReaderTests-1377105507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-925644789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99676ebb-0164-4bf8-a234-d354f2d8a8de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c292af184774cb8a8630b73867fc4c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:36:56Z,use_quota=True,user_id='61387dc863c743a9af4844c7b603de31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:36:56 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-278aea08-7ae0-40cc-b557-2898a194b0f8 tempest-ProjectReaderTests-1377105507 None] Creating volume 99676ebb-0164-4bf8-a234-d354f2d8a8de {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:36:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-278aea08-7ae0-40cc-b557-2898a194b0f8 tempest-ProjectReaderTests-1377105507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-278aea08-7ae0-40cc-b557-2898a194b0f8 tempest-ProjectReaderTests-1377105507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:56 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-278aea08-7ae0-40cc-b557-2898a194b0f8 tempest-ProjectReaderTests-1377105507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:36:56 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-278aea08-7ae0-40cc-b557-2898a194b0f8 tempest-ProjectReaderTests-1377105507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:36:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-278aea08-7ae0-40cc-b557-2898a194b0f8 tempest-ProjectReaderTests-1377105507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:56 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-278aea08-7ae0-40cc-b557-2898a194b0f8 tempest-ProjectReaderTests-1377105507 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:36:56 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-278aea08-7ae0-40cc-b557-2898a194b0f8 tempest-ProjectReaderTests-1377105507 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:36:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-278aea08-7ae0-40cc-b557-2898a194b0f8 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-99676ebb-0164-4bf8-a234-d354f2d8a8de 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:56 devstack sudo[107651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-99676ebb-0164-4bf8-a234-d354f2d8a8de 1073741824 Sep 03 14:36:56 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:56 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-1d55aecd-9661-4d85-8612-949bfc8f9dd8 tempest-ProjectMemberTests-1350538287 None] Create snapshot completed successfully Sep 03 14:36:56 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-278aea08-7ae0-40cc-b557-2898a194b0f8 tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-99676ebb-0164-4bf8-a234-d354f2d8a8de 1073741824" returned: 0 in 0.463s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-278aea08-7ae0-40cc-b557-2898a194b0f8 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-99676ebb-0164-4bf8-a234-d354f2d8a8de {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:56 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-99676ebb-0164-4bf8-a234-d354f2d8a8de Sep 03 14:36:56 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:57 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-278aea08-7ae0-40cc-b557-2898a194b0f8 tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-99676ebb-0164-4bf8-a234-d354f2d8a8de" returned: 0 in 0.263s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:57 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-278aea08-7ae0-40cc-b557-2898a194b0f8 tempest-ProjectReaderTests-1377105507 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:36:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-278aea08-7ae0-40cc-b557-2898a194b0f8 tempest-ProjectReaderTests-1377105507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:36:57 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-278aea08-7ae0-40cc-b557-2898a194b0f8 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55bf63e5-c4b0-4b4d-84fc-079a675ff34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99676ebb-0164-4bf8-a234-d354f2d8a8de', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:57 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-278aea08-7ae0-40cc-b557-2898a194b0f8 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (556d70e1-6913-46e8-8adc-7a4e81eab9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:36:57 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-278aea08-7ae0-40cc-b557-2898a194b0f8 tempest-ProjectReaderTests-1377105507 None] Volume volume-99676ebb-0164-4bf8-a234-d354f2d8a8de (99676ebb-0164-4bf8-a234-d354f2d8a8de): created successfully Sep 03 14:36:57 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-278aea08-7ae0-40cc-b557-2898a194b0f8 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (556d70e1-6913-46e8-8adc-7a4e81eab9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:36:57 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-278aea08-7ae0-40cc-b557-2898a194b0f8 tempest-ProjectReaderTests-1377105507 None] Flow 'volume_create_manager' (f1f106ea-2ecf-48fa-af4f-1a47b3e2b704) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:36:57 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-278aea08-7ae0-40cc-b557-2898a194b0f8 tempest-ProjectReaderTests-1377105507 None] Created volume successfully. Sep 03 14:36:57 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-43131f24-3fbf-4368-ae9f-e51271e5f559 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "cinder-aa5b7ec9-0552-4b28-ac2b-fc656ebcabaa-delete_snapshot" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:57 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-43131f24-3fbf-4368-ae9f-e51271e5f559 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-aa5b7ec9-0552-4b28-ac2b-fc656ebcabaa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:57 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-43131f24-3fbf-4368-ae9f-e51271e5f559 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "cinder-quobyte-b178a98e-b6be-4ea2-b19b-94123169225b" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:57 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-43131f24-3fbf-4368-ae9f-e51271e5f559 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-b178a98e-b6be-4ea2-b19b-94123169225b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:57 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-43131f24-3fbf-4368-ae9f-e51271e5f559 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "cinder-quobyte-aa5b7ec9-0552-4b28-ac2b-fc656ebcabaa" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:57 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-43131f24-3fbf-4368-ae9f-e51271e5f559 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-aa5b7ec9-0552-4b28-ac2b-fc656ebcabaa" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:57 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-43131f24-3fbf-4368-ae9f-e51271e5f559 tempest-ProjectMemberTests-1350538287 None] Deleting offline snapshot aa5b7ec9-0552-4b28-ac2b-fc656ebcabaa of volume b178a98e-b6be-4ea2-b19b-94123169225b {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:36:57 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-43131f24-3fbf-4368-ae9f-e51271e5f559 tempest-ProjectMemberTests-1350538287 None] snapshot_file for this snap is: volume-b178a98e-b6be-4ea2-b19b-94123169225b.aa5b7ec9-0552-4b28-ac2b-fc656ebcabaa {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:36:57 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1366058e-5fb8-4a98-9960-0ca6fdf8ee16]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-43131f24-3fbf-4368-ae9f-e51271e5f559 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b178a98e-b6be-4ea2-b19b-94123169225b.aa5b7ec9-0552-4b28-ac2b-fc656ebcabaa {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:57 devstack sudo[107661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b178a98e-b6be-4ea2-b19b-94123169225b.aa5b7ec9-0552-4b28-ac2b-fc656ebcabaa Sep 03 14:36:57 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:57 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-43131f24-3fbf-4368-ae9f-e51271e5f559 tempest-ProjectMemberTests-1350538287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b178a98e-b6be-4ea2-b19b-94123169225b.aa5b7ec9-0552-4b28-ac2b-fc656ebcabaa" returned: 0 in 0.384s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:57 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-43131f24-3fbf-4368-ae9f-e51271e5f559 tempest-ProjectMemberTests-1350538287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b178a98e-b6be-4ea2-b19b-94123169225b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:36:57 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[91232359-bbf8-41cd-b071-17c1d5ee0903]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-43131f24-3fbf-4368-ae9f-e51271e5f559 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b178a98e-b6be-4ea2-b19b-94123169225b {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:58 devstack sudo[107666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b178a98e-b6be-4ea2-b19b-94123169225b Sep 03 14:36:58 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-65aa2bcb-f87f-4e27-8dfd-28fc5d123fce tempest-ProjectReaderTests-1377105507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:36:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-65aa2bcb-f87f-4e27-8dfd-28fc5d123fce tempest-ProjectReaderTests-1377105507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:36:58 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-65aa2bcb-f87f-4e27-8dfd-28fc5d123fce tempest-ProjectReaderTests-1377105507 None] Creating offline snapshot 353d71c4-12c3-471f-9fd2-997e2467eb1a of volume 99676ebb-0164-4bf8-a234-d354f2d8a8de {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:36:58 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a38f242-f8d5-4b3d-a013-d7aee7f652aa]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-65aa2bcb-f87f-4e27-8dfd-28fc5d123fce tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-99676ebb-0164-4bf8-a234-d354f2d8a8de {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:58 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-43131f24-3fbf-4368-ae9f-e51271e5f559 tempest-ProjectMemberTests-1350538287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b178a98e-b6be-4ea2-b19b-94123169225b" returned: 0 in 0.433s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-43131f24-3fbf-4368-ae9f-e51271e5f559 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b178a98e-b6be-4ea2-b19b-94123169225b.aa5b7ec9-0552-4b28-ac2b-fc656ebcabaa {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:58 devstack sudo[107672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b178a98e-b6be-4ea2-b19b-94123169225b.aa5b7ec9-0552-4b28-ac2b-fc656ebcabaa Sep 03 14:36:58 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:58 devstack sudo[107671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-99676ebb-0164-4bf8-a234-d354f2d8a8de Sep 03 14:36:58 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:58 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-65aa2bcb-f87f-4e27-8dfd-28fc5d123fce tempest-ProjectReaderTests-1377105507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-99676ebb-0164-4bf8-a234-d354f2d8a8de" returned: 0 in 0.402s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-65aa2bcb-f87f-4e27-8dfd-28fc5d123fce tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-99676ebb-0164-4bf8-a234-d354f2d8a8de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-99676ebb-0164-4bf8-a234-d354f2d8a8de.353d71c4-12c3-471f-9fd2-997e2467eb1a 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:58 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-43131f24-3fbf-4368-ae9f-e51271e5f559 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b178a98e-b6be-4ea2-b19b-94123169225b.aa5b7ec9-0552-4b28-ac2b-fc656ebcabaa" returned: 0 in 0.382s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-43131f24-3fbf-4368-ae9f-e51271e5f559 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b178a98e-b6be-4ea2-b19b-94123169225b.aa5b7ec9-0552-4b28-ac2b-fc656ebcabaa {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:58 devstack sudo[107682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-99676ebb-0164-4bf8-a234-d354f2d8a8de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-99676ebb-0164-4bf8-a234-d354f2d8a8de.353d71c4-12c3-471f-9fd2-997e2467eb1a 1G Sep 03 14:36:58 devstack sudo[107682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:58 devstack sudo[107683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b178a98e-b6be-4ea2-b19b-94123169225b.aa5b7ec9-0552-4b28-ac2b-fc656ebcabaa Sep 03 14:36:58 devstack sudo[107683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:59 devstack sudo[107683]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-43131f24-3fbf-4368-ae9f-e51271e5f559 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b178a98e-b6be-4ea2-b19b-94123169225b.aa5b7ec9-0552-4b28-ac2b-fc656ebcabaa" returned: 0 in 0.284s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:59 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-43131f24-3fbf-4368-ae9f-e51271e5f559 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-aa5b7ec9-0552-4b28-ac2b-fc656ebcabaa" released by "_delete_snapshot" :: held 1.600s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:59 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-43131f24-3fbf-4368-ae9f-e51271e5f559 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-b178a98e-b6be-4ea2-b19b-94123169225b" released by "delete_snapshot" :: held 1.622s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:59 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-43131f24-3fbf-4368-ae9f-e51271e5f559 tempest-ProjectMemberTests-1350538287 None] Created reservations ['81f98197-0559-487d-8465-5401b848f7e5', '1439dcf7-2579-4bc0-9bd5-460cea22058a', '9b194444-7d75-4377-80f2-cd369774cdd0', '30c418fc-b801-467c-8043-3fe00dd5524d'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:36:59 devstack sudo[107682]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-65aa2bcb-f87f-4e27-8dfd-28fc5d123fce tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-99676ebb-0164-4bf8-a234-d354f2d8a8de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-99676ebb-0164-4bf8-a234-d354f2d8a8de.353d71c4-12c3-471f-9fd2-997e2467eb1a 1G" returned: 0 in 0.446s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-65aa2bcb-f87f-4e27-8dfd-28fc5d123fce tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99676ebb-0164-4bf8-a234-d354f2d8a8de -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-99676ebb-0164-4bf8-a234-d354f2d8a8de.353d71c4-12c3-471f-9fd2-997e2467eb1a {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:59 devstack sudo[107691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99676ebb-0164-4bf8-a234-d354f2d8a8de -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-99676ebb-0164-4bf8-a234-d354f2d8a8de.353d71c4-12c3-471f-9fd2-997e2467eb1a Sep 03 14:36:59 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:59 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-43131f24-3fbf-4368-ae9f-e51271e5f559 tempest-ProjectMemberTests-1350538287 None] Delete snapshot completed successfully. Sep 03 14:36:59 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-43131f24-3fbf-4368-ae9f-e51271e5f559 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-aa5b7ec9-0552-4b28-ac2b-fc656ebcabaa-delete_snapshot" released by "delete_snapshot" :: held 1.796s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:36:59 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-65aa2bcb-f87f-4e27-8dfd-28fc5d123fce tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99676ebb-0164-4bf8-a234-d354f2d8a8de -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-99676ebb-0164-4bf8-a234-d354f2d8a8de.353d71c4-12c3-471f-9fd2-997e2467eb1a" returned: 0 in 0.315s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:59 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-65aa2bcb-f87f-4e27-8dfd-28fc5d123fce tempest-ProjectReaderTests-1377105507 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-99676ebb-0164-4bf8-a234-d354f2d8a8de.353d71c4-12c3-471f-9fd2-997e2467eb1a is being set with open permissions: ugo+rw Sep 03 14:36:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-65aa2bcb-f87f-4e27-8dfd-28fc5d123fce tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-99676ebb-0164-4bf8-a234-d354f2d8a8de.353d71c4-12c3-471f-9fd2-997e2467eb1a {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:59 devstack sudo[107696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-99676ebb-0164-4bf8-a234-d354f2d8a8de.353d71c4-12c3-471f-9fd2-997e2467eb1a Sep 03 14:36:59 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:59 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-0cf870f5-0f8c-4575-84cf-c9951df176a4 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "cinder-b178a98e-b6be-4ea2-b19b-94123169225b-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:59 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-0cf870f5-0f8c-4575-84cf-c9951df176a4 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-b178a98e-b6be-4ea2-b19b-94123169225b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:59 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-0cf870f5-0f8c-4575-84cf-c9951df176a4 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "cinder-quobyte-b178a98e-b6be-4ea2-b19b-94123169225b" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:36:59 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-0cf870f5-0f8c-4575-84cf-c9951df176a4 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-b178a98e-b6be-4ea2-b19b-94123169225b" acquired by "delete_volume" :: waited 0.014s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:36:59 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34f0747-d414-45cc-ac34-495492653b88]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:36:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0cf870f5-0f8c-4575-84cf-c9951df176a4 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b178a98e-b6be-4ea2-b19b-94123169225b {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:59 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root Sep 03 14:36:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-65aa2bcb-f87f-4e27-8dfd-28fc5d123fce tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-99676ebb-0164-4bf8-a234-d354f2d8a8de.353d71c4-12c3-471f-9fd2-997e2467eb1a" returned: 0 in 0.317s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:36:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-65aa2bcb-f87f-4e27-8dfd-28fc5d123fce tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-99676ebb-0164-4bf8-a234-d354f2d8a8de.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:36:59 devstack sudo[107700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-99676ebb-0164-4bf8-a234-d354f2d8a8de.info Sep 03 14:36:59 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:36:59 devstack sudo[107699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b178a98e-b6be-4ea2-b19b-94123169225b Sep 03 14:36:59 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:00 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-65aa2bcb-f87f-4e27-8dfd-28fc5d123fce tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-99676ebb-0164-4bf8-a234-d354f2d8a8de.info" returned: 0 in 0.294s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:00 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-65aa2bcb-f87f-4e27-8dfd-28fc5d123fce tempest-ProjectReaderTests-1377105507 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-99676ebb-0164-4bf8-a234-d354f2d8a8de.info is being set with open permissions: ugo+rw Sep 03 14:37:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-65aa2bcb-f87f-4e27-8dfd-28fc5d123fce tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-99676ebb-0164-4bf8-a234-d354f2d8a8de.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:00 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-99676ebb-0164-4bf8-a234-d354f2d8a8de.info Sep 03 14:37:00 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:00 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0cf870f5-0f8c-4575-84cf-c9951df176a4 tempest-ProjectMemberTests-1350538287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b178a98e-b6be-4ea2-b19b-94123169225b" returned: 0 in 0.422s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0cf870f5-0f8c-4575-84cf-c9951df176a4 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b178a98e-b6be-4ea2-b19b-94123169225b {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:00 devstack sudo[107709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b178a98e-b6be-4ea2-b19b-94123169225b Sep 03 14:37:00 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:00 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-65aa2bcb-f87f-4e27-8dfd-28fc5d123fce tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-99676ebb-0164-4bf8-a234-d354f2d8a8de.info" returned: 0 in 0.306s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:00 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-65aa2bcb-f87f-4e27-8dfd-28fc5d123fce tempest-ProjectReaderTests-1377105507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.180s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0cf870f5-0f8c-4575-84cf-c9951df176a4 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-b178a98e-b6be-4ea2-b19b-94123169225b" returned: 0 in 0.294s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:00 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-0cf870f5-0f8c-4575-84cf-c9951df176a4 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-b178a98e-b6be-4ea2-b19b-94123169225b" released by "delete_volume" :: held 0.801s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:00 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-65aa2bcb-f87f-4e27-8dfd-28fc5d123fce tempest-ProjectReaderTests-1377105507 None] Create snapshot completed successfully Sep 03 14:37:00 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-0cf870f5-0f8c-4575-84cf-c9951df176a4 tempest-ProjectMemberTests-1350538287 None] Created reservations ['234b542c-da5a-4bfb-b71d-59065236d9fc', '3b9e2175-cabb-47ce-b059-02b557561814', '462a62e5-b291-4473-a166-75b5bf8a1aa6', 'c45fd810-8f27-4127-b75c-bf7f38a38c11'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:37:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-0cf870f5-0f8c-4575-84cf-c9951df176a4 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-0cf870f5-0f8c-4575-84cf-c9951df176a4 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:00 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-0cf870f5-0f8c-4575-84cf-c9951df176a4 tempest-ProjectMemberTests-1350538287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:37:00 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-0cf870f5-0f8c-4575-84cf-c9951df176a4 tempest-ProjectMemberTests-1350538287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:37:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-0cf870f5-0f8c-4575-84cf-c9951df176a4 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0cf870f5-0f8c-4575-84cf-c9951df176a4 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:00 devstack sudo[107713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:37:00 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:00 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0cf870f5-0f8c-4575-84cf-c9951df176a4 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.265s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:00 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-0cf870f5-0f8c-4575-84cf-c9951df176a4 tempest-ProjectMemberTests-1350538287 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:37:00 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-0cf870f5-0f8c-4575-84cf-c9951df176a4 tempest-ProjectMemberTests-1350538287 None] Deleted volume successfully. Sep 03 14:37:00 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-0cf870f5-0f8c-4575-84cf-c9951df176a4 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-b178a98e-b6be-4ea2-b19b-94123169225b-delete_volume" released by "delete_volume" :: held 1.335s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:01 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbc77219-8fc5-447d-a73d-c7b1bf761f0e tempest-ProjectMemberTests-1350538287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:37:01 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cbc77219-8fc5-447d-a73d-c7b1bf761f0e tempest-ProjectMemberTests-1350538287 None] Flow 'volume_create_manager' (113a10be-ccb5-4560-ac8d-b4cc8d8be148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:37:01 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cbc77219-8fc5-447d-a73d-c7b1bf761f0e tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f76fd2b-801e-4c00-8e14-afea571d97df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:01 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cbc77219-8fc5-447d-a73d-c7b1bf761f0e tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f76fd2b-801e-4c00-8e14-afea571d97df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1438875941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=666dac4d-b97d-425a-8aed-3bd28a01894d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bdc07719fdf40189d19adf3cf793220',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:37:01Z,use_quota=True,user_id='c0e0fc3b02a64f5b9b037ade3f94a724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:01 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cbc77219-8fc5-447d-a73d-c7b1bf761f0e tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c034c15-2c21-473b-9e99-1f7f3e665064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:01 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cbc77219-8fc5-447d-a73d-c7b1bf761f0e tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c034c15-2c21-473b-9e99-1f7f3e665064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:01 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cbc77219-8fc5-447d-a73d-c7b1bf761f0e tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04de776e-75e0-4a83-a068-5ff3504752fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:01 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cbc77219-8fc5-447d-a73d-c7b1bf761f0e tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04de776e-75e0-4a83-a068-5ff3504752fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '666dac4d-b97d-425a-8aed-3bd28a01894d', 'volume_name': 'volume-666dac4d-b97d-425a-8aed-3bd28a01894d', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:01 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cbc77219-8fc5-447d-a73d-c7b1bf761f0e tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e65288d9-9194-4343-909d-5eebafa2c5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:01 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cbc77219-8fc5-447d-a73d-c7b1bf761f0e tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e65288d9-9194-4343-909d-5eebafa2c5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:01 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cbc77219-8fc5-447d-a73d-c7b1bf761f0e tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ad02766-c392-43c5-8631-61f900d9e41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:01 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-cbc77219-8fc5-447d-a73d-c7b1bf761f0e tempest-ProjectMemberTests-1350538287 None] Volume 666dac4d-b97d-425a-8aed-3bd28a01894d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-666dac4d-b97d-425a-8aed-3bd28a01894d', 'volume_size': 1} Sep 03 14:37:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-cbc77219-8fc5-447d-a73d-c7b1bf761f0e tempest-ProjectMemberTests-1350538287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-cbc77219-8fc5-447d-a73d-c7b1bf761f0e tempest-ProjectMemberTests-1350538287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:01 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-cbc77219-8fc5-447d-a73d-c7b1bf761f0e tempest-ProjectMemberTests-1350538287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1438875941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=666dac4d-b97d-425a-8aed-3bd28a01894d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bdc07719fdf40189d19adf3cf793220',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:37:01Z,use_quota=True,user_id='c0e0fc3b02a64f5b9b037ade3f94a724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:37:01 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-cbc77219-8fc5-447d-a73d-c7b1bf761f0e tempest-ProjectMemberTests-1350538287 None] Creating volume 666dac4d-b97d-425a-8aed-3bd28a01894d {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:37:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-cbc77219-8fc5-447d-a73d-c7b1bf761f0e tempest-ProjectMemberTests-1350538287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-cbc77219-8fc5-447d-a73d-c7b1bf761f0e tempest-ProjectMemberTests-1350538287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:01 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-cbc77219-8fc5-447d-a73d-c7b1bf761f0e tempest-ProjectMemberTests-1350538287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:37:01 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-cbc77219-8fc5-447d-a73d-c7b1bf761f0e tempest-ProjectMemberTests-1350538287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:37:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-cbc77219-8fc5-447d-a73d-c7b1bf761f0e tempest-ProjectMemberTests-1350538287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:01 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-cbc77219-8fc5-447d-a73d-c7b1bf761f0e tempest-ProjectMemberTests-1350538287 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:37:01 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-cbc77219-8fc5-447d-a73d-c7b1bf761f0e tempest-ProjectMemberTests-1350538287 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:37:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-cbc77219-8fc5-447d-a73d-c7b1bf761f0e tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-666dac4d-b97d-425a-8aed-3bd28a01894d 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:01 devstack sudo[107716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-666dac4d-b97d-425a-8aed-3bd28a01894d 1073741824 Sep 03 14:37:01 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:01 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-3c97c2c3-80b4-4b03-b128-4e642b5acaf8 tempest-ProjectReaderTests-1377105507 None] Acquiring lock "cinder-353d71c4-12c3-471f-9fd2-997e2467eb1a-delete_snapshot" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:01 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-3c97c2c3-80b4-4b03-b128-4e642b5acaf8 tempest-ProjectReaderTests-1377105507 None] Lock "cinder-353d71c4-12c3-471f-9fd2-997e2467eb1a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:01 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-3c97c2c3-80b4-4b03-b128-4e642b5acaf8 tempest-ProjectReaderTests-1377105507 None] Acquiring lock "cinder-quobyte-99676ebb-0164-4bf8-a234-d354f2d8a8de" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:01 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-3c97c2c3-80b4-4b03-b128-4e642b5acaf8 tempest-ProjectReaderTests-1377105507 None] Lock "cinder-quobyte-99676ebb-0164-4bf8-a234-d354f2d8a8de" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:01 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-3c97c2c3-80b4-4b03-b128-4e642b5acaf8 tempest-ProjectReaderTests-1377105507 None] Acquiring lock "cinder-quobyte-353d71c4-12c3-471f-9fd2-997e2467eb1a" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:01 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-3c97c2c3-80b4-4b03-b128-4e642b5acaf8 tempest-ProjectReaderTests-1377105507 None] Lock "cinder-quobyte-353d71c4-12c3-471f-9fd2-997e2467eb1a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:01 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-3c97c2c3-80b4-4b03-b128-4e642b5acaf8 tempest-ProjectReaderTests-1377105507 None] Deleting offline snapshot 353d71c4-12c3-471f-9fd2-997e2467eb1a of volume 99676ebb-0164-4bf8-a234-d354f2d8a8de {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:37:01 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-3c97c2c3-80b4-4b03-b128-4e642b5acaf8 tempest-ProjectReaderTests-1377105507 None] snapshot_file for this snap is: volume-99676ebb-0164-4bf8-a234-d354f2d8a8de.353d71c4-12c3-471f-9fd2-997e2467eb1a {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:37:01 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b77e0a-eb3b-4cc1-8a41-49cc2f0b5190]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:37:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3c97c2c3-80b4-4b03-b128-4e642b5acaf8 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-99676ebb-0164-4bf8-a234-d354f2d8a8de.353d71c4-12c3-471f-9fd2-997e2467eb1a {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:01 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-99676ebb-0164-4bf8-a234-d354f2d8a8de.353d71c4-12c3-471f-9fd2-997e2467eb1a Sep 03 14:37:01 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:01 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-cbc77219-8fc5-447d-a73d-c7b1bf761f0e tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-666dac4d-b97d-425a-8aed-3bd28a01894d 1073741824" returned: 0 in 0.478s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:01 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-cbc77219-8fc5-447d-a73d-c7b1bf761f0e tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-666dac4d-b97d-425a-8aed-3bd28a01894d {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:01 devstack sudo[107724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-666dac4d-b97d-425a-8aed-3bd28a01894d Sep 03 14:37:01 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:02 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3c97c2c3-80b4-4b03-b128-4e642b5acaf8 tempest-ProjectReaderTests-1377105507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-99676ebb-0164-4bf8-a234-d354f2d8a8de.353d71c4-12c3-471f-9fd2-997e2467eb1a" returned: 0 in 0.404s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:02 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-3c97c2c3-80b4-4b03-b128-4e642b5acaf8 tempest-ProjectReaderTests-1377105507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99676ebb-0164-4bf8-a234-d354f2d8a8de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:37:02 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8bb956-7427-4934-9628-09affeadda53]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:37:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3c97c2c3-80b4-4b03-b128-4e642b5acaf8 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-99676ebb-0164-4bf8-a234-d354f2d8a8de {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:02 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-cbc77219-8fc5-447d-a73d-c7b1bf761f0e tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-666dac4d-b97d-425a-8aed-3bd28a01894d" returned: 0 in 0.283s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:02 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-cbc77219-8fc5-447d-a73d-c7b1bf761f0e tempest-ProjectMemberTests-1350538287 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:37:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-cbc77219-8fc5-447d-a73d-c7b1bf761f0e tempest-ProjectMemberTests-1350538287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:02 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cbc77219-8fc5-447d-a73d-c7b1bf761f0e tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ad02766-c392-43c5-8631-61f900d9e41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-666dac4d-b97d-425a-8aed-3bd28a01894d', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:02 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cbc77219-8fc5-447d-a73d-c7b1bf761f0e tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0eabeea-67c1-4d10-8369-5c3a8838ee8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:02 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-cbc77219-8fc5-447d-a73d-c7b1bf761f0e tempest-ProjectMemberTests-1350538287 None] Volume volume-666dac4d-b97d-425a-8aed-3bd28a01894d (666dac4d-b97d-425a-8aed-3bd28a01894d): created successfully Sep 03 14:37:02 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cbc77219-8fc5-447d-a73d-c7b1bf761f0e tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0eabeea-67c1-4d10-8369-5c3a8838ee8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:02 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-cbc77219-8fc5-447d-a73d-c7b1bf761f0e tempest-ProjectMemberTests-1350538287 None] Flow 'volume_create_manager' (113a10be-ccb5-4560-ac8d-b4cc8d8be148) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:37:02 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-cbc77219-8fc5-447d-a73d-c7b1bf761f0e tempest-ProjectMemberTests-1350538287 None] Created volume successfully. Sep 03 14:37:02 devstack sudo[107730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-99676ebb-0164-4bf8-a234-d354f2d8a8de Sep 03 14:37:02 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:02 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3c97c2c3-80b4-4b03-b128-4e642b5acaf8 tempest-ProjectReaderTests-1377105507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-99676ebb-0164-4bf8-a234-d354f2d8a8de" returned: 0 in 0.400s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3c97c2c3-80b4-4b03-b128-4e642b5acaf8 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-99676ebb-0164-4bf8-a234-d354f2d8a8de.353d71c4-12c3-471f-9fd2-997e2467eb1a {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:02 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-99676ebb-0164-4bf8-a234-d354f2d8a8de.353d71c4-12c3-471f-9fd2-997e2467eb1a Sep 03 14:37:02 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:02 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3c97c2c3-80b4-4b03-b128-4e642b5acaf8 tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-99676ebb-0164-4bf8-a234-d354f2d8a8de.353d71c4-12c3-471f-9fd2-997e2467eb1a" returned: 0 in 0.377s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:02 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3c97c2c3-80b4-4b03-b128-4e642b5acaf8 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-99676ebb-0164-4bf8-a234-d354f2d8a8de.353d71c4-12c3-471f-9fd2-997e2467eb1a {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:02 devstack sudo[107741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-99676ebb-0164-4bf8-a234-d354f2d8a8de.353d71c4-12c3-471f-9fd2-997e2467eb1a Sep 03 14:37:02 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:03 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3c97c2c3-80b4-4b03-b128-4e642b5acaf8 tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-99676ebb-0164-4bf8-a234-d354f2d8a8de.353d71c4-12c3-471f-9fd2-997e2467eb1a" returned: 0 in 0.257s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:03 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-3c97c2c3-80b4-4b03-b128-4e642b5acaf8 tempest-ProjectReaderTests-1377105507 None] Lock "cinder-quobyte-353d71c4-12c3-471f-9fd2-997e2467eb1a" released by "_delete_snapshot" :: held 1.533s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:03 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-3c97c2c3-80b4-4b03-b128-4e642b5acaf8 tempest-ProjectReaderTests-1377105507 None] Lock "cinder-quobyte-99676ebb-0164-4bf8-a234-d354f2d8a8de" released by "delete_snapshot" :: held 1.560s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:03 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-3c97c2c3-80b4-4b03-b128-4e642b5acaf8 tempest-ProjectReaderTests-1377105507 None] Created reservations ['6cdd54d6-7318-4a06-9db1-9b7c55b3bf45', '8edc2044-197c-4166-b109-62864ff24666', '4c1d9202-7ca0-4ec6-8cc2-c780dff46931', '6bc40c83-7aa3-4944-8b96-95e9018320d0'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:37:03 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-3c97c2c3-80b4-4b03-b128-4e642b5acaf8 tempest-ProjectReaderTests-1377105507 None] Delete snapshot completed successfully. Sep 03 14:37:03 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-3c97c2c3-80b4-4b03-b128-4e642b5acaf8 tempest-ProjectReaderTests-1377105507 None] Lock "cinder-353d71c4-12c3-471f-9fd2-997e2467eb1a-delete_snapshot" released by "delete_snapshot" :: held 1.722s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d0097421-8757-4e13-9e7d-b0b74efa7768 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d0097421-8757-4e13-9e7d-b0b74efa7768 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:03 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-d0097421-8757-4e13-9e7d-b0b74efa7768 tempest-ProjectMemberTests-1350538287 None] Creating offline snapshot ab058988-a98e-4206-ab8d-d1bef3af626a of volume 666dac4d-b97d-425a-8aed-3bd28a01894d {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:37:03 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9b0aff-da30-4cbf-ad54-62219f2c7d75]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:37:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d0097421-8757-4e13-9e7d-b0b74efa7768 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-666dac4d-b97d-425a-8aed-3bd28a01894d {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:03 devstack sudo[107744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-666dac4d-b97d-425a-8aed-3bd28a01894d Sep 03 14:37:03 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:03 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ab58ea75-a7ee-4266-9972-ea340a636869 tempest-ProjectReaderTests-1377105507 None] Acquiring lock "cinder-99676ebb-0164-4bf8-a234-d354f2d8a8de-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:03 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ab58ea75-a7ee-4266-9972-ea340a636869 tempest-ProjectReaderTests-1377105507 None] Lock "cinder-99676ebb-0164-4bf8-a234-d354f2d8a8de-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:03 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ab58ea75-a7ee-4266-9972-ea340a636869 tempest-ProjectReaderTests-1377105507 None] Acquiring lock "cinder-quobyte-99676ebb-0164-4bf8-a234-d354f2d8a8de" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:03 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ab58ea75-a7ee-4266-9972-ea340a636869 tempest-ProjectReaderTests-1377105507 None] Lock "cinder-quobyte-99676ebb-0164-4bf8-a234-d354f2d8a8de" acquired by "delete_volume" :: waited 0.019s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:03 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f951f717-c7de-467d-92ce-50cd15bd63a7]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:37:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ab58ea75-a7ee-4266-9972-ea340a636869 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-99676ebb-0164-4bf8-a234-d354f2d8a8de {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:03 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d0097421-8757-4e13-9e7d-b0b74efa7768 tempest-ProjectMemberTests-1350538287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-666dac4d-b97d-425a-8aed-3bd28a01894d" returned: 0 in 0.427s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:03 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d0097421-8757-4e13-9e7d-b0b74efa7768 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-666dac4d-b97d-425a-8aed-3bd28a01894d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-666dac4d-b97d-425a-8aed-3bd28a01894d.ab058988-a98e-4206-ab8d-d1bef3af626a 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:03 devstack sudo[107746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-99676ebb-0164-4bf8-a234-d354f2d8a8de Sep 03 14:37:03 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:03 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-666dac4d-b97d-425a-8aed-3bd28a01894d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-666dac4d-b97d-425a-8aed-3bd28a01894d.ab058988-a98e-4206-ab8d-d1bef3af626a 1G Sep 03 14:37:03 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:04 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ab58ea75-a7ee-4266-9972-ea340a636869 tempest-ProjectReaderTests-1377105507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-99676ebb-0164-4bf8-a234-d354f2d8a8de" returned: 0 in 0.417s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ab58ea75-a7ee-4266-9972-ea340a636869 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-99676ebb-0164-4bf8-a234-d354f2d8a8de {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:04 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-99676ebb-0164-4bf8-a234-d354f2d8a8de Sep 03 14:37:04 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:04 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d0097421-8757-4e13-9e7d-b0b74efa7768 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-666dac4d-b97d-425a-8aed-3bd28a01894d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-666dac4d-b97d-425a-8aed-3bd28a01894d.ab058988-a98e-4206-ab8d-d1bef3af626a 1G" returned: 0 in 0.493s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d0097421-8757-4e13-9e7d-b0b74efa7768 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-666dac4d-b97d-425a-8aed-3bd28a01894d -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-666dac4d-b97d-425a-8aed-3bd28a01894d.ab058988-a98e-4206-ab8d-d1bef3af626a {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:04 devstack sudo[107761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-666dac4d-b97d-425a-8aed-3bd28a01894d -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-666dac4d-b97d-425a-8aed-3bd28a01894d.ab058988-a98e-4206-ab8d-d1bef3af626a Sep 03 14:37:04 devstack sudo[107761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:04 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ab58ea75-a7ee-4266-9972-ea340a636869 tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-99676ebb-0164-4bf8-a234-d354f2d8a8de" returned: 0 in 0.284s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:04 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ab58ea75-a7ee-4266-9972-ea340a636869 tempest-ProjectReaderTests-1377105507 None] Lock "cinder-quobyte-99676ebb-0164-4bf8-a234-d354f2d8a8de" released by "delete_volume" :: held 0.768s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:04 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-ab58ea75-a7ee-4266-9972-ea340a636869 tempest-ProjectReaderTests-1377105507 None] Created reservations ['5e3951db-9d4b-4839-81f4-33ec4e5b689b', 'e1ee7cfc-82cd-43c9-bf05-7b474737970f', 'a6974045-d3bb-440e-b8e9-3371e305bdef', '43dec175-34b4-4222-a5bc-c3de6bc7da3e'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:37:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ab58ea75-a7ee-4266-9972-ea340a636869 tempest-ProjectReaderTests-1377105507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ab58ea75-a7ee-4266-9972-ea340a636869 tempest-ProjectReaderTests-1377105507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:04 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ab58ea75-a7ee-4266-9972-ea340a636869 tempest-ProjectReaderTests-1377105507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:37:04 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ab58ea75-a7ee-4266-9972-ea340a636869 tempest-ProjectReaderTests-1377105507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:37:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ab58ea75-a7ee-4266-9972-ea340a636869 tempest-ProjectReaderTests-1377105507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ab58ea75-a7ee-4266-9972-ea340a636869 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:04 devstack sudo[107766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:37:04 devstack sudo[107766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:04 devstack sudo[107761]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d0097421-8757-4e13-9e7d-b0b74efa7768 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-666dac4d-b97d-425a-8aed-3bd28a01894d -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-666dac4d-b97d-425a-8aed-3bd28a01894d.ab058988-a98e-4206-ab8d-d1bef3af626a" returned: 0 in 0.336s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:04 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-d0097421-8757-4e13-9e7d-b0b74efa7768 tempest-ProjectMemberTests-1350538287 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-666dac4d-b97d-425a-8aed-3bd28a01894d.ab058988-a98e-4206-ab8d-d1bef3af626a is being set with open permissions: ugo+rw Sep 03 14:37:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d0097421-8757-4e13-9e7d-b0b74efa7768 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-666dac4d-b97d-425a-8aed-3bd28a01894d.ab058988-a98e-4206-ab8d-d1bef3af626a {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:04 devstack sudo[107769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-666dac4d-b97d-425a-8aed-3bd28a01894d.ab058988-a98e-4206-ab8d-d1bef3af626a Sep 03 14:37:04 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:05 devstack sudo[107766]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ab58ea75-a7ee-4266-9972-ea340a636869 tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.294s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:05 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-ab58ea75-a7ee-4266-9972-ea340a636869 tempest-ProjectReaderTests-1377105507 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:37:05 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-ab58ea75-a7ee-4266-9972-ea340a636869 tempest-ProjectReaderTests-1377105507 None] Deleted volume successfully. Sep 03 14:37:05 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ab58ea75-a7ee-4266-9972-ea340a636869 tempest-ProjectReaderTests-1377105507 None] Lock "cinder-99676ebb-0164-4bf8-a234-d354f2d8a8de-delete_volume" released by "delete_volume" :: held 1.331s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:05 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d0097421-8757-4e13-9e7d-b0b74efa7768 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-666dac4d-b97d-425a-8aed-3bd28a01894d.ab058988-a98e-4206-ab8d-d1bef3af626a" returned: 0 in 0.291s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d0097421-8757-4e13-9e7d-b0b74efa7768 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-666dac4d-b97d-425a-8aed-3bd28a01894d.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:05 devstack sudo[107773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-666dac4d-b97d-425a-8aed-3bd28a01894d.info Sep 03 14:37:05 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:05 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-9984652c-f87d-45c7-96bd-a1851002ad56 tempest-ProjectReaderTests-1377105507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:37:05 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-9984652c-f87d-45c7-96bd-a1851002ad56 tempest-ProjectReaderTests-1377105507 None] Flow 'volume_create_manager' (526834b3-28ac-4176-8d45-c3261c45418f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:37:05 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-9984652c-f87d-45c7-96bd-a1851002ad56 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48d3d7ed-2727-456f-8c2f-a45d7919f810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:05 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d0097421-8757-4e13-9e7d-b0b74efa7768 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-666dac4d-b97d-425a-8aed-3bd28a01894d.info" returned: 0 in 0.312s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:05 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-d0097421-8757-4e13-9e7d-b0b74efa7768 tempest-ProjectMemberTests-1350538287 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-666dac4d-b97d-425a-8aed-3bd28a01894d.info is being set with open permissions: ugo+rw Sep 03 14:37:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d0097421-8757-4e13-9e7d-b0b74efa7768 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-666dac4d-b97d-425a-8aed-3bd28a01894d.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:05 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-9984652c-f87d-45c7-96bd-a1851002ad56 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48d3d7ed-2727-456f-8c2f-a45d7919f810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1834233140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4230e81b-a055-4059-aa1f-b92d9530c063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c292af184774cb8a8630b73867fc4c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:37:05Z,use_quota=True,user_id='61387dc863c743a9af4844c7b603de31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:05 devstack sudo[107776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-666dac4d-b97d-425a-8aed-3bd28a01894d.info Sep 03 14:37:05 devstack sudo[107776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:05 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-9984652c-f87d-45c7-96bd-a1851002ad56 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (201c9a29-5b5d-4f08-a2c5-9d1cab6d0d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:05 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-9984652c-f87d-45c7-96bd-a1851002ad56 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (201c9a29-5b5d-4f08-a2c5-9d1cab6d0d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:05 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-9984652c-f87d-45c7-96bd-a1851002ad56 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (484fdd9e-7e66-47a6-8626-47957367b19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:05 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-9984652c-f87d-45c7-96bd-a1851002ad56 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (484fdd9e-7e66-47a6-8626-47957367b19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4230e81b-a055-4059-aa1f-b92d9530c063', 'volume_name': 'volume-4230e81b-a055-4059-aa1f-b92d9530c063', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:05 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-9984652c-f87d-45c7-96bd-a1851002ad56 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e27a79e0-7f74-4488-ab8c-cc10d60bb757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:05 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-9984652c-f87d-45c7-96bd-a1851002ad56 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e27a79e0-7f74-4488-ab8c-cc10d60bb757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:05 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-9984652c-f87d-45c7-96bd-a1851002ad56 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84f3d7d8-c986-4a5c-8636-b59bfa6a5221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:05 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-9984652c-f87d-45c7-96bd-a1851002ad56 tempest-ProjectReaderTests-1377105507 None] Volume 4230e81b-a055-4059-aa1f-b92d9530c063: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4230e81b-a055-4059-aa1f-b92d9530c063', 'volume_size': 1} Sep 03 14:37:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-9984652c-f87d-45c7-96bd-a1851002ad56 tempest-ProjectReaderTests-1377105507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:05 devstack sudo[107776]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d0097421-8757-4e13-9e7d-b0b74efa7768 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-666dac4d-b97d-425a-8aed-3bd28a01894d.info" returned: 0 in 0.246s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d0097421-8757-4e13-9e7d-b0b74efa7768 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.193s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-9984652c-f87d-45c7-96bd-a1851002ad56 tempest-ProjectReaderTests-1377105507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.206s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:05 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-9984652c-f87d-45c7-96bd-a1851002ad56 tempest-ProjectReaderTests-1377105507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1834233140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4230e81b-a055-4059-aa1f-b92d9530c063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c292af184774cb8a8630b73867fc4c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:37:05Z,use_quota=True,user_id='61387dc863c743a9af4844c7b603de31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:37:05 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-9984652c-f87d-45c7-96bd-a1851002ad56 tempest-ProjectReaderTests-1377105507 None] Creating volume 4230e81b-a055-4059-aa1f-b92d9530c063 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:37:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-9984652c-f87d-45c7-96bd-a1851002ad56 tempest-ProjectReaderTests-1377105507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-9984652c-f87d-45c7-96bd-a1851002ad56 tempest-ProjectReaderTests-1377105507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:05 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-9984652c-f87d-45c7-96bd-a1851002ad56 tempest-ProjectReaderTests-1377105507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:37:05 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-9984652c-f87d-45c7-96bd-a1851002ad56 tempest-ProjectReaderTests-1377105507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:37:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-9984652c-f87d-45c7-96bd-a1851002ad56 tempest-ProjectReaderTests-1377105507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:05 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-9984652c-f87d-45c7-96bd-a1851002ad56 tempest-ProjectReaderTests-1377105507 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:37:05 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-9984652c-f87d-45c7-96bd-a1851002ad56 tempest-ProjectReaderTests-1377105507 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:37:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9984652c-f87d-45c7-96bd-a1851002ad56 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4230e81b-a055-4059-aa1f-b92d9530c063 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:05 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4230e81b-a055-4059-aa1f-b92d9530c063 1073741824 Sep 03 14:37:05 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:05 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-d0097421-8757-4e13-9e7d-b0b74efa7768 tempest-ProjectMemberTests-1350538287 None] Create snapshot completed successfully Sep 03 14:37:06 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9984652c-f87d-45c7-96bd-a1851002ad56 tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4230e81b-a055-4059-aa1f-b92d9530c063 1073741824" returned: 0 in 0.450s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9984652c-f87d-45c7-96bd-a1851002ad56 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4230e81b-a055-4059-aa1f-b92d9530c063 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:06 devstack sudo[107785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4230e81b-a055-4059-aa1f-b92d9530c063 Sep 03 14:37:06 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:06 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-9984652c-f87d-45c7-96bd-a1851002ad56 tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4230e81b-a055-4059-aa1f-b92d9530c063" returned: 0 in 0.252s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:06 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-9984652c-f87d-45c7-96bd-a1851002ad56 tempest-ProjectReaderTests-1377105507 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:37:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-9984652c-f87d-45c7-96bd-a1851002ad56 tempest-ProjectReaderTests-1377105507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:06 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-9984652c-f87d-45c7-96bd-a1851002ad56 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84f3d7d8-c986-4a5c-8636-b59bfa6a5221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4230e81b-a055-4059-aa1f-b92d9530c063', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:06 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-9984652c-f87d-45c7-96bd-a1851002ad56 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f54142cd-a39f-49a9-9469-24e077464175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:06 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-9984652c-f87d-45c7-96bd-a1851002ad56 tempest-ProjectReaderTests-1377105507 None] Volume volume-4230e81b-a055-4059-aa1f-b92d9530c063 (4230e81b-a055-4059-aa1f-b92d9530c063): created successfully Sep 03 14:37:06 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-9984652c-f87d-45c7-96bd-a1851002ad56 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f54142cd-a39f-49a9-9469-24e077464175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:06 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-9984652c-f87d-45c7-96bd-a1851002ad56 tempest-ProjectReaderTests-1377105507 None] Flow 'volume_create_manager' (526834b3-28ac-4176-8d45-c3261c45418f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:37:06 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-9984652c-f87d-45c7-96bd-a1851002ad56 tempest-ProjectReaderTests-1377105507 None] Created volume successfully. Sep 03 14:37:06 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7bf5dfa8-2bdb-40bb-96aa-28a8f156de6a tempest-ProjectMemberTests-1350538287 None] Acquiring lock "cinder-ab058988-a98e-4206-ab8d-d1bef3af626a-delete_snapshot" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:06 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7bf5dfa8-2bdb-40bb-96aa-28a8f156de6a tempest-ProjectMemberTests-1350538287 None] Lock "cinder-ab058988-a98e-4206-ab8d-d1bef3af626a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:06 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7bf5dfa8-2bdb-40bb-96aa-28a8f156de6a tempest-ProjectMemberTests-1350538287 None] Acquiring lock "cinder-quobyte-666dac4d-b97d-425a-8aed-3bd28a01894d" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:06 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7bf5dfa8-2bdb-40bb-96aa-28a8f156de6a tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-666dac4d-b97d-425a-8aed-3bd28a01894d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:06 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7bf5dfa8-2bdb-40bb-96aa-28a8f156de6a tempest-ProjectMemberTests-1350538287 None] Acquiring lock "cinder-quobyte-ab058988-a98e-4206-ab8d-d1bef3af626a" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:06 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7bf5dfa8-2bdb-40bb-96aa-28a8f156de6a tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-ab058988-a98e-4206-ab8d-d1bef3af626a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:06 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-7bf5dfa8-2bdb-40bb-96aa-28a8f156de6a tempest-ProjectMemberTests-1350538287 None] Deleting offline snapshot ab058988-a98e-4206-ab8d-d1bef3af626a of volume 666dac4d-b97d-425a-8aed-3bd28a01894d {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:37:06 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-7bf5dfa8-2bdb-40bb-96aa-28a8f156de6a tempest-ProjectMemberTests-1350538287 None] snapshot_file for this snap is: volume-666dac4d-b97d-425a-8aed-3bd28a01894d.ab058988-a98e-4206-ab8d-d1bef3af626a {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:37:06 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2237c543-addc-4ec4-821d-574d83bb85cd]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:37:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7bf5dfa8-2bdb-40bb-96aa-28a8f156de6a tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-666dac4d-b97d-425a-8aed-3bd28a01894d.ab058988-a98e-4206-ab8d-d1bef3af626a {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:06 devstack sudo[107789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-666dac4d-b97d-425a-8aed-3bd28a01894d.ab058988-a98e-4206-ab8d-d1bef3af626a Sep 03 14:37:06 devstack sudo[107789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:07 devstack sudo[107789]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7bf5dfa8-2bdb-40bb-96aa-28a8f156de6a tempest-ProjectMemberTests-1350538287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-666dac4d-b97d-425a-8aed-3bd28a01894d.ab058988-a98e-4206-ab8d-d1bef3af626a" returned: 0 in 0.365s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:07 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-7bf5dfa8-2bdb-40bb-96aa-28a8f156de6a tempest-ProjectMemberTests-1350538287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-666dac4d-b97d-425a-8aed-3bd28a01894d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:37:07 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[218cfc38-9f5d-4155-8acf-7acd3930c795]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:37:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7bf5dfa8-2bdb-40bb-96aa-28a8f156de6a tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-666dac4d-b97d-425a-8aed-3bd28a01894d {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:07 devstack sudo[107794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-666dac4d-b97d-425a-8aed-3bd28a01894d Sep 03 14:37:07 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:07 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7bf5dfa8-2bdb-40bb-96aa-28a8f156de6a tempest-ProjectMemberTests-1350538287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-666dac4d-b97d-425a-8aed-3bd28a01894d" returned: 0 in 0.437s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7bf5dfa8-2bdb-40bb-96aa-28a8f156de6a tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-666dac4d-b97d-425a-8aed-3bd28a01894d.ab058988-a98e-4206-ab8d-d1bef3af626a {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:07 devstack sudo[107800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-666dac4d-b97d-425a-8aed-3bd28a01894d.ab058988-a98e-4206-ab8d-d1bef3af626a Sep 03 14:37:07 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6e36f4dd-ad2f-43bb-9502-3092a25951e6 tempest-ProjectReaderTests-1377105507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6e36f4dd-ad2f-43bb-9502-3092a25951e6 tempest-ProjectReaderTests-1377105507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:07 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-6e36f4dd-ad2f-43bb-9502-3092a25951e6 tempest-ProjectReaderTests-1377105507 None] Creating offline snapshot cb298429-2318-4673-8929-26df125be6c7 of volume 4230e81b-a055-4059-aa1f-b92d9530c063 {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:37:07 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab7c41d-18b3-4127-b643-4c6d80b89212]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:37:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6e36f4dd-ad2f-43bb-9502-3092a25951e6 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4230e81b-a055-4059-aa1f-b92d9530c063 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:07 devstack sudo[107802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4230e81b-a055-4059-aa1f-b92d9530c063 Sep 03 14:37:07 devstack sudo[107802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:08 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7bf5dfa8-2bdb-40bb-96aa-28a8f156de6a tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-666dac4d-b97d-425a-8aed-3bd28a01894d.ab058988-a98e-4206-ab8d-d1bef3af626a" returned: 0 in 0.395s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7bf5dfa8-2bdb-40bb-96aa-28a8f156de6a tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-666dac4d-b97d-425a-8aed-3bd28a01894d.ab058988-a98e-4206-ab8d-d1bef3af626a {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:08 devstack sudo[107807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-666dac4d-b97d-425a-8aed-3bd28a01894d.ab058988-a98e-4206-ab8d-d1bef3af626a Sep 03 14:37:08 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:08 devstack sudo[107802]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6e36f4dd-ad2f-43bb-9502-3092a25951e6 tempest-ProjectReaderTests-1377105507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4230e81b-a055-4059-aa1f-b92d9530c063" returned: 0 in 0.416s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6e36f4dd-ad2f-43bb-9502-3092a25951e6 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4230e81b-a055-4059-aa1f-b92d9530c063,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4230e81b-a055-4059-aa1f-b92d9530c063.cb298429-2318-4673-8929-26df125be6c7 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:08 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4230e81b-a055-4059-aa1f-b92d9530c063,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4230e81b-a055-4059-aa1f-b92d9530c063.cb298429-2318-4673-8929-26df125be6c7 1G Sep 03 14:37:08 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:08 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-7bf5dfa8-2bdb-40bb-96aa-28a8f156de6a tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-666dac4d-b97d-425a-8aed-3bd28a01894d.ab058988-a98e-4206-ab8d-d1bef3af626a" returned: 0 in 0.278s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:08 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7bf5dfa8-2bdb-40bb-96aa-28a8f156de6a tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-ab058988-a98e-4206-ab8d-d1bef3af626a" released by "_delete_snapshot" :: held 1.586s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:08 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7bf5dfa8-2bdb-40bb-96aa-28a8f156de6a tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-666dac4d-b97d-425a-8aed-3bd28a01894d" released by "delete_snapshot" :: held 1.612s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:08 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-7bf5dfa8-2bdb-40bb-96aa-28a8f156de6a tempest-ProjectMemberTests-1350538287 None] Created reservations ['a1e9c2fb-0dc9-4b33-837e-0ca4d6e59386', 'e7b5ea1b-9254-48c1-b007-8a50f2f2ed37', 'c547a8e1-7521-4547-9c1b-840d846d0e59', 'd02ce98f-2b72-4e3a-95d5-431e8ccabbf5'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:37:08 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-7bf5dfa8-2bdb-40bb-96aa-28a8f156de6a tempest-ProjectMemberTests-1350538287 None] Delete snapshot completed successfully. Sep 03 14:37:08 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-7bf5dfa8-2bdb-40bb-96aa-28a8f156de6a tempest-ProjectMemberTests-1350538287 None] Lock "cinder-ab058988-a98e-4206-ab8d-d1bef3af626a-delete_snapshot" released by "delete_snapshot" :: held 1.766s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:08 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6e36f4dd-ad2f-43bb-9502-3092a25951e6 tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4230e81b-a055-4059-aa1f-b92d9530c063,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4230e81b-a055-4059-aa1f-b92d9530c063.cb298429-2318-4673-8929-26df125be6c7 1G" returned: 0 in 0.427s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6e36f4dd-ad2f-43bb-9502-3092a25951e6 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4230e81b-a055-4059-aa1f-b92d9530c063 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4230e81b-a055-4059-aa1f-b92d9530c063.cb298429-2318-4673-8929-26df125be6c7 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:08 devstack sudo[107820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4230e81b-a055-4059-aa1f-b92d9530c063 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4230e81b-a055-4059-aa1f-b92d9530c063.cb298429-2318-4673-8929-26df125be6c7 Sep 03 14:37:08 devstack sudo[107820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:08 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-033c1d38-c234-404d-9254-f5202d574439 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "cinder-666dac4d-b97d-425a-8aed-3bd28a01894d-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:08 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-033c1d38-c234-404d-9254-f5202d574439 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-666dac4d-b97d-425a-8aed-3bd28a01894d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:08 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-033c1d38-c234-404d-9254-f5202d574439 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "cinder-quobyte-666dac4d-b97d-425a-8aed-3bd28a01894d" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:08 devstack sudo[107820]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6e36f4dd-ad2f-43bb-9502-3092a25951e6 tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4230e81b-a055-4059-aa1f-b92d9530c063 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4230e81b-a055-4059-aa1f-b92d9530c063.cb298429-2318-4673-8929-26df125be6c7" returned: 0 in 0.295s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:08 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-6e36f4dd-ad2f-43bb-9502-3092a25951e6 tempest-ProjectReaderTests-1377105507 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4230e81b-a055-4059-aa1f-b92d9530c063.cb298429-2318-4673-8929-26df125be6c7 is being set with open permissions: ugo+rw Sep 03 14:37:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6e36f4dd-ad2f-43bb-9502-3092a25951e6 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4230e81b-a055-4059-aa1f-b92d9530c063.cb298429-2318-4673-8929-26df125be6c7 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:08 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-033c1d38-c234-404d-9254-f5202d574439 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-666dac4d-b97d-425a-8aed-3bd28a01894d" acquired by "delete_volume" :: waited 0.030s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:08 devstack sudo[107825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4230e81b-a055-4059-aa1f-b92d9530c063.cb298429-2318-4673-8929-26df125be6c7 Sep 03 14:37:08 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:09 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[233d0072-65d4-4dd1-a78a-e1263213adbd]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:37:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-033c1d38-c234-404d-9254-f5202d574439 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-666dac4d-b97d-425a-8aed-3bd28a01894d {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:09 devstack sudo[107827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-666dac4d-b97d-425a-8aed-3bd28a01894d Sep 03 14:37:09 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:09 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6e36f4dd-ad2f-43bb-9502-3092a25951e6 tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4230e81b-a055-4059-aa1f-b92d9530c063.cb298429-2318-4673-8929-26df125be6c7" returned: 0 in 0.255s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6e36f4dd-ad2f-43bb-9502-3092a25951e6 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4230e81b-a055-4059-aa1f-b92d9530c063.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:09 devstack sudo[107830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4230e81b-a055-4059-aa1f-b92d9530c063.info Sep 03 14:37:09 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:09 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-033c1d38-c234-404d-9254-f5202d574439 tempest-ProjectMemberTests-1350538287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-666dac4d-b97d-425a-8aed-3bd28a01894d" returned: 0 in 0.360s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-033c1d38-c234-404d-9254-f5202d574439 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-666dac4d-b97d-425a-8aed-3bd28a01894d {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:09 devstack sudo[107835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-666dac4d-b97d-425a-8aed-3bd28a01894d Sep 03 14:37:09 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:09 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6e36f4dd-ad2f-43bb-9502-3092a25951e6 tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4230e81b-a055-4059-aa1f-b92d9530c063.info" returned: 0 in 0.257s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:09 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-6e36f4dd-ad2f-43bb-9502-3092a25951e6 tempest-ProjectReaderTests-1377105507 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4230e81b-a055-4059-aa1f-b92d9530c063.info is being set with open permissions: ugo+rw Sep 03 14:37:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6e36f4dd-ad2f-43bb-9502-3092a25951e6 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4230e81b-a055-4059-aa1f-b92d9530c063.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:09 devstack sudo[107838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4230e81b-a055-4059-aa1f-b92d9530c063.info Sep 03 14:37:09 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:09 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-033c1d38-c234-404d-9254-f5202d574439 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-666dac4d-b97d-425a-8aed-3bd28a01894d" returned: 0 in 0.260s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:09 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-033c1d38-c234-404d-9254-f5202d574439 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-666dac4d-b97d-425a-8aed-3bd28a01894d" released by "delete_volume" :: held 0.687s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:09 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-033c1d38-c234-404d-9254-f5202d574439 tempest-ProjectMemberTests-1350538287 None] Created reservations ['830432dc-61a8-4c0a-804d-b21e475a91b9', 'f4657660-3b34-49c1-ab2b-56505a560c77', 'aacede33-708f-4779-8be4-cb832f41b5b8', '15ce7ac0-3d73-4408-9acf-365b7a975fb5'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:37:09 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6e36f4dd-ad2f-43bb-9502-3092a25951e6 tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4230e81b-a055-4059-aa1f-b92d9530c063.info" returned: 0 in 0.257s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6e36f4dd-ad2f-43bb-9502-3092a25951e6 tempest-ProjectReaderTests-1377105507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.998s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:09 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-6e36f4dd-ad2f-43bb-9502-3092a25951e6 tempest-ProjectReaderTests-1377105507 None] Create snapshot completed successfully Sep 03 14:37:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-033c1d38-c234-404d-9254-f5202d574439 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-033c1d38-c234-404d-9254-f5202d574439 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:09 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-033c1d38-c234-404d-9254-f5202d574439 tempest-ProjectMemberTests-1350538287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:37:09 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-033c1d38-c234-404d-9254-f5202d574439 tempest-ProjectMemberTests-1350538287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:37:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-033c1d38-c234-404d-9254-f5202d574439 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-033c1d38-c234-404d-9254-f5202d574439 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:09 devstack sudo[107842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:37:09 devstack sudo[107842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:10 devstack sudo[107842]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-033c1d38-c234-404d-9254-f5202d574439 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.244s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:10 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-033c1d38-c234-404d-9254-f5202d574439 tempest-ProjectMemberTests-1350538287 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:37:10 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-033c1d38-c234-404d-9254-f5202d574439 tempest-ProjectMemberTests-1350538287 None] Deleted volume successfully. Sep 03 14:37:10 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-033c1d38-c234-404d-9254-f5202d574439 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-666dac4d-b97d-425a-8aed-3bd28a01894d-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:10 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-023d3118-a6c3-470a-945b-9f24addd1a90 tempest-ProjectMemberTests-1350538287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:37:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-023d3118-a6c3-470a-945b-9f24addd1a90 tempest-ProjectMemberTests-1350538287 None] Flow 'volume_create_manager' (e6d48b49-81e1-4a65-9a28-7926e5581dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:37:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-023d3118-a6c3-470a-945b-9f24addd1a90 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51d84776-5670-4a70-ab9f-e357270c51e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-023d3118-a6c3-470a-945b-9f24addd1a90 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51d84776-5670-4a70-ab9f-e357270c51e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1891895699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a413c0e8-096d-48d5-88b2-86a2600b2ff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bdc07719fdf40189d19adf3cf793220',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:37:10Z,use_quota=True,user_id='c0e0fc3b02a64f5b9b037ade3f94a724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-023d3118-a6c3-470a-945b-9f24addd1a90 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73d3a85f-dfc1-4fa2-a355-5ce4f9b672a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-023d3118-a6c3-470a-945b-9f24addd1a90 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73d3a85f-dfc1-4fa2-a355-5ce4f9b672a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-023d3118-a6c3-470a-945b-9f24addd1a90 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae0fd53c-f762-4433-a388-f248dbdebf2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-023d3118-a6c3-470a-945b-9f24addd1a90 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae0fd53c-f762-4433-a388-f248dbdebf2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a413c0e8-096d-48d5-88b2-86a2600b2ff7', 'volume_name': 'volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-023d3118-a6c3-470a-945b-9f24addd1a90 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3e998e5-cf1b-4930-9ce4-a0042378435e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-023d3118-a6c3-470a-945b-9f24addd1a90 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3e998e5-cf1b-4930-9ce4-a0042378435e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:10 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-023d3118-a6c3-470a-945b-9f24addd1a90 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29025e1d-2b53-49e6-adad-ba1f4716c526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:10 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-023d3118-a6c3-470a-945b-9f24addd1a90 tempest-ProjectMemberTests-1350538287 None] Volume a413c0e8-096d-48d5-88b2-86a2600b2ff7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7', 'volume_size': 1} Sep 03 14:37:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-023d3118-a6c3-470a-945b-9f24addd1a90 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-023d3118-a6c3-470a-945b-9f24addd1a90 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:10 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-023d3118-a6c3-470a-945b-9f24addd1a90 tempest-ProjectMemberTests-1350538287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1891895699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a413c0e8-096d-48d5-88b2-86a2600b2ff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bdc07719fdf40189d19adf3cf793220',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:37:10Z,use_quota=True,user_id='c0e0fc3b02a64f5b9b037ade3f94a724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:37:10 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-023d3118-a6c3-470a-945b-9f24addd1a90 tempest-ProjectMemberTests-1350538287 None] Creating volume a413c0e8-096d-48d5-88b2-86a2600b2ff7 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:37:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-023d3118-a6c3-470a-945b-9f24addd1a90 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-023d3118-a6c3-470a-945b-9f24addd1a90 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:10 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-023d3118-a6c3-470a-945b-9f24addd1a90 tempest-ProjectMemberTests-1350538287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:37:10 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-023d3118-a6c3-470a-945b-9f24addd1a90 tempest-ProjectMemberTests-1350538287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:37:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-023d3118-a6c3-470a-945b-9f24addd1a90 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:10 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-023d3118-a6c3-470a-945b-9f24addd1a90 tempest-ProjectMemberTests-1350538287 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:37:10 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-023d3118-a6c3-470a-945b-9f24addd1a90 tempest-ProjectMemberTests-1350538287 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:37:10 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-023d3118-a6c3-470a-945b-9f24addd1a90 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:10 devstack sudo[107845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7 1073741824 Sep 03 14:37:10 devstack sudo[107845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:10 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c25652e2-1852-483e-955d-39f898334e47 tempest-ProjectReaderTests-1377105507 None] Acquiring lock "cinder-cb298429-2318-4673-8929-26df125be6c7-delete_snapshot" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:10 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c25652e2-1852-483e-955d-39f898334e47 tempest-ProjectReaderTests-1377105507 None] Lock "cinder-cb298429-2318-4673-8929-26df125be6c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:10 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c25652e2-1852-483e-955d-39f898334e47 tempest-ProjectReaderTests-1377105507 None] Acquiring lock "cinder-quobyte-4230e81b-a055-4059-aa1f-b92d9530c063" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:10 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c25652e2-1852-483e-955d-39f898334e47 tempest-ProjectReaderTests-1377105507 None] Lock "cinder-quobyte-4230e81b-a055-4059-aa1f-b92d9530c063" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:10 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c25652e2-1852-483e-955d-39f898334e47 tempest-ProjectReaderTests-1377105507 None] Acquiring lock "cinder-quobyte-cb298429-2318-4673-8929-26df125be6c7" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:10 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c25652e2-1852-483e-955d-39f898334e47 tempest-ProjectReaderTests-1377105507 None] Lock "cinder-quobyte-cb298429-2318-4673-8929-26df125be6c7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:10 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-c25652e2-1852-483e-955d-39f898334e47 tempest-ProjectReaderTests-1377105507 None] Deleting offline snapshot cb298429-2318-4673-8929-26df125be6c7 of volume 4230e81b-a055-4059-aa1f-b92d9530c063 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:37:10 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-c25652e2-1852-483e-955d-39f898334e47 tempest-ProjectReaderTests-1377105507 None] snapshot_file for this snap is: volume-4230e81b-a055-4059-aa1f-b92d9530c063.cb298429-2318-4673-8929-26df125be6c7 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:37:10 devstack sudo[107845]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-023d3118-a6c3-470a-945b-9f24addd1a90 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7 1073741824" returned: 0 in 0.453s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:11 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4983852-a544-48df-8994-cf084e51225e]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:37:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c25652e2-1852-483e-955d-39f898334e47 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4230e81b-a055-4059-aa1f-b92d9530c063.cb298429-2318-4673-8929-26df125be6c7 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-023d3118-a6c3-470a-945b-9f24addd1a90 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:11 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7 Sep 03 14:37:11 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:11 devstack sudo[107853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4230e81b-a055-4059-aa1f-b92d9530c063.cb298429-2318-4673-8929-26df125be6c7 Sep 03 14:37:11 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:11 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-023d3118-a6c3-470a-945b-9f24addd1a90 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7" returned: 0 in 0.247s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:11 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-023d3118-a6c3-470a-945b-9f24addd1a90 tempest-ProjectMemberTests-1350538287 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:37:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-023d3118-a6c3-470a-945b-9f24addd1a90 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-023d3118-a6c3-470a-945b-9f24addd1a90 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29025e1d-2b53-49e6-adad-ba1f4716c526) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-023d3118-a6c3-470a-945b-9f24addd1a90 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (375c5293-d2ca-4796-b341-b658f808faa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:11 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-023d3118-a6c3-470a-945b-9f24addd1a90 tempest-ProjectMemberTests-1350538287 None] Volume volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7 (a413c0e8-096d-48d5-88b2-86a2600b2ff7): created successfully Sep 03 14:37:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-023d3118-a6c3-470a-945b-9f24addd1a90 tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (375c5293-d2ca-4796-b341-b658f808faa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:11 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-023d3118-a6c3-470a-945b-9f24addd1a90 tempest-ProjectMemberTests-1350538287 None] Flow 'volume_create_manager' (e6d48b49-81e1-4a65-9a28-7926e5581dd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:37:11 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-023d3118-a6c3-470a-945b-9f24addd1a90 tempest-ProjectMemberTests-1350538287 None] Created volume successfully. Sep 03 14:37:11 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c25652e2-1852-483e-955d-39f898334e47 tempest-ProjectReaderTests-1377105507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4230e81b-a055-4059-aa1f-b92d9530c063.cb298429-2318-4673-8929-26df125be6c7" returned: 0 in 0.390s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:11 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-c25652e2-1852-483e-955d-39f898334e47 tempest-ProjectReaderTests-1377105507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4230e81b-a055-4059-aa1f-b92d9530c063(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:37:11 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfba37b-ad7f-4e03-8bdf-3fda4515539b]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:37:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c25652e2-1852-483e-955d-39f898334e47 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4230e81b-a055-4059-aa1f-b92d9530c063 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:11 devstack sudo[107862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4230e81b-a055-4059-aa1f-b92d9530c063 Sep 03 14:37:11 devstack sudo[107862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-87588ed3-b59b-4d13-acb2-82207d6c0e5c tempest-ProjectMemberTests-1350538287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-87588ed3-b59b-4d13-acb2-82207d6c0e5c tempest-ProjectMemberTests-1350538287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:11 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-87588ed3-b59b-4d13-acb2-82207d6c0e5c tempest-ProjectMemberTests-1350538287 None] Creating offline snapshot 15ebf271-1b31-4065-928d-f6d58c5b1c6b of volume a413c0e8-096d-48d5-88b2-86a2600b2ff7 {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:37:11 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b102e1-3eb0-4f3c-904f-d56b007bdd8b]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:37:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-87588ed3-b59b-4d13-acb2-82207d6c0e5c tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:11 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7 Sep 03 14:37:11 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:11 devstack sudo[107862]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c25652e2-1852-483e-955d-39f898334e47 tempest-ProjectReaderTests-1377105507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4230e81b-a055-4059-aa1f-b92d9530c063" returned: 0 in 0.397s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:11 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c25652e2-1852-483e-955d-39f898334e47 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4230e81b-a055-4059-aa1f-b92d9530c063.cb298429-2318-4673-8929-26df125be6c7 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:11 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4230e81b-a055-4059-aa1f-b92d9530c063.cb298429-2318-4673-8929-26df125be6c7 Sep 03 14:37:11 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:12 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-87588ed3-b59b-4d13-acb2-82207d6c0e5c tempest-ProjectMemberTests-1350538287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7" returned: 0 in 0.378s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-87588ed3-b59b-4d13-acb2-82207d6c0e5c tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7.15ebf271-1b31-4065-928d-f6d58c5b1c6b 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:12 devstack sudo[107876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7.15ebf271-1b31-4065-928d-f6d58c5b1c6b 1G Sep 03 14:37:12 devstack sudo[107876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:12 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c25652e2-1852-483e-955d-39f898334e47 tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4230e81b-a055-4059-aa1f-b92d9530c063.cb298429-2318-4673-8929-26df125be6c7" returned: 0 in 0.369s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c25652e2-1852-483e-955d-39f898334e47 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4230e81b-a055-4059-aa1f-b92d9530c063.cb298429-2318-4673-8929-26df125be6c7 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:12 devstack sudo[107880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4230e81b-a055-4059-aa1f-b92d9530c063.cb298429-2318-4673-8929-26df125be6c7 Sep 03 14:37:12 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:12 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c25652e2-1852-483e-955d-39f898334e47 tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4230e81b-a055-4059-aa1f-b92d9530c063.cb298429-2318-4673-8929-26df125be6c7" returned: 0 in 0.251s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:12 devstack sudo[107876]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-87588ed3-b59b-4d13-acb2-82207d6c0e5c tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7.15ebf271-1b31-4065-928d-f6d58c5b1c6b 1G" returned: 0 in 0.407s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-87588ed3-b59b-4d13-acb2-82207d6c0e5c tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7.15ebf271-1b31-4065-928d-f6d58c5b1c6b {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:12 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c25652e2-1852-483e-955d-39f898334e47 tempest-ProjectReaderTests-1377105507 None] Lock "cinder-quobyte-cb298429-2318-4673-8929-26df125be6c7" released by "_delete_snapshot" :: held 1.512s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:12 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c25652e2-1852-483e-955d-39f898334e47 tempest-ProjectReaderTests-1377105507 None] Lock "cinder-quobyte-4230e81b-a055-4059-aa1f-b92d9530c063" released by "delete_snapshot" :: held 1.538s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:12 devstack sudo[107887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7.15ebf271-1b31-4065-928d-f6d58c5b1c6b Sep 03 14:37:12 devstack sudo[107887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:12 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-c25652e2-1852-483e-955d-39f898334e47 tempest-ProjectReaderTests-1377105507 None] Created reservations ['f2315afb-6990-4733-a75f-8501cb22a219', '120afdd7-9fa2-4d59-b54e-4124567afff1', '14431455-4573-49e9-b845-737e738feb5d', '18e2b01b-1053-40e9-9b7a-3b19a80f7c32'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:37:12 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-c25652e2-1852-483e-955d-39f898334e47 tempest-ProjectReaderTests-1377105507 None] Delete snapshot completed successfully. Sep 03 14:37:12 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-c25652e2-1852-483e-955d-39f898334e47 tempest-ProjectReaderTests-1377105507 None] Lock "cinder-cb298429-2318-4673-8929-26df125be6c7-delete_snapshot" released by "delete_snapshot" :: held 1.682s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:12 devstack sudo[107887]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-87588ed3-b59b-4d13-acb2-82207d6c0e5c tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7.15ebf271-1b31-4065-928d-f6d58c5b1c6b" returned: 0 in 0.287s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:12 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-87588ed3-b59b-4d13-acb2-82207d6c0e5c tempest-ProjectMemberTests-1350538287 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7.15ebf271-1b31-4065-928d-f6d58c5b1c6b is being set with open permissions: ugo+rw Sep 03 14:37:12 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-87588ed3-b59b-4d13-acb2-82207d6c0e5c tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7.15ebf271-1b31-4065-928d-f6d58c5b1c6b {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:12 devstack sudo[107892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7.15ebf271-1b31-4065-928d-f6d58c5b1c6b Sep 03 14:37:12 devstack sudo[107892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:13 devstack sudo[107892]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-87588ed3-b59b-4d13-acb2-82207d6c0e5c tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7.15ebf271-1b31-4065-928d-f6d58c5b1c6b" returned: 0 in 0.248s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-87588ed3-b59b-4d13-acb2-82207d6c0e5c tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:13 devstack sudo[107895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7.info Sep 03 14:37:13 devstack sudo[107895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:13 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-efe14a67-c634-469b-963f-5de655d9d0a8 tempest-ProjectReaderTests-1377105507 None] Acquiring lock "cinder-4230e81b-a055-4059-aa1f-b92d9530c063-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:13 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-efe14a67-c634-469b-963f-5de655d9d0a8 tempest-ProjectReaderTests-1377105507 None] Lock "cinder-4230e81b-a055-4059-aa1f-b92d9530c063-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:13 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-efe14a67-c634-469b-963f-5de655d9d0a8 tempest-ProjectReaderTests-1377105507 None] Acquiring lock "cinder-quobyte-4230e81b-a055-4059-aa1f-b92d9530c063" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:13 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-efe14a67-c634-469b-963f-5de655d9d0a8 tempest-ProjectReaderTests-1377105507 None] Lock "cinder-quobyte-4230e81b-a055-4059-aa1f-b92d9530c063" acquired by "delete_volume" :: waited 0.019s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:13 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[52115815-4cd6-4c3b-9b89-df5104973350]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:37:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-efe14a67-c634-469b-963f-5de655d9d0a8 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4230e81b-a055-4059-aa1f-b92d9530c063 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:13 devstack sudo[107895]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-87588ed3-b59b-4d13-acb2-82207d6c0e5c tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7.info" returned: 0 in 0.264s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:13 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-87588ed3-b59b-4d13-acb2-82207d6c0e5c tempest-ProjectMemberTests-1350538287 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7.info is being set with open permissions: ugo+rw Sep 03 14:37:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-87588ed3-b59b-4d13-acb2-82207d6c0e5c tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:13 devstack sudo[107897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4230e81b-a055-4059-aa1f-b92d9530c063 Sep 03 14:37:13 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:13 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7.info Sep 03 14:37:13 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:13 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-87588ed3-b59b-4d13-acb2-82207d6c0e5c tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7.info" returned: 0 in 0.267s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-87588ed3-b59b-4d13-acb2-82207d6c0e5c tempest-ProjectMemberTests-1350538287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.930s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:13 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-efe14a67-c634-469b-963f-5de655d9d0a8 tempest-ProjectReaderTests-1377105507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4230e81b-a055-4059-aa1f-b92d9530c063" returned: 0 in 0.408s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-efe14a67-c634-469b-963f-5de655d9d0a8 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4230e81b-a055-4059-aa1f-b92d9530c063 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:13 devstack sudo[107940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4230e81b-a055-4059-aa1f-b92d9530c063 Sep 03 14:37:13 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:13 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-87588ed3-b59b-4d13-acb2-82207d6c0e5c tempest-ProjectMemberTests-1350538287 None] Create snapshot completed successfully Sep 03 14:37:13 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-21e68b0a-22cd-4920-b7a2-4121187ea10f tempest-ProjectMemberTests-1350538287 None] Acquiring lock "cinder-15ebf271-1b31-4065-928d-f6d58c5b1c6b-delete_snapshot" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:13 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-21e68b0a-22cd-4920-b7a2-4121187ea10f tempest-ProjectMemberTests-1350538287 None] Lock "cinder-15ebf271-1b31-4065-928d-f6d58c5b1c6b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:13 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-21e68b0a-22cd-4920-b7a2-4121187ea10f tempest-ProjectMemberTests-1350538287 None] Acquiring lock "cinder-quobyte-a413c0e8-096d-48d5-88b2-86a2600b2ff7" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:13 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-21e68b0a-22cd-4920-b7a2-4121187ea10f tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-a413c0e8-096d-48d5-88b2-86a2600b2ff7" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:13 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-21e68b0a-22cd-4920-b7a2-4121187ea10f tempest-ProjectMemberTests-1350538287 None] Acquiring lock "cinder-quobyte-15ebf271-1b31-4065-928d-f6d58c5b1c6b" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:13 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-efe14a67-c634-469b-963f-5de655d9d0a8 tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4230e81b-a055-4059-aa1f-b92d9530c063" returned: 0 in 0.281s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:13 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-21e68b0a-22cd-4920-b7a2-4121187ea10f tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-15ebf271-1b31-4065-928d-f6d58c5b1c6b" acquired by "_delete_snapshot" :: waited 0.074s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:13 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-21e68b0a-22cd-4920-b7a2-4121187ea10f tempest-ProjectMemberTests-1350538287 None] Deleting offline snapshot 15ebf271-1b31-4065-928d-f6d58c5b1c6b of volume a413c0e8-096d-48d5-88b2-86a2600b2ff7 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:37:13 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-21e68b0a-22cd-4920-b7a2-4121187ea10f tempest-ProjectMemberTests-1350538287 None] snapshot_file for this snap is: volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7.15ebf271-1b31-4065-928d-f6d58c5b1c6b {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:37:13 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-efe14a67-c634-469b-963f-5de655d9d0a8 tempest-ProjectReaderTests-1377105507 None] Lock "cinder-quobyte-4230e81b-a055-4059-aa1f-b92d9530c063" released by "delete_volume" :: held 0.773s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:13 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a93ac9-630e-4e4a-8211-3f2066994b2d]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:37:13 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-21e68b0a-22cd-4920-b7a2-4121187ea10f tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7.15ebf271-1b31-4065-928d-f6d58c5b1c6b {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:13 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-efe14a67-c634-469b-963f-5de655d9d0a8 tempest-ProjectReaderTests-1377105507 None] Created reservations ['d66c1719-0256-427c-82db-f2dad7d0e82a', '8430796f-f8c5-4e64-98b9-7cd06db8f344', '15c3eec7-b8c1-4a5c-b34f-8902e226c5a2', '9a3f1bbd-88a8-4787-8eeb-eba38121de01'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:37:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-efe14a67-c634-469b-963f-5de655d9d0a8 tempest-ProjectReaderTests-1377105507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-efe14a67-c634-469b-963f-5de655d9d0a8 tempest-ProjectReaderTests-1377105507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-efe14a67-c634-469b-963f-5de655d9d0a8 tempest-ProjectReaderTests-1377105507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:37:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-efe14a67-c634-469b-963f-5de655d9d0a8 tempest-ProjectReaderTests-1377105507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:37:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-efe14a67-c634-469b-963f-5de655d9d0a8 tempest-ProjectReaderTests-1377105507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-efe14a67-c634-469b-963f-5de655d9d0a8 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:14 devstack sudo[107945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7.15ebf271-1b31-4065-928d-f6d58c5b1c6b Sep 03 14:37:14 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:14 devstack sudo[107947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:37:14 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:14 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-efe14a67-c634-469b-963f-5de655d9d0a8 tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.256s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:14 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-efe14a67-c634-469b-963f-5de655d9d0a8 tempest-ProjectReaderTests-1377105507 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:37:14 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-efe14a67-c634-469b-963f-5de655d9d0a8 tempest-ProjectReaderTests-1377105507 None] Deleted volume successfully. Sep 03 14:37:14 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-21e68b0a-22cd-4920-b7a2-4121187ea10f tempest-ProjectMemberTests-1350538287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7.15ebf271-1b31-4065-928d-f6d58c5b1c6b" returned: 0 in 0.401s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-21e68b0a-22cd-4920-b7a2-4121187ea10f tempest-ProjectMemberTests-1350538287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:37:14 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-efe14a67-c634-469b-963f-5de655d9d0a8 tempest-ProjectReaderTests-1377105507 None] Lock "cinder-4230e81b-a055-4059-aa1f-b92d9530c063-delete_volume" released by "delete_volume" :: held 1.262s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:14 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ed5a26-829b-40d9-9ff8-406883fd4821]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:37:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-21e68b0a-22cd-4920-b7a2-4121187ea10f tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:14 devstack sudo[107953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7 Sep 03 14:37:14 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:14 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdb3dba2-9bdf-44de-8206-36059a9dff1d tempest-ProjectReaderTests-1377105507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:37:14 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fdb3dba2-9bdf-44de-8206-36059a9dff1d tempest-ProjectReaderTests-1377105507 None] Flow 'volume_create_manager' (7243f70b-b2c5-4297-9e94-8752a189c7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:37:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fdb3dba2-9bdf-44de-8206-36059a9dff1d tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (828bcf94-850b-46f6-b416-b014e2e3ec99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-21e68b0a-22cd-4920-b7a2-4121187ea10f tempest-ProjectMemberTests-1350538287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7" returned: 0 in 0.403s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-21e68b0a-22cd-4920-b7a2-4121187ea10f tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7.15ebf271-1b31-4065-928d-f6d58c5b1c6b {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:14 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7.15ebf271-1b31-4065-928d-f6d58c5b1c6b Sep 03 14:37:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fdb3dba2-9bdf-44de-8206-36059a9dff1d tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (828bcf94-850b-46f6-b416-b014e2e3ec99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1927485765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f497dd53-d5c0-4e2c-b2ec-0ec30c07760b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c292af184774cb8a8630b73867fc4c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:37:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:37:15Z,use_quota=True,user_id='61387dc863c743a9af4844c7b603de31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:14 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fdb3dba2-9bdf-44de-8206-36059a9dff1d tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a06834a-9ef9-4e51-9bcf-bb505136477a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fdb3dba2-9bdf-44de-8206-36059a9dff1d tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a06834a-9ef9-4e51-9bcf-bb505136477a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fdb3dba2-9bdf-44de-8206-36059a9dff1d tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea56d7a5-d059-46cd-84e8-2b6a9562f30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fdb3dba2-9bdf-44de-8206-36059a9dff1d tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea56d7a5-d059-46cd-84e8-2b6a9562f30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f497dd53-d5c0-4e2c-b2ec-0ec30c07760b', 'volume_name': 'volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fdb3dba2-9bdf-44de-8206-36059a9dff1d tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c3dec43-8b67-4721-9a26-375e131d0a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fdb3dba2-9bdf-44de-8206-36059a9dff1d tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c3dec43-8b67-4721-9a26-375e131d0a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:14 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fdb3dba2-9bdf-44de-8206-36059a9dff1d tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c38f3937-4dc7-47b0-a6a1-a9ee3b3347b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:14 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-fdb3dba2-9bdf-44de-8206-36059a9dff1d tempest-ProjectReaderTests-1377105507 None] Volume f497dd53-d5c0-4e2c-b2ec-0ec30c07760b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b', 'volume_size': 1} Sep 03 14:37:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-fdb3dba2-9bdf-44de-8206-36059a9dff1d tempest-ProjectReaderTests-1377105507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-fdb3dba2-9bdf-44de-8206-36059a9dff1d tempest-ProjectReaderTests-1377105507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-fdb3dba2-9bdf-44de-8206-36059a9dff1d tempest-ProjectReaderTests-1377105507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1927485765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f497dd53-d5c0-4e2c-b2ec-0ec30c07760b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c292af184774cb8a8630b73867fc4c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:37:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:37:15Z,use_quota=True,user_id='61387dc863c743a9af4844c7b603de31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:37:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-fdb3dba2-9bdf-44de-8206-36059a9dff1d tempest-ProjectReaderTests-1377105507 None] Creating volume f497dd53-d5c0-4e2c-b2ec-0ec30c07760b {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:37:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-fdb3dba2-9bdf-44de-8206-36059a9dff1d tempest-ProjectReaderTests-1377105507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-fdb3dba2-9bdf-44de-8206-36059a9dff1d tempest-ProjectReaderTests-1377105507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-fdb3dba2-9bdf-44de-8206-36059a9dff1d tempest-ProjectReaderTests-1377105507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:37:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-fdb3dba2-9bdf-44de-8206-36059a9dff1d tempest-ProjectReaderTests-1377105507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:37:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-fdb3dba2-9bdf-44de-8206-36059a9dff1d tempest-ProjectReaderTests-1377105507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:14 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-fdb3dba2-9bdf-44de-8206-36059a9dff1d tempest-ProjectReaderTests-1377105507 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:37:14 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-fdb3dba2-9bdf-44de-8206-36059a9dff1d tempest-ProjectReaderTests-1377105507 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:37:14 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fdb3dba2-9bdf-44de-8206-36059a9dff1d tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:14 devstack sudo[107960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b 1073741824 Sep 03 14:37:14 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:15 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-21e68b0a-22cd-4920-b7a2-4121187ea10f tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7.15ebf271-1b31-4065-928d-f6d58c5b1c6b" returned: 0 in 0.358s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-21e68b0a-22cd-4920-b7a2-4121187ea10f tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7.15ebf271-1b31-4065-928d-f6d58c5b1c6b {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:15 devstack sudo[107968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7.15ebf271-1b31-4065-928d-f6d58c5b1c6b Sep 03 14:37:15 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:15 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fdb3dba2-9bdf-44de-8206-36059a9dff1d tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b 1073741824" returned: 0 in 0.438s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fdb3dba2-9bdf-44de-8206-36059a9dff1d tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:15 devstack sudo[107971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b Sep 03 14:37:15 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:15 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-21e68b0a-22cd-4920-b7a2-4121187ea10f tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7.15ebf271-1b31-4065-928d-f6d58c5b1c6b" returned: 0 in 0.287s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:15 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-21e68b0a-22cd-4920-b7a2-4121187ea10f tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-15ebf271-1b31-4065-928d-f6d58c5b1c6b" released by "_delete_snapshot" :: held 1.547s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:15 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-21e68b0a-22cd-4920-b7a2-4121187ea10f tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-a413c0e8-096d-48d5-88b2-86a2600b2ff7" released by "delete_snapshot" :: held 1.629s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:15 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-21e68b0a-22cd-4920-b7a2-4121187ea10f tempest-ProjectMemberTests-1350538287 None] Created reservations ['51ddb549-9e2b-4741-a37c-f24a4838db88', '1b8d6d74-188f-40d2-b2fd-291642a1dfa0', 'b7305271-f581-4258-bddf-42edeb1f5553', '9155351a-5c49-42b5-8aa8-bd89a9f25617'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:37:15 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-21e68b0a-22cd-4920-b7a2-4121187ea10f tempest-ProjectMemberTests-1350538287 None] Delete snapshot completed successfully. Sep 03 14:37:15 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-21e68b0a-22cd-4920-b7a2-4121187ea10f tempest-ProjectMemberTests-1350538287 None] Lock "cinder-15ebf271-1b31-4065-928d-f6d58c5b1c6b-delete_snapshot" released by "delete_snapshot" :: held 1.764s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:15 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fdb3dba2-9bdf-44de-8206-36059a9dff1d tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b" returned: 0 in 0.279s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:15 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-fdb3dba2-9bdf-44de-8206-36059a9dff1d tempest-ProjectReaderTests-1377105507 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:37:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-fdb3dba2-9bdf-44de-8206-36059a9dff1d tempest-ProjectReaderTests-1377105507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:15 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fdb3dba2-9bdf-44de-8206-36059a9dff1d tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c38f3937-4dc7-47b0-a6a1-a9ee3b3347b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:15 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fdb3dba2-9bdf-44de-8206-36059a9dff1d tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42814ad3-7b8a-410e-b825-726f3ac1adca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:15 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-fdb3dba2-9bdf-44de-8206-36059a9dff1d tempest-ProjectReaderTests-1377105507 None] Volume volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b (f497dd53-d5c0-4e2c-b2ec-0ec30c07760b): created successfully Sep 03 14:37:15 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fdb3dba2-9bdf-44de-8206-36059a9dff1d tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42814ad3-7b8a-410e-b825-726f3ac1adca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:15 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fdb3dba2-9bdf-44de-8206-36059a9dff1d tempest-ProjectReaderTests-1377105507 None] Flow 'volume_create_manager' (7243f70b-b2c5-4297-9e94-8752a189c7da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:37:15 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-fdb3dba2-9bdf-44de-8206-36059a9dff1d tempest-ProjectReaderTests-1377105507 None] Created volume successfully. Sep 03 14:37:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c7602595-1bed-4f1e-a781-3f3aae55d12b tempest-ProjectReaderTests-1377105507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c7602595-1bed-4f1e-a781-3f3aae55d12b tempest-ProjectReaderTests-1377105507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:15 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-c7602595-1bed-4f1e-a781-3f3aae55d12b tempest-ProjectReaderTests-1377105507 None] Creating offline snapshot 9fac7441-9c18-492b-88fd-7272497994bf of volume f497dd53-d5c0-4e2c-b2ec-0ec30c07760b {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:37:15 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a12a267-5d96-4b1e-8475-2910a2026a72]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:37:15 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c7602595-1bed-4f1e-a781-3f3aae55d12b tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:15 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-cb44b956-e2d3-4bad-a842-3214ff19b979 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "cinder-a413c0e8-096d-48d5-88b2-86a2600b2ff7-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:15 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-cb44b956-e2d3-4bad-a842-3214ff19b979 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-a413c0e8-096d-48d5-88b2-86a2600b2ff7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:16 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-cb44b956-e2d3-4bad-a842-3214ff19b979 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "cinder-quobyte-a413c0e8-096d-48d5-88b2-86a2600b2ff7" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:16 devstack sudo[107975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b Sep 03 14:37:16 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:16 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-cb44b956-e2d3-4bad-a842-3214ff19b979 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-a413c0e8-096d-48d5-88b2-86a2600b2ff7" acquired by "delete_volume" :: waited 0.017s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:16 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9887d9da-6949-462a-bdfe-7bf1c30d5943]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:37:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-cb44b956-e2d3-4bad-a842-3214ff19b979 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:16 devstack sudo[107977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7 Sep 03 14:37:16 devstack sudo[107977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:16 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c7602595-1bed-4f1e-a781-3f3aae55d12b tempest-ProjectReaderTests-1377105507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b" returned: 0 in 0.368s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c7602595-1bed-4f1e-a781-3f3aae55d12b tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b.9fac7441-9c18-492b-88fd-7272497994bf 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:16 devstack sudo[107982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b.9fac7441-9c18-492b-88fd-7272497994bf 1G Sep 03 14:37:16 devstack sudo[107982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:16 devstack sudo[107977]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-cb44b956-e2d3-4bad-a842-3214ff19b979 tempest-ProjectMemberTests-1350538287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7" returned: 0 in 0.363s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-cb44b956-e2d3-4bad-a842-3214ff19b979 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:16 devstack sudo[107987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7 Sep 03 14:37:16 devstack sudo[107987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:16 devstack sudo[107987]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-cb44b956-e2d3-4bad-a842-3214ff19b979 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-a413c0e8-096d-48d5-88b2-86a2600b2ff7" returned: 0 in 0.259s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:16 devstack sudo[107982]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c7602595-1bed-4f1e-a781-3f3aae55d12b tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b.9fac7441-9c18-492b-88fd-7272497994bf 1G" returned: 0 in 0.436s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c7602595-1bed-4f1e-a781-3f3aae55d12b tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b.9fac7441-9c18-492b-88fd-7272497994bf {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:16 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-cb44b956-e2d3-4bad-a842-3214ff19b979 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-a413c0e8-096d-48d5-88b2-86a2600b2ff7" released by "delete_volume" :: held 0.704s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:16 devstack sudo[107994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b.9fac7441-9c18-492b-88fd-7272497994bf Sep 03 14:37:16 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:16 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-cb44b956-e2d3-4bad-a842-3214ff19b979 tempest-ProjectMemberTests-1350538287 None] Created reservations ['c93828bb-694e-4adb-8fb6-b2ac4c9b6df9', 'fcfd190d-3172-4ebf-bb4d-c568590bafcd', 'ae7ff118-2261-4d2c-802f-7d51509929c4', '7780fada-bc12-4fa3-a4f5-7c63195306f4'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:37:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-cb44b956-e2d3-4bad-a842-3214ff19b979 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-cb44b956-e2d3-4bad-a842-3214ff19b979 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:16 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-cb44b956-e2d3-4bad-a842-3214ff19b979 tempest-ProjectMemberTests-1350538287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:37:16 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-cb44b956-e2d3-4bad-a842-3214ff19b979 tempest-ProjectMemberTests-1350538287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:37:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-cb44b956-e2d3-4bad-a842-3214ff19b979 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:16 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-cb44b956-e2d3-4bad-a842-3214ff19b979 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:16 devstack sudo[107996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:37:16 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:17 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c7602595-1bed-4f1e-a781-3f3aae55d12b tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b.9fac7441-9c18-492b-88fd-7272497994bf" returned: 0 in 0.288s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:17 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-c7602595-1bed-4f1e-a781-3f3aae55d12b tempest-ProjectReaderTests-1377105507 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b.9fac7441-9c18-492b-88fd-7272497994bf is being set with open permissions: ugo+rw Sep 03 14:37:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c7602595-1bed-4f1e-a781-3f3aae55d12b tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b.9fac7441-9c18-492b-88fd-7272497994bf {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:17 devstack sudo[108001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b.9fac7441-9c18-492b-88fd-7272497994bf Sep 03 14:37:17 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:17 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-cb44b956-e2d3-4bad-a842-3214ff19b979 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.274s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:17 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-cb44b956-e2d3-4bad-a842-3214ff19b979 tempest-ProjectMemberTests-1350538287 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:37:17 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-cb44b956-e2d3-4bad-a842-3214ff19b979 tempest-ProjectMemberTests-1350538287 None] Deleted volume successfully. Sep 03 14:37:17 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-cb44b956-e2d3-4bad-a842-3214ff19b979 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-a413c0e8-096d-48d5-88b2-86a2600b2ff7-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:17 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c7602595-1bed-4f1e-a781-3f3aae55d12b tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b.9fac7441-9c18-492b-88fd-7272497994bf" returned: 0 in 0.265s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c7602595-1bed-4f1e-a781-3f3aae55d12b tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:17 devstack sudo[108005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b.info Sep 03 14:37:17 devstack sudo[108005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:17 devstack sudo[108005]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c7602595-1bed-4f1e-a781-3f3aae55d12b tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b.info" returned: 0 in 0.265s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:17 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-c7602595-1bed-4f1e-a781-3f3aae55d12b tempest-ProjectReaderTests-1377105507 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b.info is being set with open permissions: ugo+rw Sep 03 14:37:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c7602595-1bed-4f1e-a781-3f3aae55d12b tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:17 devstack sudo[108008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b.info Sep 03 14:37:17 devstack sudo[108008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:17 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9f56ea3-550d-421b-92db-d0462b43a86c tempest-ProjectMemberTests-1350538287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:37:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a9f56ea3-550d-421b-92db-d0462b43a86c tempest-ProjectMemberTests-1350538287 None] Flow 'volume_create_manager' (c75e8a2a-b9f9-40f9-b5c1-26bc589c9405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:37:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a9f56ea3-550d-421b-92db-d0462b43a86c tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f1649f6-04ec-423d-9871-3d52ce9da711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a9f56ea3-550d-421b-92db-d0462b43a86c tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f1649f6-04ec-423d-9871-3d52ce9da711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1346230715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e3d84b3-9196-4775-ba6b-cc5fb49a433d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bdc07719fdf40189d19adf3cf793220',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:37:18Z,use_quota=True,user_id='c0e0fc3b02a64f5b9b037ade3f94a724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a9f56ea3-550d-421b-92db-d0462b43a86c tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5646333c-eb9d-4ed3-a98d-74547e0a1943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a9f56ea3-550d-421b-92db-d0462b43a86c tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5646333c-eb9d-4ed3-a98d-74547e0a1943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a9f56ea3-550d-421b-92db-d0462b43a86c tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (571f3f02-1d5e-4d0c-b42a-6ba9b63c6471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a9f56ea3-550d-421b-92db-d0462b43a86c tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (571f3f02-1d5e-4d0c-b42a-6ba9b63c6471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e3d84b3-9196-4775-ba6b-cc5fb49a433d', 'volume_name': 'volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a9f56ea3-550d-421b-92db-d0462b43a86c tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd30a7b7-3d4e-4dd7-a05d-6223c988ac30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a9f56ea3-550d-421b-92db-d0462b43a86c tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd30a7b7-3d4e-4dd7-a05d-6223c988ac30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:17 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a9f56ea3-550d-421b-92db-d0462b43a86c tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6779ad62-b011-4a22-89e0-7ae043dff749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:17 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-a9f56ea3-550d-421b-92db-d0462b43a86c tempest-ProjectMemberTests-1350538287 None] Volume 1e3d84b3-9196-4775-ba6b-cc5fb49a433d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d', 'volume_size': 1} Sep 03 14:37:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a9f56ea3-550d-421b-92db-d0462b43a86c tempest-ProjectMemberTests-1350538287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:17 devstack sudo[108008]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-c7602595-1bed-4f1e-a781-3f3aae55d12b tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b.info" returned: 0 in 0.236s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-c7602595-1bed-4f1e-a781-3f3aae55d12b tempest-ProjectReaderTests-1377105507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.935s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a9f56ea3-550d-421b-92db-d0462b43a86c tempest-ProjectMemberTests-1350538287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.116s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:17 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a9f56ea3-550d-421b-92db-d0462b43a86c tempest-ProjectMemberTests-1350538287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1346230715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e3d84b3-9196-4775-ba6b-cc5fb49a433d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bdc07719fdf40189d19adf3cf793220',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:37:18Z,use_quota=True,user_id='c0e0fc3b02a64f5b9b037ade3f94a724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:37:17 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-a9f56ea3-550d-421b-92db-d0462b43a86c tempest-ProjectMemberTests-1350538287 None] Creating volume 1e3d84b3-9196-4775-ba6b-cc5fb49a433d {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:37:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a9f56ea3-550d-421b-92db-d0462b43a86c tempest-ProjectMemberTests-1350538287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a9f56ea3-550d-421b-92db-d0462b43a86c tempest-ProjectMemberTests-1350538287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:17 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a9f56ea3-550d-421b-92db-d0462b43a86c tempest-ProjectMemberTests-1350538287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:37:17 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a9f56ea3-550d-421b-92db-d0462b43a86c tempest-ProjectMemberTests-1350538287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:37:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a9f56ea3-550d-421b-92db-d0462b43a86c tempest-ProjectMemberTests-1350538287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:17 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a9f56ea3-550d-421b-92db-d0462b43a86c tempest-ProjectMemberTests-1350538287 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:37:17 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-a9f56ea3-550d-421b-92db-d0462b43a86c tempest-ProjectMemberTests-1350538287 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:37:17 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a9f56ea3-550d-421b-92db-d0462b43a86c tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:17 devstack sudo[108011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d 1073741824 Sep 03 14:37:17 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:17 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-c7602595-1bed-4f1e-a781-3f3aae55d12b tempest-ProjectReaderTests-1377105507 None] Create snapshot completed successfully Sep 03 14:37:18 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d33b27f7-1423-4fbf-9641-5f50f9aa62f1 tempest-ProjectReaderTests-1377105507 None] Acquiring lock "cinder-9fac7441-9c18-492b-88fd-7272497994bf-delete_snapshot" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:18 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d33b27f7-1423-4fbf-9641-5f50f9aa62f1 tempest-ProjectReaderTests-1377105507 None] Lock "cinder-9fac7441-9c18-492b-88fd-7272497994bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:18 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d33b27f7-1423-4fbf-9641-5f50f9aa62f1 tempest-ProjectReaderTests-1377105507 None] Acquiring lock "cinder-quobyte-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:18 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d33b27f7-1423-4fbf-9641-5f50f9aa62f1 tempest-ProjectReaderTests-1377105507 None] Lock "cinder-quobyte-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:18 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d33b27f7-1423-4fbf-9641-5f50f9aa62f1 tempest-ProjectReaderTests-1377105507 None] Acquiring lock "cinder-quobyte-9fac7441-9c18-492b-88fd-7272497994bf" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:18 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d33b27f7-1423-4fbf-9641-5f50f9aa62f1 tempest-ProjectReaderTests-1377105507 None] Lock "cinder-quobyte-9fac7441-9c18-492b-88fd-7272497994bf" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:18 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-d33b27f7-1423-4fbf-9641-5f50f9aa62f1 tempest-ProjectReaderTests-1377105507 None] Deleting offline snapshot 9fac7441-9c18-492b-88fd-7272497994bf of volume f497dd53-d5c0-4e2c-b2ec-0ec30c07760b {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:37:18 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-d33b27f7-1423-4fbf-9641-5f50f9aa62f1 tempest-ProjectReaderTests-1377105507 None] snapshot_file for this snap is: volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b.9fac7441-9c18-492b-88fd-7272497994bf {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:37:18 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8097776d-c282-4fcf-86d5-0e4c0e546b38]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:37:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d33b27f7-1423-4fbf-9641-5f50f9aa62f1 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b.9fac7441-9c18-492b-88fd-7272497994bf {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:18 devstack sudo[108016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b.9fac7441-9c18-492b-88fd-7272497994bf Sep 03 14:37:18 devstack sudo[108016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:18 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a9f56ea3-550d-421b-92db-d0462b43a86c tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d 1073741824" returned: 0 in 0.451s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a9f56ea3-550d-421b-92db-d0462b43a86c tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:18 devstack sudo[108018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d Sep 03 14:37:18 devstack sudo[108018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:18 devstack sudo[108016]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d33b27f7-1423-4fbf-9641-5f50f9aa62f1 tempest-ProjectReaderTests-1377105507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b.9fac7441-9c18-492b-88fd-7272497994bf" returned: 0 in 0.381s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:18 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-d33b27f7-1423-4fbf-9641-5f50f9aa62f1 tempest-ProjectReaderTests-1377105507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:37:18 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ad797b-21c0-4f7f-9fa2-33726e08a189]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:37:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d33b27f7-1423-4fbf-9641-5f50f9aa62f1 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:18 devstack sudo[108018]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-a9f56ea3-550d-421b-92db-d0462b43a86c tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d" returned: 0 in 0.269s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:18 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-a9f56ea3-550d-421b-92db-d0462b43a86c tempest-ProjectMemberTests-1350538287 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:37:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-a9f56ea3-550d-421b-92db-d0462b43a86c tempest-ProjectMemberTests-1350538287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:18 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a9f56ea3-550d-421b-92db-d0462b43a86c tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6779ad62-b011-4a22-89e0-7ae043dff749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:18 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a9f56ea3-550d-421b-92db-d0462b43a86c tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b03d2a8-6e54-432f-b712-5d75aa4da3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:18 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-a9f56ea3-550d-421b-92db-d0462b43a86c tempest-ProjectMemberTests-1350538287 None] Volume volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d (1e3d84b3-9196-4775-ba6b-cc5fb49a433d): created successfully Sep 03 14:37:18 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a9f56ea3-550d-421b-92db-d0462b43a86c tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b03d2a8-6e54-432f-b712-5d75aa4da3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:18 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-a9f56ea3-550d-421b-92db-d0462b43a86c tempest-ProjectMemberTests-1350538287 None] Flow 'volume_create_manager' (c75e8a2a-b9f9-40f9-b5c1-26bc589c9405) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:37:18 devstack sudo[108023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b Sep 03 14:37:18 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:18 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-a9f56ea3-550d-421b-92db-d0462b43a86c tempest-ProjectMemberTests-1350538287 None] Created volume successfully. Sep 03 14:37:18 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d33b27f7-1423-4fbf-9641-5f50f9aa62f1 tempest-ProjectReaderTests-1377105507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b" returned: 0 in 0.355s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:18 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d33b27f7-1423-4fbf-9641-5f50f9aa62f1 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b.9fac7441-9c18-492b-88fd-7272497994bf {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:18 devstack sudo[108029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b.9fac7441-9c18-492b-88fd-7272497994bf Sep 03 14:37:18 devstack sudo[108029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:19 devstack sudo[108029]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d33b27f7-1423-4fbf-9641-5f50f9aa62f1 tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b.9fac7441-9c18-492b-88fd-7272497994bf" returned: 0 in 0.321s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d33b27f7-1423-4fbf-9641-5f50f9aa62f1 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b.9fac7441-9c18-492b-88fd-7272497994bf {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:19 devstack sudo[108034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b.9fac7441-9c18-492b-88fd-7272497994bf Sep 03 14:37:19 devstack sudo[108034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:19 devstack sudo[108034]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d33b27f7-1423-4fbf-9641-5f50f9aa62f1 tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b.9fac7441-9c18-492b-88fd-7272497994bf" returned: 0 in 0.250s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:19 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d33b27f7-1423-4fbf-9641-5f50f9aa62f1 tempest-ProjectReaderTests-1377105507 None] Lock "cinder-quobyte-9fac7441-9c18-492b-88fd-7272497994bf" released by "_delete_snapshot" :: held 1.411s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:19 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d33b27f7-1423-4fbf-9641-5f50f9aa62f1 tempest-ProjectReaderTests-1377105507 None] Lock "cinder-quobyte-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b" released by "delete_snapshot" :: held 1.438s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:19 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-d33b27f7-1423-4fbf-9641-5f50f9aa62f1 tempest-ProjectReaderTests-1377105507 None] Created reservations ['e5beda50-7c57-4234-8103-4eda1cb5578f', 'aa73754c-5008-4871-84af-cdd1b8a7f307', 'fe2ff460-c8ba-42a8-a39f-7236ad1e4a52', '26ed0426-5f71-4c4f-8ff2-c62bbc07e176'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:37:19 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-d33b27f7-1423-4fbf-9641-5f50f9aa62f1 tempest-ProjectReaderTests-1377105507 None] Delete snapshot completed successfully. Sep 03 14:37:19 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d33b27f7-1423-4fbf-9641-5f50f9aa62f1 tempest-ProjectReaderTests-1377105507 None] Lock "cinder-9fac7441-9c18-492b-88fd-7272497994bf-delete_snapshot" released by "delete_snapshot" :: held 1.568s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-183dccf9-0a06-41b0-bd17-7fc562c62c6a tempest-ProjectMemberTests-1350538287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-183dccf9-0a06-41b0-bd17-7fc562c62c6a tempest-ProjectMemberTests-1350538287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:19 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-183dccf9-0a06-41b0-bd17-7fc562c62c6a tempest-ProjectMemberTests-1350538287 None] Creating offline snapshot a30f9241-375e-46e0-95a0-80e944a49c51 of volume 1e3d84b3-9196-4775-ba6b-cc5fb49a433d {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:37:19 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8254926-5bd3-44da-8bdb-624f222a10ac]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:37:19 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-183dccf9-0a06-41b0-bd17-7fc562c62c6a tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:19 devstack sudo[108037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d Sep 03 14:37:19 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:20 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-36ff5851-0cfa-4b8a-9adf-e503eed75491 tempest-ProjectReaderTests-1377105507 None] Acquiring lock "cinder-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:20 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-36ff5851-0cfa-4b8a-9adf-e503eed75491 tempest-ProjectReaderTests-1377105507 None] Lock "cinder-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:20 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-183dccf9-0a06-41b0-bd17-7fc562c62c6a tempest-ProjectMemberTests-1350538287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d" returned: 0 in 0.381s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-183dccf9-0a06-41b0-bd17-7fc562c62c6a tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d.a30f9241-375e-46e0-95a0-80e944a49c51 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:20 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-36ff5851-0cfa-4b8a-9adf-e503eed75491 tempest-ProjectReaderTests-1377105507 None] Acquiring lock "cinder-quobyte-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:20 devstack sudo[108043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d.a30f9241-375e-46e0-95a0-80e944a49c51 1G Sep 03 14:37:20 devstack sudo[108043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:20 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-36ff5851-0cfa-4b8a-9adf-e503eed75491 tempest-ProjectReaderTests-1377105507 None] Lock "cinder-quobyte-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b" acquired by "delete_volume" :: waited 0.017s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:20 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc61245-4a79-47e7-b260-375dd5c4c4f3]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:37:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-36ff5851-0cfa-4b8a-9adf-e503eed75491 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:20 devstack sudo[108045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b Sep 03 14:37:20 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:20 devstack sudo[108043]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-183dccf9-0a06-41b0-bd17-7fc562c62c6a tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d.a30f9241-375e-46e0-95a0-80e944a49c51 1G" returned: 0 in 0.397s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-183dccf9-0a06-41b0-bd17-7fc562c62c6a tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d.a30f9241-375e-46e0-95a0-80e944a49c51 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:20 devstack sudo[108053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d.a30f9241-375e-46e0-95a0-80e944a49c51 Sep 03 14:37:20 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:20 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-36ff5851-0cfa-4b8a-9adf-e503eed75491 tempest-ProjectReaderTests-1377105507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b" returned: 0 in 0.368s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-36ff5851-0cfa-4b8a-9adf-e503eed75491 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:20 devstack sudo[108055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b Sep 03 14:37:20 devstack sudo[108055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:20 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:20 devstack sudo[108055]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-183dccf9-0a06-41b0-bd17-7fc562c62c6a tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d.a30f9241-375e-46e0-95a0-80e944a49c51" returned: 0 in 0.306s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:20 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-183dccf9-0a06-41b0-bd17-7fc562c62c6a tempest-ProjectMemberTests-1350538287 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d.a30f9241-375e-46e0-95a0-80e944a49c51 is being set with open permissions: ugo+rw Sep 03 14:37:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-183dccf9-0a06-41b0-bd17-7fc562c62c6a tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d.a30f9241-375e-46e0-95a0-80e944a49c51 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:20 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-36ff5851-0cfa-4b8a-9adf-e503eed75491 tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b" returned: 0 in 0.263s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:20 devstack sudo[108061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d.a30f9241-375e-46e0-95a0-80e944a49c51 Sep 03 14:37:20 devstack sudo[108061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:20 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-36ff5851-0cfa-4b8a-9adf-e503eed75491 tempest-ProjectReaderTests-1377105507 None] Lock "cinder-quobyte-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b" released by "delete_volume" :: held 0.688s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:21 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-36ff5851-0cfa-4b8a-9adf-e503eed75491 tempest-ProjectReaderTests-1377105507 None] Created reservations ['d52f230f-d14a-42b0-a1e9-630334c6260a', '0134d94b-a5c9-41f3-8da4-8d7a1cb7cea7', '640645dd-650e-4290-a9b9-f4e2b9e50440', '0a65fb88-c100-4e8a-8d9a-9dcb6574578c'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:37:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-36ff5851-0cfa-4b8a-9adf-e503eed75491 tempest-ProjectReaderTests-1377105507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-36ff5851-0cfa-4b8a-9adf-e503eed75491 tempest-ProjectReaderTests-1377105507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:21 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-36ff5851-0cfa-4b8a-9adf-e503eed75491 tempest-ProjectReaderTests-1377105507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:37:21 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-36ff5851-0cfa-4b8a-9adf-e503eed75491 tempest-ProjectReaderTests-1377105507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:37:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-36ff5851-0cfa-4b8a-9adf-e503eed75491 tempest-ProjectReaderTests-1377105507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-36ff5851-0cfa-4b8a-9adf-e503eed75491 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:21 devstack sudo[108063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:37:21 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:21 devstack sudo[108061]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-183dccf9-0a06-41b0-bd17-7fc562c62c6a tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d.a30f9241-375e-46e0-95a0-80e944a49c51" returned: 0 in 0.246s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-183dccf9-0a06-41b0-bd17-7fc562c62c6a tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:21 devstack sudo[108066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d.info Sep 03 14:37:21 devstack sudo[108066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:21 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-36ff5851-0cfa-4b8a-9adf-e503eed75491 tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.261s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:21 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-36ff5851-0cfa-4b8a-9adf-e503eed75491 tempest-ProjectReaderTests-1377105507 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:37:21 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-36ff5851-0cfa-4b8a-9adf-e503eed75491 tempest-ProjectReaderTests-1377105507 None] Deleted volume successfully. Sep 03 14:37:21 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-36ff5851-0cfa-4b8a-9adf-e503eed75491 tempest-ProjectReaderTests-1377105507 None] Lock "cinder-f497dd53-d5c0-4e2c-b2ec-0ec30c07760b-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:21 devstack sudo[108066]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-183dccf9-0a06-41b0-bd17-7fc562c62c6a tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d.info" returned: 0 in 0.262s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:21 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-183dccf9-0a06-41b0-bd17-7fc562c62c6a tempest-ProjectMemberTests-1350538287 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d.info is being set with open permissions: ugo+rw Sep 03 14:37:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-183dccf9-0a06-41b0-bd17-7fc562c62c6a tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:21 devstack sudo[108070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d.info Sep 03 14:37:21 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:21 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-183dccf9-0a06-41b0-bd17-7fc562c62c6a tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d.info" returned: 0 in 0.254s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-183dccf9-0a06-41b0-bd17-7fc562c62c6a tempest-ProjectMemberTests-1350538287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.922s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:21 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-183dccf9-0a06-41b0-bd17-7fc562c62c6a tempest-ProjectMemberTests-1350538287 None] Create snapshot completed successfully Sep 03 14:37:21 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef59bec2-4efa-406c-9a2d-427c26f11d18 tempest-ProjectReaderTests-1377105507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:37:21 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ef59bec2-4efa-406c-9a2d-427c26f11d18 tempest-ProjectReaderTests-1377105507 None] Flow 'volume_create_manager' (ea560cb5-3f0a-4ddc-a905-13b0169f2582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:37:21 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ef59bec2-4efa-406c-9a2d-427c26f11d18 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca0d791a-02f9-4677-a555-9b5fc11775e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:21 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ef59bec2-4efa-406c-9a2d-427c26f11d18 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca0d791a-02f9-4677-a555-9b5fc11775e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:37:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-302701106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=399cc927-ae0d-476d-82b4-9b5fce4a4927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c292af184774cb8a8630b73867fc4c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:37:22Z,use_quota=True,user_id='61387dc863c743a9af4844c7b603de31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:21 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ef59bec2-4efa-406c-9a2d-427c26f11d18 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d61bcd9f-59cf-4682-86fa-65b67d82e76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:21 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ef59bec2-4efa-406c-9a2d-427c26f11d18 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d61bcd9f-59cf-4682-86fa-65b67d82e76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:21 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ef59bec2-4efa-406c-9a2d-427c26f11d18 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (620c6204-a3f6-4b40-9bca-334c0ead1e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:21 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ef59bec2-4efa-406c-9a2d-427c26f11d18 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (620c6204-a3f6-4b40-9bca-334c0ead1e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '399cc927-ae0d-476d-82b4-9b5fce4a4927', 'volume_name': 'volume-399cc927-ae0d-476d-82b4-9b5fce4a4927', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:21 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ef59bec2-4efa-406c-9a2d-427c26f11d18 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8676bdb-7ea4-4385-ab06-eb61ed5789f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:21 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ef59bec2-4efa-406c-9a2d-427c26f11d18 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8676bdb-7ea4-4385-ab06-eb61ed5789f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:21 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ef59bec2-4efa-406c-9a2d-427c26f11d18 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d456a15f-b53c-42e1-a47e-acd7cd147900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:21 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-ef59bec2-4efa-406c-9a2d-427c26f11d18 tempest-ProjectReaderTests-1377105507 None] Volume 399cc927-ae0d-476d-82b4-9b5fce4a4927: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-399cc927-ae0d-476d-82b4-9b5fce4a4927', 'volume_size': 1} Sep 03 14:37:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ef59bec2-4efa-406c-9a2d-427c26f11d18 tempest-ProjectReaderTests-1377105507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ef59bec2-4efa-406c-9a2d-427c26f11d18 tempest-ProjectReaderTests-1377105507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:21 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ef59bec2-4efa-406c-9a2d-427c26f11d18 tempest-ProjectReaderTests-1377105507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:37:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-302701106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=399cc927-ae0d-476d-82b4-9b5fce4a4927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c292af184774cb8a8630b73867fc4c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:37:22Z,use_quota=True,user_id='61387dc863c743a9af4844c7b603de31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:37:21 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-ef59bec2-4efa-406c-9a2d-427c26f11d18 tempest-ProjectReaderTests-1377105507 None] Creating volume 399cc927-ae0d-476d-82b4-9b5fce4a4927 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:37:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ef59bec2-4efa-406c-9a2d-427c26f11d18 tempest-ProjectReaderTests-1377105507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ef59bec2-4efa-406c-9a2d-427c26f11d18 tempest-ProjectReaderTests-1377105507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:21 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ef59bec2-4efa-406c-9a2d-427c26f11d18 tempest-ProjectReaderTests-1377105507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:37:21 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ef59bec2-4efa-406c-9a2d-427c26f11d18 tempest-ProjectReaderTests-1377105507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:37:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ef59bec2-4efa-406c-9a2d-427c26f11d18 tempest-ProjectReaderTests-1377105507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:21 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ef59bec2-4efa-406c-9a2d-427c26f11d18 tempest-ProjectReaderTests-1377105507 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:37:21 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-ef59bec2-4efa-406c-9a2d-427c26f11d18 tempest-ProjectReaderTests-1377105507 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:37:21 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ef59bec2-4efa-406c-9a2d-427c26f11d18 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-399cc927-ae0d-476d-82b4-9b5fce4a4927 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-6318e4f6-dd71-4ef4-bac8-8d379396e62c tempest-ProjectMemberTests-1350538287 None] Acquiring lock "cinder-a30f9241-375e-46e0-95a0-80e944a49c51-delete_snapshot" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:22 devstack sudo[108073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-399cc927-ae0d-476d-82b4-9b5fce4a4927 1073741824 Sep 03 14:37:22 devstack sudo[108073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-6318e4f6-dd71-4ef4-bac8-8d379396e62c tempest-ProjectMemberTests-1350538287 None] Lock "cinder-a30f9241-375e-46e0-95a0-80e944a49c51-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-6318e4f6-dd71-4ef4-bac8-8d379396e62c tempest-ProjectMemberTests-1350538287 None] Acquiring lock "cinder-quobyte-1e3d84b3-9196-4775-ba6b-cc5fb49a433d" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-6318e4f6-dd71-4ef4-bac8-8d379396e62c tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-1e3d84b3-9196-4775-ba6b-cc5fb49a433d" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-6318e4f6-dd71-4ef4-bac8-8d379396e62c tempest-ProjectMemberTests-1350538287 None] Acquiring lock "cinder-quobyte-a30f9241-375e-46e0-95a0-80e944a49c51" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:22 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-6318e4f6-dd71-4ef4-bac8-8d379396e62c tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-a30f9241-375e-46e0-95a0-80e944a49c51" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:22 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-6318e4f6-dd71-4ef4-bac8-8d379396e62c tempest-ProjectMemberTests-1350538287 None] Deleting offline snapshot a30f9241-375e-46e0-95a0-80e944a49c51 of volume 1e3d84b3-9196-4775-ba6b-cc5fb49a433d {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:37:22 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-6318e4f6-dd71-4ef4-bac8-8d379396e62c tempest-ProjectMemberTests-1350538287 None] snapshot_file for this snap is: volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d.a30f9241-375e-46e0-95a0-80e944a49c51 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:37:22 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb30173-0ffa-4b21-a568-67f3f872c605]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:37:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6318e4f6-dd71-4ef4-bac8-8d379396e62c tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d.a30f9241-375e-46e0-95a0-80e944a49c51 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:22 devstack sudo[108075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d.a30f9241-375e-46e0-95a0-80e944a49c51 Sep 03 14:37:22 devstack sudo[108075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:22 devstack sudo[108073]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ef59bec2-4efa-406c-9a2d-427c26f11d18 tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-399cc927-ae0d-476d-82b4-9b5fce4a4927 1073741824" returned: 0 in 0.463s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:22 devstack sudo[108075]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6318e4f6-dd71-4ef4-bac8-8d379396e62c tempest-ProjectMemberTests-1350538287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d.a30f9241-375e-46e0-95a0-80e944a49c51" returned: 0 in 0.378s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:22 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-6318e4f6-dd71-4ef4-bac8-8d379396e62c tempest-ProjectMemberTests-1350538287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:37:22 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f317ea-2896-4607-b03a-f6768a4e6ab2]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:37:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6318e4f6-dd71-4ef4-bac8-8d379396e62c tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ef59bec2-4efa-406c-9a2d-427c26f11d18 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-399cc927-ae0d-476d-82b4-9b5fce4a4927 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:22 devstack sudo[108085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-399cc927-ae0d-476d-82b4-9b5fce4a4927 Sep 03 14:37:22 devstack sudo[108085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:22 devstack sudo[108084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d Sep 03 14:37:22 devstack sudo[108084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:22 devstack sudo[108085]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ef59bec2-4efa-406c-9a2d-427c26f11d18 tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-399cc927-ae0d-476d-82b4-9b5fce4a4927" returned: 0 in 0.246s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:22 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ef59bec2-4efa-406c-9a2d-427c26f11d18 tempest-ProjectReaderTests-1377105507 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:37:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ef59bec2-4efa-406c-9a2d-427c26f11d18 tempest-ProjectReaderTests-1377105507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:22 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ef59bec2-4efa-406c-9a2d-427c26f11d18 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d456a15f-b53c-42e1-a47e-acd7cd147900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-399cc927-ae0d-476d-82b4-9b5fce4a4927', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:22 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ef59bec2-4efa-406c-9a2d-427c26f11d18 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42650d5d-f4f6-4b98-a9fd-39f123c708e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:22 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-ef59bec2-4efa-406c-9a2d-427c26f11d18 tempest-ProjectReaderTests-1377105507 None] Volume volume-399cc927-ae0d-476d-82b4-9b5fce4a4927 (399cc927-ae0d-476d-82b4-9b5fce4a4927): created successfully Sep 03 14:37:22 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ef59bec2-4efa-406c-9a2d-427c26f11d18 tempest-ProjectReaderTests-1377105507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42650d5d-f4f6-4b98-a9fd-39f123c708e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:22 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ef59bec2-4efa-406c-9a2d-427c26f11d18 tempest-ProjectReaderTests-1377105507 None] Flow 'volume_create_manager' (ea560cb5-3f0a-4ddc-a905-13b0169f2582) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:37:22 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-ef59bec2-4efa-406c-9a2d-427c26f11d18 tempest-ProjectReaderTests-1377105507 None] Created volume successfully. Sep 03 14:37:22 devstack sudo[108084]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6318e4f6-dd71-4ef4-bac8-8d379396e62c tempest-ProjectMemberTests-1350538287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d" returned: 0 in 0.383s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:22 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6318e4f6-dd71-4ef4-bac8-8d379396e62c tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d.a30f9241-375e-46e0-95a0-80e944a49c51 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:22 devstack sudo[108092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d.a30f9241-375e-46e0-95a0-80e944a49c51 Sep 03 14:37:22 devstack sudo[108092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6e760124-c752-49b0-82f6-e1f5e794a795 tempest-ProjectReaderTests-1377105507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6e760124-c752-49b0-82f6-e1f5e794a795 tempest-ProjectReaderTests-1377105507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:23 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-6e760124-c752-49b0-82f6-e1f5e794a795 tempest-ProjectReaderTests-1377105507 None] Creating offline snapshot fece9737-538c-4192-8ad3-82a0e83dfd3b of volume 399cc927-ae0d-476d-82b4-9b5fce4a4927 {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:37:23 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[030439e0-84ec-46aa-bd0a-707b6b96256f]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:37:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6e760124-c752-49b0-82f6-e1f5e794a795 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-399cc927-ae0d-476d-82b4-9b5fce4a4927 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:23 devstack sudo[108092]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6318e4f6-dd71-4ef4-bac8-8d379396e62c tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d.a30f9241-375e-46e0-95a0-80e944a49c51" returned: 0 in 0.349s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6318e4f6-dd71-4ef4-bac8-8d379396e62c tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d.a30f9241-375e-46e0-95a0-80e944a49c51 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:23 devstack sudo[108097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-399cc927-ae0d-476d-82b4-9b5fce4a4927 Sep 03 14:37:23 devstack sudo[108097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:23 devstack sudo[108099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d.a30f9241-375e-46e0-95a0-80e944a49c51 Sep 03 14:37:23 devstack sudo[108099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:23 devstack sudo[108099]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6318e4f6-dd71-4ef4-bac8-8d379396e62c tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d.a30f9241-375e-46e0-95a0-80e944a49c51" returned: 0 in 0.250s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:23 devstack sudo[108097]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6e760124-c752-49b0-82f6-e1f5e794a795 tempest-ProjectReaderTests-1377105507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-399cc927-ae0d-476d-82b4-9b5fce4a4927" returned: 0 in 0.379s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6e760124-c752-49b0-82f6-e1f5e794a795 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-399cc927-ae0d-476d-82b4-9b5fce4a4927,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-399cc927-ae0d-476d-82b4-9b5fce4a4927.fece9737-538c-4192-8ad3-82a0e83dfd3b 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:23 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-6318e4f6-dd71-4ef4-bac8-8d379396e62c tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-a30f9241-375e-46e0-95a0-80e944a49c51" released by "_delete_snapshot" :: held 1.466s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:23 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-6318e4f6-dd71-4ef4-bac8-8d379396e62c tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-1e3d84b3-9196-4775-ba6b-cc5fb49a433d" released by "delete_snapshot" :: held 1.488s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:23 devstack sudo[108106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-399cc927-ae0d-476d-82b4-9b5fce4a4927,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-399cc927-ae0d-476d-82b4-9b5fce4a4927.fece9737-538c-4192-8ad3-82a0e83dfd3b 1G Sep 03 14:37:23 devstack sudo[108106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:23 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-6318e4f6-dd71-4ef4-bac8-8d379396e62c tempest-ProjectMemberTests-1350538287 None] Created reservations ['d1dcdb0c-93c8-4a81-9bd0-279d0025356b', 'bb4ec142-fe6a-488d-a9f3-4acc2a7ac117', 'bd09424e-68c4-47e3-bdb3-76a81eff8a0e', '9ada1a17-32cd-4ddc-a33e-0198ede768fa'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:37:23 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-6318e4f6-dd71-4ef4-bac8-8d379396e62c tempest-ProjectMemberTests-1350538287 None] Delete snapshot completed successfully. Sep 03 14:37:23 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-6318e4f6-dd71-4ef4-bac8-8d379396e62c tempest-ProjectMemberTests-1350538287 None] Lock "cinder-a30f9241-375e-46e0-95a0-80e944a49c51-delete_snapshot" released by "delete_snapshot" :: held 1.627s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:23 devstack sudo[108106]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6e760124-c752-49b0-82f6-e1f5e794a795 tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-399cc927-ae0d-476d-82b4-9b5fce4a4927,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-399cc927-ae0d-476d-82b4-9b5fce4a4927.fece9737-538c-4192-8ad3-82a0e83dfd3b 1G" returned: 0 in 0.403s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:23 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6e760124-c752-49b0-82f6-e1f5e794a795 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-399cc927-ae0d-476d-82b4-9b5fce4a4927 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-399cc927-ae0d-476d-82b4-9b5fce4a4927.fece9737-538c-4192-8ad3-82a0e83dfd3b {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:23 devstack sudo[108111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-399cc927-ae0d-476d-82b4-9b5fce4a4927 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-399cc927-ae0d-476d-82b4-9b5fce4a4927.fece9737-538c-4192-8ad3-82a0e83dfd3b Sep 03 14:37:23 devstack sudo[108111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:24 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-fbd7bef1-f0a5-413b-ada4-99e0150f187b tempest-ProjectMemberTests-1350538287 None] Acquiring lock "cinder-1e3d84b3-9196-4775-ba6b-cc5fb49a433d-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:24 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-fbd7bef1-f0a5-413b-ada4-99e0150f187b tempest-ProjectMemberTests-1350538287 None] Lock "cinder-1e3d84b3-9196-4775-ba6b-cc5fb49a433d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:24 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-fbd7bef1-f0a5-413b-ada4-99e0150f187b tempest-ProjectMemberTests-1350538287 None] Acquiring lock "cinder-quobyte-1e3d84b3-9196-4775-ba6b-cc5fb49a433d" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:24 devstack sudo[108111]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6e760124-c752-49b0-82f6-e1f5e794a795 tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-399cc927-ae0d-476d-82b4-9b5fce4a4927 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-399cc927-ae0d-476d-82b4-9b5fce4a4927.fece9737-538c-4192-8ad3-82a0e83dfd3b" returned: 0 in 0.331s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:24 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-6e760124-c752-49b0-82f6-e1f5e794a795 tempest-ProjectReaderTests-1377105507 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-399cc927-ae0d-476d-82b4-9b5fce4a4927.fece9737-538c-4192-8ad3-82a0e83dfd3b is being set with open permissions: ugo+rw Sep 03 14:37:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6e760124-c752-49b0-82f6-e1f5e794a795 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-399cc927-ae0d-476d-82b4-9b5fce4a4927.fece9737-538c-4192-8ad3-82a0e83dfd3b {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:24 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-fbd7bef1-f0a5-413b-ada4-99e0150f187b tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-1e3d84b3-9196-4775-ba6b-cc5fb49a433d" acquired by "delete_volume" :: waited 0.029s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:24 devstack sudo[108116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-399cc927-ae0d-476d-82b4-9b5fce4a4927.fece9737-538c-4192-8ad3-82a0e83dfd3b Sep 03 14:37:24 devstack sudo[108116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:24 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6aef8a-2c65-4534-90db-c20290e5b7a1]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:37:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fbd7bef1-f0a5-413b-ada4-99e0150f187b tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:24 devstack sudo[108118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d Sep 03 14:37:24 devstack sudo[108118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:24 devstack sudo[108116]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6e760124-c752-49b0-82f6-e1f5e794a795 tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-399cc927-ae0d-476d-82b4-9b5fce4a4927.fece9737-538c-4192-8ad3-82a0e83dfd3b" returned: 0 in 0.281s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6e760124-c752-49b0-82f6-e1f5e794a795 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-399cc927-ae0d-476d-82b4-9b5fce4a4927.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:24 devstack sudo[108121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-399cc927-ae0d-476d-82b4-9b5fce4a4927.info Sep 03 14:37:24 devstack sudo[108121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:24 devstack sudo[108118]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fbd7bef1-f0a5-413b-ada4-99e0150f187b tempest-ProjectMemberTests-1350538287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d" returned: 0 in 0.369s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fbd7bef1-f0a5-413b-ada4-99e0150f187b tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:24 devstack sudo[108126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d Sep 03 14:37:24 devstack sudo[108126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:24 devstack sudo[108121]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6e760124-c752-49b0-82f6-e1f5e794a795 tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-399cc927-ae0d-476d-82b4-9b5fce4a4927.info" returned: 0 in 0.268s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:24 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-6e760124-c752-49b0-82f6-e1f5e794a795 tempest-ProjectReaderTests-1377105507 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-399cc927-ae0d-476d-82b4-9b5fce4a4927.info is being set with open permissions: ugo+rw Sep 03 14:37:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6e760124-c752-49b0-82f6-e1f5e794a795 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-399cc927-ae0d-476d-82b4-9b5fce4a4927.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:24 devstack sudo[108129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-399cc927-ae0d-476d-82b4-9b5fce4a4927.info Sep 03 14:37:24 devstack sudo[108129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:24 devstack sudo[108126]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:24 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fbd7bef1-f0a5-413b-ada4-99e0150f187b tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-1e3d84b3-9196-4775-ba6b-cc5fb49a433d" returned: 0 in 0.252s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:24 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-fbd7bef1-f0a5-413b-ada4-99e0150f187b tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-1e3d84b3-9196-4775-ba6b-cc5fb49a433d" released by "delete_volume" :: held 0.683s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:24 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-fbd7bef1-f0a5-413b-ada4-99e0150f187b tempest-ProjectMemberTests-1350538287 None] Created reservations ['05d70953-eaa4-4ab7-865a-150793874dd8', 'd5df26a1-5743-499b-a1d8-f69446f3bda4', 'afe693e5-e87b-4025-914d-cf5e0ab17784', '33122511-2401-49db-b66d-80e911bfc153'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:37:25 devstack sudo[108129]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-6e760124-c752-49b0-82f6-e1f5e794a795 tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-399cc927-ae0d-476d-82b4-9b5fce4a4927.info" returned: 0 in 0.245s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-6e760124-c752-49b0-82f6-e1f5e794a795 tempest-ProjectReaderTests-1377105507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.986s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-fbd7bef1-f0a5-413b-ada4-99e0150f187b tempest-ProjectMemberTests-1350538287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-fbd7bef1-f0a5-413b-ada4-99e0150f187b tempest-ProjectMemberTests-1350538287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:25 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-fbd7bef1-f0a5-413b-ada4-99e0150f187b tempest-ProjectMemberTests-1350538287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:37:25 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-fbd7bef1-f0a5-413b-ada4-99e0150f187b tempest-ProjectMemberTests-1350538287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:37:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-fbd7bef1-f0a5-413b-ada4-99e0150f187b tempest-ProjectMemberTests-1350538287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fbd7bef1-f0a5-413b-ada4-99e0150f187b tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:25 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-6e760124-c752-49b0-82f6-e1f5e794a795 tempest-ProjectReaderTests-1377105507 None] Create snapshot completed successfully Sep 03 14:37:25 devstack sudo[108133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:37:25 devstack sudo[108133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:25 devstack sudo[108133]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fbd7bef1-f0a5-413b-ada4-99e0150f187b tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.248s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:25 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-fbd7bef1-f0a5-413b-ada4-99e0150f187b tempest-ProjectMemberTests-1350538287 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:37:25 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-fbd7bef1-f0a5-413b-ada4-99e0150f187b tempest-ProjectMemberTests-1350538287 None] Deleted volume successfully. Sep 03 14:37:25 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-fbd7bef1-f0a5-413b-ada4-99e0150f187b tempest-ProjectMemberTests-1350538287 None] Lock "cinder-1e3d84b3-9196-4775-ba6b-cc5fb49a433d-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:25 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-3caf78dd-ffd5-455f-8556-53145be8a29a tempest-ProjectMemberTests-1350538287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:37:25 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-3caf78dd-ffd5-455f-8556-53145be8a29a tempest-ProjectMemberTests-1350538287 None] Flow 'volume_create_manager' (cd409a21-dc4d-478f-8bff-53c5a4619036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:37:25 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-3caf78dd-ffd5-455f-8556-53145be8a29a tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c643e73c-1cde-42ed-b815-e6160c5cbd72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:25 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-3caf78dd-ffd5-455f-8556-53145be8a29a tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c643e73c-1cde-42ed-b815-e6160c5cbd72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1262251346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da56c618-3de7-473a-b868-50af4e11b0f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bdc07719fdf40189d19adf3cf793220',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:37:26Z,use_quota=True,user_id='c0e0fc3b02a64f5b9b037ade3f94a724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:25 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-3caf78dd-ffd5-455f-8556-53145be8a29a tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (895178c9-847c-4efb-814b-e692b950cff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:25 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-3caf78dd-ffd5-455f-8556-53145be8a29a tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (895178c9-847c-4efb-814b-e692b950cff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:25 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-3caf78dd-ffd5-455f-8556-53145be8a29a tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a725222f-e031-4db4-bcf7-282eb56533a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:25 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-3caf78dd-ffd5-455f-8556-53145be8a29a tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a725222f-e031-4db4-bcf7-282eb56533a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da56c618-3de7-473a-b868-50af4e11b0f1', 'volume_name': 'volume-da56c618-3de7-473a-b868-50af4e11b0f1', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:25 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-3caf78dd-ffd5-455f-8556-53145be8a29a tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2265a38b-8bd1-49c2-9f50-5a84aa55518b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:25 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-3caf78dd-ffd5-455f-8556-53145be8a29a tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2265a38b-8bd1-49c2-9f50-5a84aa55518b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:25 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-3caf78dd-ffd5-455f-8556-53145be8a29a tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95b74d3d-ee10-4ec0-86b1-5a3731f18b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:25 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-3caf78dd-ffd5-455f-8556-53145be8a29a tempest-ProjectMemberTests-1350538287 None] Volume da56c618-3de7-473a-b868-50af4e11b0f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da56c618-3de7-473a-b868-50af4e11b0f1', 'volume_size': 1} Sep 03 14:37:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-3caf78dd-ffd5-455f-8556-53145be8a29a tempest-ProjectMemberTests-1350538287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-3caf78dd-ffd5-455f-8556-53145be8a29a tempest-ProjectMemberTests-1350538287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:25 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-3caf78dd-ffd5-455f-8556-53145be8a29a tempest-ProjectMemberTests-1350538287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1262251346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da56c618-3de7-473a-b868-50af4e11b0f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bdc07719fdf40189d19adf3cf793220',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:37:26Z,use_quota=True,user_id='c0e0fc3b02a64f5b9b037ade3f94a724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:37:25 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-3caf78dd-ffd5-455f-8556-53145be8a29a tempest-ProjectMemberTests-1350538287 None] Creating volume da56c618-3de7-473a-b868-50af4e11b0f1 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:37:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-3caf78dd-ffd5-455f-8556-53145be8a29a tempest-ProjectMemberTests-1350538287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-3caf78dd-ffd5-455f-8556-53145be8a29a tempest-ProjectMemberTests-1350538287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:25 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-3caf78dd-ffd5-455f-8556-53145be8a29a tempest-ProjectMemberTests-1350538287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:37:25 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-3caf78dd-ffd5-455f-8556-53145be8a29a tempest-ProjectMemberTests-1350538287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:37:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-3caf78dd-ffd5-455f-8556-53145be8a29a tempest-ProjectMemberTests-1350538287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:25 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-3caf78dd-ffd5-455f-8556-53145be8a29a tempest-ProjectMemberTests-1350538287 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:37:25 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-3caf78dd-ffd5-455f-8556-53145be8a29a tempest-ProjectMemberTests-1350538287 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:37:25 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3caf78dd-ffd5-455f-8556-53145be8a29a tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da56c618-3de7-473a-b868-50af4e11b0f1 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:25 devstack sudo[108142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da56c618-3de7-473a-b868-50af4e11b0f1 1073741824 Sep 03 14:37:25 devstack sudo[108142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:26 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8b510538-70b8-4ab7-8459-26a72a88bf4b tempest-ProjectReaderTests-1377105507 None] Acquiring lock "cinder-fece9737-538c-4192-8ad3-82a0e83dfd3b-delete_snapshot" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:26 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8b510538-70b8-4ab7-8459-26a72a88bf4b tempest-ProjectReaderTests-1377105507 None] Lock "cinder-fece9737-538c-4192-8ad3-82a0e83dfd3b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:26 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8b510538-70b8-4ab7-8459-26a72a88bf4b tempest-ProjectReaderTests-1377105507 None] Acquiring lock "cinder-quobyte-399cc927-ae0d-476d-82b4-9b5fce4a4927" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:26 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8b510538-70b8-4ab7-8459-26a72a88bf4b tempest-ProjectReaderTests-1377105507 None] Lock "cinder-quobyte-399cc927-ae0d-476d-82b4-9b5fce4a4927" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:26 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8b510538-70b8-4ab7-8459-26a72a88bf4b tempest-ProjectReaderTests-1377105507 None] Acquiring lock "cinder-quobyte-fece9737-538c-4192-8ad3-82a0e83dfd3b" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:26 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8b510538-70b8-4ab7-8459-26a72a88bf4b tempest-ProjectReaderTests-1377105507 None] Lock "cinder-quobyte-fece9737-538c-4192-8ad3-82a0e83dfd3b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:26 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-8b510538-70b8-4ab7-8459-26a72a88bf4b tempest-ProjectReaderTests-1377105507 None] Deleting offline snapshot fece9737-538c-4192-8ad3-82a0e83dfd3b of volume 399cc927-ae0d-476d-82b4-9b5fce4a4927 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:37:26 devstack sudo[108142]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:26 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-8b510538-70b8-4ab7-8459-26a72a88bf4b tempest-ProjectReaderTests-1377105507 None] snapshot_file for this snap is: volume-399cc927-ae0d-476d-82b4-9b5fce4a4927.fece9737-538c-4192-8ad3-82a0e83dfd3b {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:37:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3caf78dd-ffd5-455f-8556-53145be8a29a tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da56c618-3de7-473a-b868-50af4e11b0f1 1073741824" returned: 0 in 0.489s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:26 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9784dd44-dde5-42be-a919-88e982904853]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:37:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8b510538-70b8-4ab7-8459-26a72a88bf4b tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-399cc927-ae0d-476d-82b4-9b5fce4a4927.fece9737-538c-4192-8ad3-82a0e83dfd3b {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3caf78dd-ffd5-455f-8556-53145be8a29a tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da56c618-3de7-473a-b868-50af4e11b0f1 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:26 devstack sudo[108149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da56c618-3de7-473a-b868-50af4e11b0f1 Sep 03 14:37:26 devstack sudo[108149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:26 devstack sudo[108148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-399cc927-ae0d-476d-82b4-9b5fce4a4927.fece9737-538c-4192-8ad3-82a0e83dfd3b Sep 03 14:37:26 devstack sudo[108148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:26 devstack sudo[108149]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3caf78dd-ffd5-455f-8556-53145be8a29a tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da56c618-3de7-473a-b868-50af4e11b0f1" returned: 0 in 0.260s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:26 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-3caf78dd-ffd5-455f-8556-53145be8a29a tempest-ProjectMemberTests-1350538287 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:37:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-3caf78dd-ffd5-455f-8556-53145be8a29a tempest-ProjectMemberTests-1350538287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:26 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-3caf78dd-ffd5-455f-8556-53145be8a29a tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95b74d3d-ee10-4ec0-86b1-5a3731f18b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da56c618-3de7-473a-b868-50af4e11b0f1', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:26 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-3caf78dd-ffd5-455f-8556-53145be8a29a tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24c36762-959b-4003-8771-339d74e8a3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:26 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-3caf78dd-ffd5-455f-8556-53145be8a29a tempest-ProjectMemberTests-1350538287 None] Volume volume-da56c618-3de7-473a-b868-50af4e11b0f1 (da56c618-3de7-473a-b868-50af4e11b0f1): created successfully Sep 03 14:37:26 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-3caf78dd-ffd5-455f-8556-53145be8a29a tempest-ProjectMemberTests-1350538287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24c36762-959b-4003-8771-339d74e8a3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:26 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-3caf78dd-ffd5-455f-8556-53145be8a29a tempest-ProjectMemberTests-1350538287 None] Flow 'volume_create_manager' (cd409a21-dc4d-478f-8bff-53c5a4619036) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:37:26 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-3caf78dd-ffd5-455f-8556-53145be8a29a tempest-ProjectMemberTests-1350538287 None] Created volume successfully. Sep 03 14:37:26 devstack sudo[108148]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8b510538-70b8-4ab7-8459-26a72a88bf4b tempest-ProjectReaderTests-1377105507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-399cc927-ae0d-476d-82b4-9b5fce4a4927.fece9737-538c-4192-8ad3-82a0e83dfd3b" returned: 0 in 0.391s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:26 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-8b510538-70b8-4ab7-8459-26a72a88bf4b tempest-ProjectReaderTests-1377105507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-399cc927-ae0d-476d-82b4-9b5fce4a4927(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:37:26 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed96ece-8965-43b3-a012-77c155151326]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:37:26 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8b510538-70b8-4ab7-8459-26a72a88bf4b tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-399cc927-ae0d-476d-82b4-9b5fce4a4927 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:26 devstack sudo[108157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-399cc927-ae0d-476d-82b4-9b5fce4a4927 Sep 03 14:37:26 devstack sudo[108157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:27 devstack sudo[108157]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8b510538-70b8-4ab7-8459-26a72a88bf4b tempest-ProjectReaderTests-1377105507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-399cc927-ae0d-476d-82b4-9b5fce4a4927" returned: 0 in 0.368s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8b510538-70b8-4ab7-8459-26a72a88bf4b tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-399cc927-ae0d-476d-82b4-9b5fce4a4927.fece9737-538c-4192-8ad3-82a0e83dfd3b {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:27 devstack sudo[108162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-399cc927-ae0d-476d-82b4-9b5fce4a4927.fece9737-538c-4192-8ad3-82a0e83dfd3b Sep 03 14:37:27 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:27 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8b510538-70b8-4ab7-8459-26a72a88bf4b tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-399cc927-ae0d-476d-82b4-9b5fce4a4927.fece9737-538c-4192-8ad3-82a0e83dfd3b" returned: 0 in 0.321s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8b510538-70b8-4ab7-8459-26a72a88bf4b tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-399cc927-ae0d-476d-82b4-9b5fce4a4927.fece9737-538c-4192-8ad3-82a0e83dfd3b {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:27 devstack sudo[108167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-399cc927-ae0d-476d-82b4-9b5fce4a4927.fece9737-538c-4192-8ad3-82a0e83dfd3b Sep 03 14:37:27 devstack sudo[108167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:27 devstack sudo[108167]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8b510538-70b8-4ab7-8459-26a72a88bf4b tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-399cc927-ae0d-476d-82b4-9b5fce4a4927.fece9737-538c-4192-8ad3-82a0e83dfd3b" returned: 0 in 0.248s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:27 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8b510538-70b8-4ab7-8459-26a72a88bf4b tempest-ProjectReaderTests-1377105507 None] Lock "cinder-quobyte-fece9737-538c-4192-8ad3-82a0e83dfd3b" released by "_delete_snapshot" :: held 1.431s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:27 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8b510538-70b8-4ab7-8459-26a72a88bf4b tempest-ProjectReaderTests-1377105507 None] Lock "cinder-quobyte-399cc927-ae0d-476d-82b4-9b5fce4a4927" released by "delete_snapshot" :: held 1.455s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:27 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-8b510538-70b8-4ab7-8459-26a72a88bf4b tempest-ProjectReaderTests-1377105507 None] Created reservations ['034e1d93-f8d8-4bbf-8784-2074714bfac9', '88db0314-0fe6-455d-ba74-63a483d7dcc5', '0bbc323d-1fd9-4908-a56e-3deed57680a4', '2eae4b64-050a-4fb5-90d0-68b3a9f5f1df'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:37:27 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-8b510538-70b8-4ab7-8459-26a72a88bf4b tempest-ProjectReaderTests-1377105507 None] Delete snapshot completed successfully. Sep 03 14:37:27 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8b510538-70b8-4ab7-8459-26a72a88bf4b tempest-ProjectReaderTests-1377105507 None] Lock "cinder-fece9737-538c-4192-8ad3-82a0e83dfd3b-delete_snapshot" released by "delete_snapshot" :: held 1.606s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2d755f57-ba3a-4340-baca-333707d16f0b tempest-ProjectMemberTests-1350538287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:27 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2d755f57-ba3a-4340-baca-333707d16f0b tempest-ProjectMemberTests-1350538287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:28 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-2d755f57-ba3a-4340-baca-333707d16f0b tempest-ProjectMemberTests-1350538287 None] Creating offline snapshot 8bb430c4-5aa5-44c2-bf32-c9f944ded600 of volume da56c618-3de7-473a-b868-50af4e11b0f1 {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:37:28 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21c430b-be6f-40c8-9f43-f9f329010ebb]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:37:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2d755f57-ba3a-4340-baca-333707d16f0b tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da56c618-3de7-473a-b868-50af4e11b0f1 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:28 devstack sudo[108170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da56c618-3de7-473a-b868-50af4e11b0f1 Sep 03 14:37:28 devstack sudo[108170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:28 devstack sudo[108170]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2d755f57-ba3a-4340-baca-333707d16f0b tempest-ProjectMemberTests-1350538287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da56c618-3de7-473a-b868-50af4e11b0f1" returned: 0 in 0.347s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2d755f57-ba3a-4340-baca-333707d16f0b tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da56c618-3de7-473a-b868-50af4e11b0f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da56c618-3de7-473a-b868-50af4e11b0f1.8bb430c4-5aa5-44c2-bf32-c9f944ded600 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:28 devstack sudo[108176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da56c618-3de7-473a-b868-50af4e11b0f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da56c618-3de7-473a-b868-50af4e11b0f1.8bb430c4-5aa5-44c2-bf32-c9f944ded600 1G Sep 03 14:37:28 devstack sudo[108176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:28 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-3cb110c3-7b07-49c4-800f-049f574711e0 tempest-ProjectReaderTests-1377105507 None] Acquiring lock "cinder-399cc927-ae0d-476d-82b4-9b5fce4a4927-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:28 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-3cb110c3-7b07-49c4-800f-049f574711e0 tempest-ProjectReaderTests-1377105507 None] Lock "cinder-399cc927-ae0d-476d-82b4-9b5fce4a4927-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:28 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-3cb110c3-7b07-49c4-800f-049f574711e0 tempest-ProjectReaderTests-1377105507 None] Acquiring lock "cinder-quobyte-399cc927-ae0d-476d-82b4-9b5fce4a4927" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:28 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-3cb110c3-7b07-49c4-800f-049f574711e0 tempest-ProjectReaderTests-1377105507 None] Lock "cinder-quobyte-399cc927-ae0d-476d-82b4-9b5fce4a4927" acquired by "delete_volume" :: waited 0.018s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:28 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[268e77c6-5eec-46fd-aa00-5ddf63807c6f]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:37:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3cb110c3-7b07-49c4-800f-049f574711e0 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-399cc927-ae0d-476d-82b4-9b5fce4a4927 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:28 devstack sudo[108178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-399cc927-ae0d-476d-82b4-9b5fce4a4927 Sep 03 14:37:28 devstack sudo[108178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:28 devstack sudo[108176]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2d755f57-ba3a-4340-baca-333707d16f0b tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da56c618-3de7-473a-b868-50af4e11b0f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da56c618-3de7-473a-b868-50af4e11b0f1.8bb430c4-5aa5-44c2-bf32-c9f944ded600 1G" returned: 0 in 0.443s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2d755f57-ba3a-4340-baca-333707d16f0b tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da56c618-3de7-473a-b868-50af4e11b0f1 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da56c618-3de7-473a-b868-50af4e11b0f1.8bb430c4-5aa5-44c2-bf32-c9f944ded600 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:28 devstack sudo[108185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da56c618-3de7-473a-b868-50af4e11b0f1 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da56c618-3de7-473a-b868-50af4e11b0f1.8bb430c4-5aa5-44c2-bf32-c9f944ded600 Sep 03 14:37:28 devstack sudo[108185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:28 devstack sudo[108178]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3cb110c3-7b07-49c4-800f-049f574711e0 tempest-ProjectReaderTests-1377105507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-399cc927-ae0d-476d-82b4-9b5fce4a4927" returned: 0 in 0.399s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:28 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3cb110c3-7b07-49c4-800f-049f574711e0 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-399cc927-ae0d-476d-82b4-9b5fce4a4927 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:28 devstack sudo[108190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-399cc927-ae0d-476d-82b4-9b5fce4a4927 Sep 03 14:37:28 devstack sudo[108190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:29 devstack sudo[108185]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2d755f57-ba3a-4340-baca-333707d16f0b tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da56c618-3de7-473a-b868-50af4e11b0f1 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da56c618-3de7-473a-b868-50af4e11b0f1.8bb430c4-5aa5-44c2-bf32-c9f944ded600" returned: 0 in 0.335s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:29 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-2d755f57-ba3a-4340-baca-333707d16f0b tempest-ProjectMemberTests-1350538287 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da56c618-3de7-473a-b868-50af4e11b0f1.8bb430c4-5aa5-44c2-bf32-c9f944ded600 is being set with open permissions: ugo+rw Sep 03 14:37:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2d755f57-ba3a-4340-baca-333707d16f0b tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da56c618-3de7-473a-b868-50af4e11b0f1.8bb430c4-5aa5-44c2-bf32-c9f944ded600 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:29 devstack sudo[108196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da56c618-3de7-473a-b868-50af4e11b0f1.8bb430c4-5aa5-44c2-bf32-c9f944ded600 Sep 03 14:37:29 devstack sudo[108196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:29 devstack sudo[108190]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3cb110c3-7b07-49c4-800f-049f574711e0 tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-399cc927-ae0d-476d-82b4-9b5fce4a4927" returned: 0 in 0.269s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:29 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-3cb110c3-7b07-49c4-800f-049f574711e0 tempest-ProjectReaderTests-1377105507 None] Lock "cinder-quobyte-399cc927-ae0d-476d-82b4-9b5fce4a4927" released by "delete_volume" :: held 0.735s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:29 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-3cb110c3-7b07-49c4-800f-049f574711e0 tempest-ProjectReaderTests-1377105507 None] Created reservations ['097dc662-7565-466e-9c97-8c47e1964731', '4370985d-c643-4cbc-bbe8-ce543a4b79cc', '33ddb268-8bb3-4378-8358-5ec4c0613711', '5360f89b-c956-4949-975b-bd9b1e23c80c'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:37:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-3cb110c3-7b07-49c4-800f-049f574711e0 tempest-ProjectReaderTests-1377105507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-3cb110c3-7b07-49c4-800f-049f574711e0 tempest-ProjectReaderTests-1377105507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:29 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-3cb110c3-7b07-49c4-800f-049f574711e0 tempest-ProjectReaderTests-1377105507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:37:29 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-3cb110c3-7b07-49c4-800f-049f574711e0 tempest-ProjectReaderTests-1377105507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:37:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-3cb110c3-7b07-49c4-800f-049f574711e0 tempest-ProjectReaderTests-1377105507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3cb110c3-7b07-49c4-800f-049f574711e0 tempest-ProjectReaderTests-1377105507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:29 devstack sudo[108196]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:29 devstack sudo[108200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:37:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2d755f57-ba3a-4340-baca-333707d16f0b tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da56c618-3de7-473a-b868-50af4e11b0f1.8bb430c4-5aa5-44c2-bf32-c9f944ded600" returned: 0 in 0.273s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:29 devstack sudo[108200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2d755f57-ba3a-4340-baca-333707d16f0b tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da56c618-3de7-473a-b868-50af4e11b0f1.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:29 devstack sudo[108202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da56c618-3de7-473a-b868-50af4e11b0f1.info Sep 03 14:37:29 devstack sudo[108202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:29 devstack sudo[108200]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-3cb110c3-7b07-49c4-800f-049f574711e0 tempest-ProjectReaderTests-1377105507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.275s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:29 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-3cb110c3-7b07-49c4-800f-049f574711e0 tempest-ProjectReaderTests-1377105507 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:37:29 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-3cb110c3-7b07-49c4-800f-049f574711e0 tempest-ProjectReaderTests-1377105507 None] Deleted volume successfully. Sep 03 14:37:29 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-3cb110c3-7b07-49c4-800f-049f574711e0 tempest-ProjectReaderTests-1377105507 None] Lock "cinder-399cc927-ae0d-476d-82b4-9b5fce4a4927-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:29 devstack sudo[108202]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2d755f57-ba3a-4340-baca-333707d16f0b tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da56c618-3de7-473a-b868-50af4e11b0f1.info" returned: 0 in 0.282s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:29 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-2d755f57-ba3a-4340-baca-333707d16f0b tempest-ProjectMemberTests-1350538287 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da56c618-3de7-473a-b868-50af4e11b0f1.info is being set with open permissions: ugo+rw Sep 03 14:37:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2d755f57-ba3a-4340-baca-333707d16f0b tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da56c618-3de7-473a-b868-50af4e11b0f1.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:29 devstack sudo[108206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da56c618-3de7-473a-b868-50af4e11b0f1.info Sep 03 14:37:29 devstack sudo[108206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:29 devstack sudo[108206]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:29 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-2d755f57-ba3a-4340-baca-333707d16f0b tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da56c618-3de7-473a-b868-50af4e11b0f1.info" returned: 0 in 0.248s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:30 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-2d755f57-ba3a-4340-baca-333707d16f0b tempest-ProjectMemberTests-1350538287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.020s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:30 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-2d755f57-ba3a-4340-baca-333707d16f0b tempest-ProjectMemberTests-1350538287 None] Create snapshot completed successfully Sep 03 14:37:31 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-465c21b6-497d-4ac5-8fce-9bfda62899b3 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "cinder-8bb430c4-5aa5-44c2-bf32-c9f944ded600-delete_snapshot" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:31 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-465c21b6-497d-4ac5-8fce-9bfda62899b3 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-8bb430c4-5aa5-44c2-bf32-c9f944ded600-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:31 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-465c21b6-497d-4ac5-8fce-9bfda62899b3 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "cinder-quobyte-da56c618-3de7-473a-b868-50af4e11b0f1" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:31 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-465c21b6-497d-4ac5-8fce-9bfda62899b3 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-da56c618-3de7-473a-b868-50af4e11b0f1" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:31 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-465c21b6-497d-4ac5-8fce-9bfda62899b3 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "cinder-quobyte-8bb430c4-5aa5-44c2-bf32-c9f944ded600" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:31 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-465c21b6-497d-4ac5-8fce-9bfda62899b3 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-8bb430c4-5aa5-44c2-bf32-c9f944ded600" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:31 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-465c21b6-497d-4ac5-8fce-9bfda62899b3 tempest-ProjectMemberTests-1350538287 None] Deleting offline snapshot 8bb430c4-5aa5-44c2-bf32-c9f944ded600 of volume da56c618-3de7-473a-b868-50af4e11b0f1 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:37:31 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-465c21b6-497d-4ac5-8fce-9bfda62899b3 tempest-ProjectMemberTests-1350538287 None] snapshot_file for this snap is: volume-da56c618-3de7-473a-b868-50af4e11b0f1.8bb430c4-5aa5-44c2-bf32-c9f944ded600 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:37:31 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e860b20-c63a-417e-a582-1a3627513170]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:37:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-465c21b6-497d-4ac5-8fce-9bfda62899b3 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da56c618-3de7-473a-b868-50af4e11b0f1.8bb430c4-5aa5-44c2-bf32-c9f944ded600 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:31 devstack sudo[108209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da56c618-3de7-473a-b868-50af4e11b0f1.8bb430c4-5aa5-44c2-bf32-c9f944ded600 Sep 03 14:37:31 devstack sudo[108209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:31 devstack sudo[108209]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-465c21b6-497d-4ac5-8fce-9bfda62899b3 tempest-ProjectMemberTests-1350538287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da56c618-3de7-473a-b868-50af4e11b0f1.8bb430c4-5aa5-44c2-bf32-c9f944ded600" returned: 0 in 0.367s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:31 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-465c21b6-497d-4ac5-8fce-9bfda62899b3 tempest-ProjectMemberTests-1350538287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da56c618-3de7-473a-b868-50af4e11b0f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:37:31 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[709c3dd1-5c20-40ee-818f-ae677e98142e]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:37:31 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-465c21b6-497d-4ac5-8fce-9bfda62899b3 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da56c618-3de7-473a-b868-50af4e11b0f1 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:31 devstack sudo[108214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da56c618-3de7-473a-b868-50af4e11b0f1 Sep 03 14:37:31 devstack sudo[108214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:32 devstack sudo[108214]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-465c21b6-497d-4ac5-8fce-9bfda62899b3 tempest-ProjectMemberTests-1350538287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da56c618-3de7-473a-b868-50af4e11b0f1" returned: 0 in 0.385s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-465c21b6-497d-4ac5-8fce-9bfda62899b3 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da56c618-3de7-473a-b868-50af4e11b0f1.8bb430c4-5aa5-44c2-bf32-c9f944ded600 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:32 devstack sudo[108220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da56c618-3de7-473a-b868-50af4e11b0f1.8bb430c4-5aa5-44c2-bf32-c9f944ded600 Sep 03 14:37:32 devstack sudo[108220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:32 devstack sudo[108220]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-465c21b6-497d-4ac5-8fce-9bfda62899b3 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da56c618-3de7-473a-b868-50af4e11b0f1.8bb430c4-5aa5-44c2-bf32-c9f944ded600" returned: 0 in 0.334s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-465c21b6-497d-4ac5-8fce-9bfda62899b3 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da56c618-3de7-473a-b868-50af4e11b0f1.8bb430c4-5aa5-44c2-bf32-c9f944ded600 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:32 devstack sudo[108226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da56c618-3de7-473a-b868-50af4e11b0f1.8bb430c4-5aa5-44c2-bf32-c9f944ded600 Sep 03 14:37:32 devstack sudo[108226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:32 devstack sudo[108226]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:32 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-465c21b6-497d-4ac5-8fce-9bfda62899b3 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da56c618-3de7-473a-b868-50af4e11b0f1.8bb430c4-5aa5-44c2-bf32-c9f944ded600" returned: 0 in 0.245s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:32 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-465c21b6-497d-4ac5-8fce-9bfda62899b3 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-8bb430c4-5aa5-44c2-bf32-c9f944ded600" released by "_delete_snapshot" :: held 1.430s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:32 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-465c21b6-497d-4ac5-8fce-9bfda62899b3 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-da56c618-3de7-473a-b868-50af4e11b0f1" released by "delete_snapshot" :: held 1.459s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:32 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-465c21b6-497d-4ac5-8fce-9bfda62899b3 tempest-ProjectMemberTests-1350538287 None] Created reservations ['01bef84e-6700-4bb2-a611-b9b84cfe3e4c', 'a5dae562-438e-4402-9e56-7188be0996e5', '1ffd601b-8838-48be-b431-7d15efcab106', '58300eda-adc4-42dc-97a5-21a787fee68f'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:37:32 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-465c21b6-497d-4ac5-8fce-9bfda62899b3 tempest-ProjectMemberTests-1350538287 None] Delete snapshot completed successfully. Sep 03 14:37:32 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-465c21b6-497d-4ac5-8fce-9bfda62899b3 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-8bb430c4-5aa5-44c2-bf32-c9f944ded600-delete_snapshot" released by "delete_snapshot" :: held 1.604s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:33 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8317e0b1-070e-4c8d-843a-e4690d3b0e44 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "cinder-da56c618-3de7-473a-b868-50af4e11b0f1-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:33 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8317e0b1-070e-4c8d-843a-e4690d3b0e44 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-da56c618-3de7-473a-b868-50af4e11b0f1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:33 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8317e0b1-070e-4c8d-843a-e4690d3b0e44 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "cinder-quobyte-da56c618-3de7-473a-b868-50af4e11b0f1" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:33 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8317e0b1-070e-4c8d-843a-e4690d3b0e44 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-da56c618-3de7-473a-b868-50af4e11b0f1" acquired by "delete_volume" :: waited 0.018s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:33 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f8a367-ebbf-4faf-a461-2e0550a60573]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:37:33 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8317e0b1-070e-4c8d-843a-e4690d3b0e44 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da56c618-3de7-473a-b868-50af4e11b0f1 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:33 devstack sudo[108231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da56c618-3de7-473a-b868-50af4e11b0f1 Sep 03 14:37:33 devstack sudo[108231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:33 devstack sudo[108231]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:33 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8317e0b1-070e-4c8d-843a-e4690d3b0e44 tempest-ProjectMemberTests-1350538287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da56c618-3de7-473a-b868-50af4e11b0f1" returned: 0 in 0.383s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:33 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8317e0b1-070e-4c8d-843a-e4690d3b0e44 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da56c618-3de7-473a-b868-50af4e11b0f1 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:33 devstack sudo[108236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da56c618-3de7-473a-b868-50af4e11b0f1 Sep 03 14:37:33 devstack sudo[108236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:34 devstack sudo[108236]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8317e0b1-070e-4c8d-843a-e4690d3b0e44 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-da56c618-3de7-473a-b868-50af4e11b0f1" returned: 0 in 0.260s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:34 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8317e0b1-070e-4c8d-843a-e4690d3b0e44 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-quobyte-da56c618-3de7-473a-b868-50af4e11b0f1" released by "delete_volume" :: held 0.704s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:34 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-8317e0b1-070e-4c8d-843a-e4690d3b0e44 tempest-ProjectMemberTests-1350538287 None] Created reservations ['3c9e3669-ed85-41ff-adaa-9bf5041413b3', '7ead2ee0-2a97-4b2d-a70c-99a9c858a099', 'cc16e849-6667-41d6-a724-c7391d2bbc92', '50726f93-b9fd-44fe-bc45-7dcd0d91d62c'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:37:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8317e0b1-070e-4c8d-843a-e4690d3b0e44 tempest-ProjectMemberTests-1350538287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8317e0b1-070e-4c8d-843a-e4690d3b0e44 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:34 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-8317e0b1-070e-4c8d-843a-e4690d3b0e44 tempest-ProjectMemberTests-1350538287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:37:34 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-8317e0b1-070e-4c8d-843a-e4690d3b0e44 tempest-ProjectMemberTests-1350538287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:37:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-8317e0b1-070e-4c8d-843a-e4690d3b0e44 tempest-ProjectMemberTests-1350538287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8317e0b1-070e-4c8d-843a-e4690d3b0e44 tempest-ProjectMemberTests-1350538287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:34 devstack sudo[108239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:37:34 devstack sudo[108239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:34 devstack sudo[108239]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:34 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-8317e0b1-070e-4c8d-843a-e4690d3b0e44 tempest-ProjectMemberTests-1350538287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.249s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:34 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-8317e0b1-070e-4c8d-843a-e4690d3b0e44 tempest-ProjectMemberTests-1350538287 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:37:34 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-8317e0b1-070e-4c8d-843a-e4690d3b0e44 tempest-ProjectMemberTests-1350538287 None] Deleted volume successfully. Sep 03 14:37:34 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-8317e0b1-070e-4c8d-843a-e4690d3b0e44 tempest-ProjectMemberTests-1350538287 None] Lock "cinder-da56c618-3de7-473a-b868-50af4e11b0f1-delete_volume" released by "delete_volume" :: held 1.153s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:38 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-d25f7b0b-e38b-47f0-9ba3-8a4b93b5db85 tempest-ProjectReaderTests-2007028364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:37:38 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d25f7b0b-e38b-47f0-9ba3-8a4b93b5db85 tempest-ProjectReaderTests-2007028364 None] Flow 'volume_create_manager' (ff1af880-ddfb-4142-a481-adeac32203c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:37:38 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d25f7b0b-e38b-47f0-9ba3-8a4b93b5db85 tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e0e2076-f65e-4148-a44a-9d78e5b4a338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:38 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d25f7b0b-e38b-47f0-9ba3-8a4b93b5db85 tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e0e2076-f65e-4148-a44a-9d78e5b4a338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-940181264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97f6693f-d922-429b-8049-24347b864254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55658dd304954edc9a862800840c5e9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:37:38Z,use_quota=True,user_id='4e93cf71cbe74024a082237b537070a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:38 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d25f7b0b-e38b-47f0-9ba3-8a4b93b5db85 tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad719db6-dad7-4036-a43f-f1dd5181ef37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:38 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d25f7b0b-e38b-47f0-9ba3-8a4b93b5db85 tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad719db6-dad7-4036-a43f-f1dd5181ef37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:38 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d25f7b0b-e38b-47f0-9ba3-8a4b93b5db85 tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a4588f6-d35c-40a4-a6ff-bbfbd2322308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:38 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d25f7b0b-e38b-47f0-9ba3-8a4b93b5db85 tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a4588f6-d35c-40a4-a6ff-bbfbd2322308) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97f6693f-d922-429b-8049-24347b864254', 'volume_name': 'volume-97f6693f-d922-429b-8049-24347b864254', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:38 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d25f7b0b-e38b-47f0-9ba3-8a4b93b5db85 tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39f1fc99-66aa-4a91-a262-fc58f71d915a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:38 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d25f7b0b-e38b-47f0-9ba3-8a4b93b5db85 tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39f1fc99-66aa-4a91-a262-fc58f71d915a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:38 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d25f7b0b-e38b-47f0-9ba3-8a4b93b5db85 tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33e3d1ae-7446-434e-8bbe-24a4f4cce878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:38 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-d25f7b0b-e38b-47f0-9ba3-8a4b93b5db85 tempest-ProjectReaderTests-2007028364 None] Volume 97f6693f-d922-429b-8049-24347b864254: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97f6693f-d922-429b-8049-24347b864254', 'volume_size': 1} Sep 03 14:37:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d25f7b0b-e38b-47f0-9ba3-8a4b93b5db85 tempest-ProjectReaderTests-2007028364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d25f7b0b-e38b-47f0-9ba3-8a4b93b5db85 tempest-ProjectReaderTests-2007028364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:38 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d25f7b0b-e38b-47f0-9ba3-8a4b93b5db85 tempest-ProjectReaderTests-2007028364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-940181264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97f6693f-d922-429b-8049-24347b864254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55658dd304954edc9a862800840c5e9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:37:38Z,use_quota=True,user_id='4e93cf71cbe74024a082237b537070a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:37:38 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-d25f7b0b-e38b-47f0-9ba3-8a4b93b5db85 tempest-ProjectReaderTests-2007028364 None] Creating volume 97f6693f-d922-429b-8049-24347b864254 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:37:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d25f7b0b-e38b-47f0-9ba3-8a4b93b5db85 tempest-ProjectReaderTests-2007028364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d25f7b0b-e38b-47f0-9ba3-8a4b93b5db85 tempest-ProjectReaderTests-2007028364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:38 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d25f7b0b-e38b-47f0-9ba3-8a4b93b5db85 tempest-ProjectReaderTests-2007028364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:37:38 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d25f7b0b-e38b-47f0-9ba3-8a4b93b5db85 tempest-ProjectReaderTests-2007028364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:37:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d25f7b0b-e38b-47f0-9ba3-8a4b93b5db85 tempest-ProjectReaderTests-2007028364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:38 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d25f7b0b-e38b-47f0-9ba3-8a4b93b5db85 tempest-ProjectReaderTests-2007028364 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:37:38 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-d25f7b0b-e38b-47f0-9ba3-8a4b93b5db85 tempest-ProjectReaderTests-2007028364 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:37:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d25f7b0b-e38b-47f0-9ba3-8a4b93b5db85 tempest-ProjectReaderTests-2007028364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97f6693f-d922-429b-8049-24347b864254 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:38 devstack sudo[108243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97f6693f-d922-429b-8049-24347b864254 1073741824 Sep 03 14:37:38 devstack sudo[108243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:39 devstack sudo[108243]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d25f7b0b-e38b-47f0-9ba3-8a4b93b5db85 tempest-ProjectReaderTests-2007028364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97f6693f-d922-429b-8049-24347b864254 1073741824" returned: 0 in 0.440s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d25f7b0b-e38b-47f0-9ba3-8a4b93b5db85 tempest-ProjectReaderTests-2007028364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97f6693f-d922-429b-8049-24347b864254 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:39 devstack sudo[108249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97f6693f-d922-429b-8049-24347b864254 Sep 03 14:37:39 devstack sudo[108249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:39 devstack sudo[108249]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d25f7b0b-e38b-47f0-9ba3-8a4b93b5db85 tempest-ProjectReaderTests-2007028364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97f6693f-d922-429b-8049-24347b864254" returned: 0 in 0.254s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:39 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d25f7b0b-e38b-47f0-9ba3-8a4b93b5db85 tempest-ProjectReaderTests-2007028364 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:37:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d25f7b0b-e38b-47f0-9ba3-8a4b93b5db85 tempest-ProjectReaderTests-2007028364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:39 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d25f7b0b-e38b-47f0-9ba3-8a4b93b5db85 tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33e3d1ae-7446-434e-8bbe-24a4f4cce878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97f6693f-d922-429b-8049-24347b864254', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:39 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d25f7b0b-e38b-47f0-9ba3-8a4b93b5db85 tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2346de4d-39c5-4876-ba34-82a1ecf897d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:39 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-d25f7b0b-e38b-47f0-9ba3-8a4b93b5db85 tempest-ProjectReaderTests-2007028364 None] Volume volume-97f6693f-d922-429b-8049-24347b864254 (97f6693f-d922-429b-8049-24347b864254): created successfully Sep 03 14:37:39 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d25f7b0b-e38b-47f0-9ba3-8a4b93b5db85 tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2346de4d-39c5-4876-ba34-82a1ecf897d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:39 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-d25f7b0b-e38b-47f0-9ba3-8a4b93b5db85 tempest-ProjectReaderTests-2007028364 None] Flow 'volume_create_manager' (ff1af880-ddfb-4142-a481-adeac32203c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:37:39 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-d25f7b0b-e38b-47f0-9ba3-8a4b93b5db85 tempest-ProjectReaderTests-2007028364 None] Created volume successfully. Sep 03 14:37:39 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-08e40944-8ed8-4212-9bfe-69633d85629d tempest-ProjectReaderTests-2007028364 None] Acquiring lock "cinder-97f6693f-d922-429b-8049-24347b864254-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:39 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-08e40944-8ed8-4212-9bfe-69633d85629d tempest-ProjectReaderTests-2007028364 None] Lock "cinder-97f6693f-d922-429b-8049-24347b864254-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:39 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-08e40944-8ed8-4212-9bfe-69633d85629d tempest-ProjectReaderTests-2007028364 None] Acquiring lock "cinder-quobyte-97f6693f-d922-429b-8049-24347b864254" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:39 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-08e40944-8ed8-4212-9bfe-69633d85629d tempest-ProjectReaderTests-2007028364 None] Lock "cinder-quobyte-97f6693f-d922-429b-8049-24347b864254" acquired by "delete_volume" :: waited 0.017s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:39 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d2c8e8-f410-4cc4-b267-c34f5aa8f3b5]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:37:39 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-08e40944-8ed8-4212-9bfe-69633d85629d tempest-ProjectReaderTests-2007028364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97f6693f-d922-429b-8049-24347b864254 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:39 devstack sudo[108252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97f6693f-d922-429b-8049-24347b864254 Sep 03 14:37:39 devstack sudo[108252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:40 devstack sudo[108252]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-08e40944-8ed8-4212-9bfe-69633d85629d tempest-ProjectReaderTests-2007028364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97f6693f-d922-429b-8049-24347b864254" returned: 0 in 0.403s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-08e40944-8ed8-4212-9bfe-69633d85629d tempest-ProjectReaderTests-2007028364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97f6693f-d922-429b-8049-24347b864254 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:40 devstack sudo[108257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97f6693f-d922-429b-8049-24347b864254 Sep 03 14:37:40 devstack sudo[108257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:40 devstack sudo[108257]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-08e40944-8ed8-4212-9bfe-69633d85629d tempest-ProjectReaderTests-2007028364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-97f6693f-d922-429b-8049-24347b864254" returned: 0 in 0.263s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:40 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-08e40944-8ed8-4212-9bfe-69633d85629d tempest-ProjectReaderTests-2007028364 None] Lock "cinder-quobyte-97f6693f-d922-429b-8049-24347b864254" released by "delete_volume" :: held 0.708s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:40 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-08e40944-8ed8-4212-9bfe-69633d85629d tempest-ProjectReaderTests-2007028364 None] Created reservations ['9245e179-c649-4f5b-9039-15c88d35ca50', '1fbc3119-1b97-4a36-b752-c0bb8e20399c', '8402252b-6383-406f-aca8-aeaee7b772c8', '60a3b3cd-eeb2-468b-a20e-c82823b00b71'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:37:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-08e40944-8ed8-4212-9bfe-69633d85629d tempest-ProjectReaderTests-2007028364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-08e40944-8ed8-4212-9bfe-69633d85629d tempest-ProjectReaderTests-2007028364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:40 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-08e40944-8ed8-4212-9bfe-69633d85629d tempest-ProjectReaderTests-2007028364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:37:40 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-08e40944-8ed8-4212-9bfe-69633d85629d tempest-ProjectReaderTests-2007028364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:37:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-08e40944-8ed8-4212-9bfe-69633d85629d tempest-ProjectReaderTests-2007028364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-08e40944-8ed8-4212-9bfe-69633d85629d tempest-ProjectReaderTests-2007028364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:40 devstack sudo[108260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:37:40 devstack sudo[108260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:40 devstack sudo[108260]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:40 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-08e40944-8ed8-4212-9bfe-69633d85629d tempest-ProjectReaderTests-2007028364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.264s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:40 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-08e40944-8ed8-4212-9bfe-69633d85629d tempest-ProjectReaderTests-2007028364 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:37:40 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-08e40944-8ed8-4212-9bfe-69633d85629d tempest-ProjectReaderTests-2007028364 None] Deleted volume successfully. Sep 03 14:37:40 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-08e40944-8ed8-4212-9bfe-69633d85629d tempest-ProjectReaderTests-2007028364 None] Lock "cinder-97f6693f-d922-429b-8049-24347b864254-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:41 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:SELECT=167,cinder:INSERT=73,cinder:UPDATE=252,cinder:DELETE=18 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:37:41 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:INSERT=60,cinder:UPDATE=239,cinder:SELECT=202,cinder:DELETE=22 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:37:41 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed511f95-18a7-44fe-8f9f-943100651c2f tempest-ProjectReaderTests-2007028364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:37:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ed511f95-18a7-44fe-8f9f-943100651c2f tempest-ProjectReaderTests-2007028364 None] Flow 'volume_create_manager' (bd43eb1d-a521-42a3-a608-e5084497fae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:37:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ed511f95-18a7-44fe-8f9f-943100651c2f tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9dd94a8-57f3-4139-b533-51e1f6ad66f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ed511f95-18a7-44fe-8f9f-943100651c2f tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9dd94a8-57f3-4139-b533-51e1f6ad66f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1180038357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b82999e-4044-4157-b898-6105b25e04e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55658dd304954edc9a862800840c5e9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:37:41Z,use_quota=True,user_id='4e93cf71cbe74024a082237b537070a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ed511f95-18a7-44fe-8f9f-943100651c2f tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3a76c5a-7c23-41a6-bc42-f1ff4d65b573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ed511f95-18a7-44fe-8f9f-943100651c2f tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3a76c5a-7c23-41a6-bc42-f1ff4d65b573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ed511f95-18a7-44fe-8f9f-943100651c2f tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49e7aec1-384a-4388-96d5-460a9b8457ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ed511f95-18a7-44fe-8f9f-943100651c2f tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49e7aec1-384a-4388-96d5-460a9b8457ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b82999e-4044-4157-b898-6105b25e04e7', 'volume_name': 'volume-4b82999e-4044-4157-b898-6105b25e04e7', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ed511f95-18a7-44fe-8f9f-943100651c2f tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8579809d-3303-46fe-8372-7db898bc43c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ed511f95-18a7-44fe-8f9f-943100651c2f tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8579809d-3303-46fe-8372-7db898bc43c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:41 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ed511f95-18a7-44fe-8f9f-943100651c2f tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8110a596-9383-4c26-9d3b-30dc817daabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:41 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-ed511f95-18a7-44fe-8f9f-943100651c2f tempest-ProjectReaderTests-2007028364 None] Volume 4b82999e-4044-4157-b898-6105b25e04e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b82999e-4044-4157-b898-6105b25e04e7', 'volume_size': 1} Sep 03 14:37:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ed511f95-18a7-44fe-8f9f-943100651c2f tempest-ProjectReaderTests-2007028364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ed511f95-18a7-44fe-8f9f-943100651c2f tempest-ProjectReaderTests-2007028364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ed511f95-18a7-44fe-8f9f-943100651c2f tempest-ProjectReaderTests-2007028364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1180038357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b82999e-4044-4157-b898-6105b25e04e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55658dd304954edc9a862800840c5e9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:37:41Z,use_quota=True,user_id='4e93cf71cbe74024a082237b537070a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:37:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-ed511f95-18a7-44fe-8f9f-943100651c2f tempest-ProjectReaderTests-2007028364 None] Creating volume 4b82999e-4044-4157-b898-6105b25e04e7 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:37:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ed511f95-18a7-44fe-8f9f-943100651c2f tempest-ProjectReaderTests-2007028364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ed511f95-18a7-44fe-8f9f-943100651c2f tempest-ProjectReaderTests-2007028364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ed511f95-18a7-44fe-8f9f-943100651c2f tempest-ProjectReaderTests-2007028364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:37:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ed511f95-18a7-44fe-8f9f-943100651c2f tempest-ProjectReaderTests-2007028364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:37:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ed511f95-18a7-44fe-8f9f-943100651c2f tempest-ProjectReaderTests-2007028364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:41 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ed511f95-18a7-44fe-8f9f-943100651c2f tempest-ProjectReaderTests-2007028364 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:37:41 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-ed511f95-18a7-44fe-8f9f-943100651c2f tempest-ProjectReaderTests-2007028364 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:37:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ed511f95-18a7-44fe-8f9f-943100651c2f tempest-ProjectReaderTests-2007028364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4b82999e-4044-4157-b898-6105b25e04e7 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:41 devstack sudo[108263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4b82999e-4044-4157-b898-6105b25e04e7 1073741824 Sep 03 14:37:41 devstack sudo[108263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:41 devstack sudo[108263]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:41 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ed511f95-18a7-44fe-8f9f-943100651c2f tempest-ProjectReaderTests-2007028364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4b82999e-4044-4157-b898-6105b25e04e7 1073741824" returned: 0 in 0.475s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ed511f95-18a7-44fe-8f9f-943100651c2f tempest-ProjectReaderTests-2007028364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4b82999e-4044-4157-b898-6105b25e04e7 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:42 devstack sudo[108269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4b82999e-4044-4157-b898-6105b25e04e7 Sep 03 14:37:42 devstack sudo[108269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:42 devstack sudo[108269]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ed511f95-18a7-44fe-8f9f-943100651c2f tempest-ProjectReaderTests-2007028364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4b82999e-4044-4157-b898-6105b25e04e7" returned: 0 in 0.279s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:42 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ed511f95-18a7-44fe-8f9f-943100651c2f tempest-ProjectReaderTests-2007028364 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:37:42 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ed511f95-18a7-44fe-8f9f-943100651c2f tempest-ProjectReaderTests-2007028364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ed511f95-18a7-44fe-8f9f-943100651c2f tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8110a596-9383-4c26-9d3b-30dc817daabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b82999e-4044-4157-b898-6105b25e04e7', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ed511f95-18a7-44fe-8f9f-943100651c2f tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61d58ed3-36fd-4917-ab13-0d81af1a80ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:42 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-ed511f95-18a7-44fe-8f9f-943100651c2f tempest-ProjectReaderTests-2007028364 None] Volume volume-4b82999e-4044-4157-b898-6105b25e04e7 (4b82999e-4044-4157-b898-6105b25e04e7): created successfully Sep 03 14:37:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ed511f95-18a7-44fe-8f9f-943100651c2f tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61d58ed3-36fd-4917-ab13-0d81af1a80ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:42 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ed511f95-18a7-44fe-8f9f-943100651c2f tempest-ProjectReaderTests-2007028364 None] Flow 'volume_create_manager' (bd43eb1d-a521-42a3-a608-e5084497fae8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:37:42 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-ed511f95-18a7-44fe-8f9f-943100651c2f tempest-ProjectReaderTests-2007028364 None] Created volume successfully. Sep 03 14:37:43 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1faea3da-fe86-48bf-ac70-42ee4b1e8549 tempest-ProjectReaderTests-2007028364 None] Acquiring lock "cinder-4b82999e-4044-4157-b898-6105b25e04e7-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:43 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1faea3da-fe86-48bf-ac70-42ee4b1e8549 tempest-ProjectReaderTests-2007028364 None] Lock "cinder-4b82999e-4044-4157-b898-6105b25e04e7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:43 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1faea3da-fe86-48bf-ac70-42ee4b1e8549 tempest-ProjectReaderTests-2007028364 None] Acquiring lock "cinder-quobyte-4b82999e-4044-4157-b898-6105b25e04e7" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:43 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1faea3da-fe86-48bf-ac70-42ee4b1e8549 tempest-ProjectReaderTests-2007028364 None] Lock "cinder-quobyte-4b82999e-4044-4157-b898-6105b25e04e7" acquired by "delete_volume" :: waited 0.015s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:43 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0913a0-ed1b-4e8b-a552-eb60c1d8778d]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:37:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1faea3da-fe86-48bf-ac70-42ee4b1e8549 tempest-ProjectReaderTests-2007028364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4b82999e-4044-4157-b898-6105b25e04e7 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:43 devstack sudo[108272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4b82999e-4044-4157-b898-6105b25e04e7 Sep 03 14:37:43 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:44 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1faea3da-fe86-48bf-ac70-42ee4b1e8549 tempest-ProjectReaderTests-2007028364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4b82999e-4044-4157-b898-6105b25e04e7" returned: 0 in 0.361s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1faea3da-fe86-48bf-ac70-42ee4b1e8549 tempest-ProjectReaderTests-2007028364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4b82999e-4044-4157-b898-6105b25e04e7 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:44 devstack sudo[108277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4b82999e-4044-4157-b898-6105b25e04e7 Sep 03 14:37:44 devstack sudo[108277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:44 devstack sudo[108277]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1faea3da-fe86-48bf-ac70-42ee4b1e8549 tempest-ProjectReaderTests-2007028364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-4b82999e-4044-4157-b898-6105b25e04e7" returned: 0 in 0.265s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:44 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1faea3da-fe86-48bf-ac70-42ee4b1e8549 tempest-ProjectReaderTests-2007028364 None] Lock "cinder-quobyte-4b82999e-4044-4157-b898-6105b25e04e7" released by "delete_volume" :: held 0.679s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:44 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-1faea3da-fe86-48bf-ac70-42ee4b1e8549 tempest-ProjectReaderTests-2007028364 None] Created reservations ['86afb4ad-5bcc-4e06-979d-d5510ce2bbbf', '1f8a7f45-a09b-446a-872d-1f10561ddf5b', 'e3491d2b-40f1-4016-9dc4-73cee4b11a8c', 'a4fb75bc-16f0-49e7-a4c9-cb74384ecbc3'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:37:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1faea3da-fe86-48bf-ac70-42ee4b1e8549 tempest-ProjectReaderTests-2007028364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1faea3da-fe86-48bf-ac70-42ee4b1e8549 tempest-ProjectReaderTests-2007028364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:44 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-1faea3da-fe86-48bf-ac70-42ee4b1e8549 tempest-ProjectReaderTests-2007028364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:37:44 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-1faea3da-fe86-48bf-ac70-42ee4b1e8549 tempest-ProjectReaderTests-2007028364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:37:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-1faea3da-fe86-48bf-ac70-42ee4b1e8549 tempest-ProjectReaderTests-2007028364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1faea3da-fe86-48bf-ac70-42ee4b1e8549 tempest-ProjectReaderTests-2007028364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:44 devstack sudo[108280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:37:44 devstack sudo[108280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:44 devstack sudo[108280]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:44 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-1faea3da-fe86-48bf-ac70-42ee4b1e8549 tempest-ProjectReaderTests-2007028364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.247s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:44 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-1faea3da-fe86-48bf-ac70-42ee4b1e8549 tempest-ProjectReaderTests-2007028364 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:37:44 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-1faea3da-fe86-48bf-ac70-42ee4b1e8549 tempest-ProjectReaderTests-2007028364 None] Deleted volume successfully. Sep 03 14:37:44 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-1faea3da-fe86-48bf-ac70-42ee4b1e8549 tempest-ProjectReaderTests-2007028364 None] Lock "cinder-4b82999e-4044-4157-b898-6105b25e04e7-delete_volume" released by "delete_volume" :: held 1.160s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:45 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-508ac56b-d5cd-4761-bb7c-26fd745cc2e4 tempest-ProjectReaderTests-2007028364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:37:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-508ac56b-d5cd-4761-bb7c-26fd745cc2e4 tempest-ProjectReaderTests-2007028364 None] Flow 'volume_create_manager' (144e97bf-b6c2-478c-b658-19d7a18816ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:37:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-508ac56b-d5cd-4761-bb7c-26fd745cc2e4 tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72190179-7f76-43e2-9dae-e1feca859d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-508ac56b-d5cd-4761-bb7c-26fd745cc2e4 tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72190179-7f76-43e2-9dae-e1feca859d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-388120396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd4fef56-8276-4e34-b3b4-928d4ec17d0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55658dd304954edc9a862800840c5e9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:37:45Z,use_quota=True,user_id='4e93cf71cbe74024a082237b537070a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-508ac56b-d5cd-4761-bb7c-26fd745cc2e4 tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e0f7d56-c396-41ec-a038-dea77f6e8055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-508ac56b-d5cd-4761-bb7c-26fd745cc2e4 tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e0f7d56-c396-41ec-a038-dea77f6e8055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-508ac56b-d5cd-4761-bb7c-26fd745cc2e4 tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b93466f6-4dee-4ccf-8dda-1301a0619cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-508ac56b-d5cd-4761-bb7c-26fd745cc2e4 tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b93466f6-4dee-4ccf-8dda-1301a0619cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd4fef56-8276-4e34-b3b4-928d4ec17d0b', 'volume_name': 'volume-cd4fef56-8276-4e34-b3b4-928d4ec17d0b', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-508ac56b-d5cd-4761-bb7c-26fd745cc2e4 tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c247d40e-efdb-4144-92db-e645648c83f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-508ac56b-d5cd-4761-bb7c-26fd745cc2e4 tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c247d40e-efdb-4144-92db-e645648c83f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:45 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-508ac56b-d5cd-4761-bb7c-26fd745cc2e4 tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f32a8a0-db89-44f7-9313-68f7367ea7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:45 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-508ac56b-d5cd-4761-bb7c-26fd745cc2e4 tempest-ProjectReaderTests-2007028364 None] Volume cd4fef56-8276-4e34-b3b4-928d4ec17d0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd4fef56-8276-4e34-b3b4-928d4ec17d0b', 'volume_size': 1} Sep 03 14:37:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-508ac56b-d5cd-4761-bb7c-26fd745cc2e4 tempest-ProjectReaderTests-2007028364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-508ac56b-d5cd-4761-bb7c-26fd745cc2e4 tempest-ProjectReaderTests-2007028364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:45 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-508ac56b-d5cd-4761-bb7c-26fd745cc2e4 tempest-ProjectReaderTests-2007028364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-388120396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd4fef56-8276-4e34-b3b4-928d4ec17d0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55658dd304954edc9a862800840c5e9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:37:45Z,use_quota=True,user_id='4e93cf71cbe74024a082237b537070a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:37:45 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-508ac56b-d5cd-4761-bb7c-26fd745cc2e4 tempest-ProjectReaderTests-2007028364 None] Creating volume cd4fef56-8276-4e34-b3b4-928d4ec17d0b {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:37:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-508ac56b-d5cd-4761-bb7c-26fd745cc2e4 tempest-ProjectReaderTests-2007028364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-508ac56b-d5cd-4761-bb7c-26fd745cc2e4 tempest-ProjectReaderTests-2007028364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:45 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-508ac56b-d5cd-4761-bb7c-26fd745cc2e4 tempest-ProjectReaderTests-2007028364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:37:45 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-508ac56b-d5cd-4761-bb7c-26fd745cc2e4 tempest-ProjectReaderTests-2007028364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:37:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-508ac56b-d5cd-4761-bb7c-26fd745cc2e4 tempest-ProjectReaderTests-2007028364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:45 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-508ac56b-d5cd-4761-bb7c-26fd745cc2e4 tempest-ProjectReaderTests-2007028364 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:37:45 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-508ac56b-d5cd-4761-bb7c-26fd745cc2e4 tempest-ProjectReaderTests-2007028364 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:37:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-508ac56b-d5cd-4761-bb7c-26fd745cc2e4 tempest-ProjectReaderTests-2007028364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-cd4fef56-8276-4e34-b3b4-928d4ec17d0b 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:45 devstack sudo[108283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-cd4fef56-8276-4e34-b3b4-928d4ec17d0b 1073741824 Sep 03 14:37:45 devstack sudo[108283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:45 devstack sudo[108283]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-508ac56b-d5cd-4761-bb7c-26fd745cc2e4 tempest-ProjectReaderTests-2007028364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-cd4fef56-8276-4e34-b3b4-928d4ec17d0b 1073741824" returned: 0 in 0.491s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:45 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-508ac56b-d5cd-4761-bb7c-26fd745cc2e4 tempest-ProjectReaderTests-2007028364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-cd4fef56-8276-4e34-b3b4-928d4ec17d0b {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:45 devstack sudo[108289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-cd4fef56-8276-4e34-b3b4-928d4ec17d0b Sep 03 14:37:45 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:46 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-508ac56b-d5cd-4761-bb7c-26fd745cc2e4 tempest-ProjectReaderTests-2007028364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-cd4fef56-8276-4e34-b3b4-928d4ec17d0b" returned: 0 in 0.285s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:46 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-508ac56b-d5cd-4761-bb7c-26fd745cc2e4 tempest-ProjectReaderTests-2007028364 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:37:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-508ac56b-d5cd-4761-bb7c-26fd745cc2e4 tempest-ProjectReaderTests-2007028364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:46 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-508ac56b-d5cd-4761-bb7c-26fd745cc2e4 tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f32a8a0-db89-44f7-9313-68f7367ea7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd4fef56-8276-4e34-b3b4-928d4ec17d0b', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:46 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-508ac56b-d5cd-4761-bb7c-26fd745cc2e4 tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66abec7f-9e7e-4fa9-9b23-4e1201514fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:46 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-508ac56b-d5cd-4761-bb7c-26fd745cc2e4 tempest-ProjectReaderTests-2007028364 None] Volume volume-cd4fef56-8276-4e34-b3b4-928d4ec17d0b (cd4fef56-8276-4e34-b3b4-928d4ec17d0b): created successfully Sep 03 14:37:46 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-508ac56b-d5cd-4761-bb7c-26fd745cc2e4 tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66abec7f-9e7e-4fa9-9b23-4e1201514fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:46 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-508ac56b-d5cd-4761-bb7c-26fd745cc2e4 tempest-ProjectReaderTests-2007028364 None] Flow 'volume_create_manager' (144e97bf-b6c2-478c-b658-19d7a18816ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:37:46 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-508ac56b-d5cd-4761-bb7c-26fd745cc2e4 tempest-ProjectReaderTests-2007028364 None] Created volume successfully. Sep 03 14:37:47 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-829e0a1e-d2c6-4218-9d00-4313fa04e77c tempest-ProjectReaderTests-2007028364 None] Acquiring lock "cinder-cd4fef56-8276-4e34-b3b4-928d4ec17d0b-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:47 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-829e0a1e-d2c6-4218-9d00-4313fa04e77c tempest-ProjectReaderTests-2007028364 None] Lock "cinder-cd4fef56-8276-4e34-b3b4-928d4ec17d0b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:47 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-829e0a1e-d2c6-4218-9d00-4313fa04e77c tempest-ProjectReaderTests-2007028364 None] Acquiring lock "cinder-quobyte-cd4fef56-8276-4e34-b3b4-928d4ec17d0b" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:47 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-829e0a1e-d2c6-4218-9d00-4313fa04e77c tempest-ProjectReaderTests-2007028364 None] Lock "cinder-quobyte-cd4fef56-8276-4e34-b3b4-928d4ec17d0b" acquired by "delete_volume" :: waited 0.019s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:47 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab81c452-b148-4041-a5f3-2ee32147b9bf]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:37:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-829e0a1e-d2c6-4218-9d00-4313fa04e77c tempest-ProjectReaderTests-2007028364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-cd4fef56-8276-4e34-b3b4-928d4ec17d0b {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:47 devstack sudo[108293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-cd4fef56-8276-4e34-b3b4-928d4ec17d0b Sep 03 14:37:47 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:47 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-829e0a1e-d2c6-4218-9d00-4313fa04e77c tempest-ProjectReaderTests-2007028364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-cd4fef56-8276-4e34-b3b4-928d4ec17d0b" returned: 0 in 0.375s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:47 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-829e0a1e-d2c6-4218-9d00-4313fa04e77c tempest-ProjectReaderTests-2007028364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-cd4fef56-8276-4e34-b3b4-928d4ec17d0b {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:47 devstack sudo[108298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-cd4fef56-8276-4e34-b3b4-928d4ec17d0b Sep 03 14:37:47 devstack sudo[108298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:48 devstack sudo[108298]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-829e0a1e-d2c6-4218-9d00-4313fa04e77c tempest-ProjectReaderTests-2007028364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-cd4fef56-8276-4e34-b3b4-928d4ec17d0b" returned: 0 in 0.250s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:48 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-829e0a1e-d2c6-4218-9d00-4313fa04e77c tempest-ProjectReaderTests-2007028364 None] Lock "cinder-quobyte-cd4fef56-8276-4e34-b3b4-928d4ec17d0b" released by "delete_volume" :: held 0.674s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:48 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-829e0a1e-d2c6-4218-9d00-4313fa04e77c tempest-ProjectReaderTests-2007028364 None] Created reservations ['e93db19f-ca3f-44b3-be8e-c7900f196ece', '3c6294f9-71ea-404b-9a5b-481973057fc0', 'aba75691-b66d-435f-90b0-c21a3bda4b82', '31e2238c-2daf-41a8-8c5e-1fc5d9ebbcad'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:37:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-829e0a1e-d2c6-4218-9d00-4313fa04e77c tempest-ProjectReaderTests-2007028364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-829e0a1e-d2c6-4218-9d00-4313fa04e77c tempest-ProjectReaderTests-2007028364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:48 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-829e0a1e-d2c6-4218-9d00-4313fa04e77c tempest-ProjectReaderTests-2007028364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:37:48 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-829e0a1e-d2c6-4218-9d00-4313fa04e77c tempest-ProjectReaderTests-2007028364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:37:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-829e0a1e-d2c6-4218-9d00-4313fa04e77c tempest-ProjectReaderTests-2007028364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-829e0a1e-d2c6-4218-9d00-4313fa04e77c tempest-ProjectReaderTests-2007028364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:48 devstack sudo[108301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:37:48 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:48 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:48 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-829e0a1e-d2c6-4218-9d00-4313fa04e77c tempest-ProjectReaderTests-2007028364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.269s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:48 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-829e0a1e-d2c6-4218-9d00-4313fa04e77c tempest-ProjectReaderTests-2007028364 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:37:48 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-829e0a1e-d2c6-4218-9d00-4313fa04e77c tempest-ProjectReaderTests-2007028364 None] Deleted volume successfully. Sep 03 14:37:48 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-829e0a1e-d2c6-4218-9d00-4313fa04e77c tempest-ProjectReaderTests-2007028364 None] Lock "cinder-cd4fef56-8276-4e34-b3b4-928d4ec17d0b-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:49 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-0809186c-415f-4a91-add1-73757a70110d tempest-ProjectReaderTests-2007028364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:37:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0809186c-415f-4a91-add1-73757a70110d tempest-ProjectReaderTests-2007028364 None] Flow 'volume_create_manager' (5e0db196-229c-407f-b196-05cc9a22bb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:37:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0809186c-415f-4a91-add1-73757a70110d tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa2a264b-6f4b-464f-880d-d887762cd232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0809186c-415f-4a91-add1-73757a70110d tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa2a264b-6f4b-464f-880d-d887762cd232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:37:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1265338617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcfda6d9-d6d1-423f-8a6c-1ab68d44fa91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55658dd304954edc9a862800840c5e9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:37:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:37:49Z,use_quota=True,user_id='4e93cf71cbe74024a082237b537070a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0809186c-415f-4a91-add1-73757a70110d tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff0d52b-47cb-4f67-8a5a-ad53b493cf94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0809186c-415f-4a91-add1-73757a70110d tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff0d52b-47cb-4f67-8a5a-ad53b493cf94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0809186c-415f-4a91-add1-73757a70110d tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3142824a-522f-420a-9774-f1a3821ec9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0809186c-415f-4a91-add1-73757a70110d tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3142824a-522f-420a-9774-f1a3821ec9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcfda6d9-d6d1-423f-8a6c-1ab68d44fa91', 'volume_name': 'volume-dcfda6d9-d6d1-423f-8a6c-1ab68d44fa91', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0809186c-415f-4a91-add1-73757a70110d tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (987843e2-1fe9-4feb-9103-15156690a823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0809186c-415f-4a91-add1-73757a70110d tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (987843e2-1fe9-4feb-9103-15156690a823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0809186c-415f-4a91-add1-73757a70110d tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2386aa-eb40-4794-af1e-a92a849e587e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:49 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-0809186c-415f-4a91-add1-73757a70110d tempest-ProjectReaderTests-2007028364 None] Volume dcfda6d9-d6d1-423f-8a6c-1ab68d44fa91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcfda6d9-d6d1-423f-8a6c-1ab68d44fa91', 'volume_size': 1} Sep 03 14:37:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-0809186c-415f-4a91-add1-73757a70110d tempest-ProjectReaderTests-2007028364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-0809186c-415f-4a91-add1-73757a70110d tempest-ProjectReaderTests-2007028364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:49 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-0809186c-415f-4a91-add1-73757a70110d tempest-ProjectReaderTests-2007028364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:37:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1265338617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcfda6d9-d6d1-423f-8a6c-1ab68d44fa91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55658dd304954edc9a862800840c5e9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:37:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:37:49Z,use_quota=True,user_id='4e93cf71cbe74024a082237b537070a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:37:49 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-0809186c-415f-4a91-add1-73757a70110d tempest-ProjectReaderTests-2007028364 None] Creating volume dcfda6d9-d6d1-423f-8a6c-1ab68d44fa91 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:37:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-0809186c-415f-4a91-add1-73757a70110d tempest-ProjectReaderTests-2007028364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-0809186c-415f-4a91-add1-73757a70110d tempest-ProjectReaderTests-2007028364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:49 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-0809186c-415f-4a91-add1-73757a70110d tempest-ProjectReaderTests-2007028364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:37:49 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-0809186c-415f-4a91-add1-73757a70110d tempest-ProjectReaderTests-2007028364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:37:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-0809186c-415f-4a91-add1-73757a70110d tempest-ProjectReaderTests-2007028364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:49 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-0809186c-415f-4a91-add1-73757a70110d tempest-ProjectReaderTests-2007028364 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:37:49 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-0809186c-415f-4a91-add1-73757a70110d tempest-ProjectReaderTests-2007028364 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:37:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0809186c-415f-4a91-add1-73757a70110d tempest-ProjectReaderTests-2007028364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dcfda6d9-d6d1-423f-8a6c-1ab68d44fa91 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:49 devstack sudo[108304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dcfda6d9-d6d1-423f-8a6c-1ab68d44fa91 1073741824 Sep 03 14:37:49 devstack sudo[108304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:49 devstack sudo[108304]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0809186c-415f-4a91-add1-73757a70110d tempest-ProjectReaderTests-2007028364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dcfda6d9-d6d1-423f-8a6c-1ab68d44fa91 1073741824" returned: 0 in 0.423s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0809186c-415f-4a91-add1-73757a70110d tempest-ProjectReaderTests-2007028364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dcfda6d9-d6d1-423f-8a6c-1ab68d44fa91 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:49 devstack sudo[108310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dcfda6d9-d6d1-423f-8a6c-1ab68d44fa91 Sep 03 14:37:49 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:49 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-0809186c-415f-4a91-add1-73757a70110d tempest-ProjectReaderTests-2007028364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dcfda6d9-d6d1-423f-8a6c-1ab68d44fa91" returned: 0 in 0.263s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:49 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-0809186c-415f-4a91-add1-73757a70110d tempest-ProjectReaderTests-2007028364 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:37:49 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-0809186c-415f-4a91-add1-73757a70110d tempest-ProjectReaderTests-2007028364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0809186c-415f-4a91-add1-73757a70110d tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2386aa-eb40-4794-af1e-a92a849e587e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcfda6d9-d6d1-423f-8a6c-1ab68d44fa91', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0809186c-415f-4a91-add1-73757a70110d tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d43c3d2-a8f6-40c4-bb03-9b3b5276e8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:49 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-0809186c-415f-4a91-add1-73757a70110d tempest-ProjectReaderTests-2007028364 None] Volume volume-dcfda6d9-d6d1-423f-8a6c-1ab68d44fa91 (dcfda6d9-d6d1-423f-8a6c-1ab68d44fa91): created successfully Sep 03 14:37:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0809186c-415f-4a91-add1-73757a70110d tempest-ProjectReaderTests-2007028364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d43c3d2-a8f6-40c4-bb03-9b3b5276e8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:49 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-0809186c-415f-4a91-add1-73757a70110d tempest-ProjectReaderTests-2007028364 None] Flow 'volume_create_manager' (5e0db196-229c-407f-b196-05cc9a22bb63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:37:49 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-0809186c-415f-4a91-add1-73757a70110d tempest-ProjectReaderTests-2007028364 None] Created volume successfully. Sep 03 14:37:50 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ecce431e-2fcc-4ab9-964b-7ea11fb77019 tempest-ProjectReaderTests-2007028364 None] Acquiring lock "cinder-dcfda6d9-d6d1-423f-8a6c-1ab68d44fa91-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:50 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ecce431e-2fcc-4ab9-964b-7ea11fb77019 tempest-ProjectReaderTests-2007028364 None] Lock "cinder-dcfda6d9-d6d1-423f-8a6c-1ab68d44fa91-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:50 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ecce431e-2fcc-4ab9-964b-7ea11fb77019 tempest-ProjectReaderTests-2007028364 None] Acquiring lock "cinder-quobyte-dcfda6d9-d6d1-423f-8a6c-1ab68d44fa91" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:50 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ecce431e-2fcc-4ab9-964b-7ea11fb77019 tempest-ProjectReaderTests-2007028364 None] Lock "cinder-quobyte-dcfda6d9-d6d1-423f-8a6c-1ab68d44fa91" acquired by "delete_volume" :: waited 0.016s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:50 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0bc2fc-4d8b-49fc-887d-9ff5890c0d86]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:37:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ecce431e-2fcc-4ab9-964b-7ea11fb77019 tempest-ProjectReaderTests-2007028364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dcfda6d9-d6d1-423f-8a6c-1ab68d44fa91 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:50 devstack sudo[108314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dcfda6d9-d6d1-423f-8a6c-1ab68d44fa91 Sep 03 14:37:50 devstack sudo[108314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:50 devstack sudo[108314]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ecce431e-2fcc-4ab9-964b-7ea11fb77019 tempest-ProjectReaderTests-2007028364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dcfda6d9-d6d1-423f-8a6c-1ab68d44fa91" returned: 0 in 0.357s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ecce431e-2fcc-4ab9-964b-7ea11fb77019 tempest-ProjectReaderTests-2007028364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dcfda6d9-d6d1-423f-8a6c-1ab68d44fa91 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:50 devstack sudo[108319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dcfda6d9-d6d1-423f-8a6c-1ab68d44fa91 Sep 03 14:37:50 devstack sudo[108319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:50 devstack sudo[108319]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:50 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ecce431e-2fcc-4ab9-964b-7ea11fb77019 tempest-ProjectReaderTests-2007028364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-dcfda6d9-d6d1-423f-8a6c-1ab68d44fa91" returned: 0 in 0.290s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:50 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ecce431e-2fcc-4ab9-964b-7ea11fb77019 tempest-ProjectReaderTests-2007028364 None] Lock "cinder-quobyte-dcfda6d9-d6d1-423f-8a6c-1ab68d44fa91" released by "delete_volume" :: held 0.709s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:51 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-ecce431e-2fcc-4ab9-964b-7ea11fb77019 tempest-ProjectReaderTests-2007028364 None] Created reservations ['e5df4bc0-e064-4459-8394-179cba00390b', '032dc431-61c4-4e0a-906e-923df00a5fa8', '4f2b1e90-0c65-4512-b4a6-949b5b4fe67c', '783044cd-4c23-4b2a-a444-86ebb2601988'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:37:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ecce431e-2fcc-4ab9-964b-7ea11fb77019 tempest-ProjectReaderTests-2007028364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ecce431e-2fcc-4ab9-964b-7ea11fb77019 tempest-ProjectReaderTests-2007028364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ecce431e-2fcc-4ab9-964b-7ea11fb77019 tempest-ProjectReaderTests-2007028364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:37:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ecce431e-2fcc-4ab9-964b-7ea11fb77019 tempest-ProjectReaderTests-2007028364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:37:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ecce431e-2fcc-4ab9-964b-7ea11fb77019 tempest-ProjectReaderTests-2007028364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ecce431e-2fcc-4ab9-964b-7ea11fb77019 tempest-ProjectReaderTests-2007028364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:51 devstack sudo[108322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:37:51 devstack sudo[108322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:51 devstack sudo[108322]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ecce431e-2fcc-4ab9-964b-7ea11fb77019 tempest-ProjectReaderTests-2007028364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.253s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:51 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-ecce431e-2fcc-4ab9-964b-7ea11fb77019 tempest-ProjectReaderTests-2007028364 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:37:51 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-ecce431e-2fcc-4ab9-964b-7ea11fb77019 tempest-ProjectReaderTests-2007028364 None] Deleted volume successfully. Sep 03 14:37:51 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-ecce431e-2fcc-4ab9-964b-7ea11fb77019 tempest-ProjectReaderTests-2007028364 None] Lock "cinder-dcfda6d9-d6d1-423f-8a6c-1ab68d44fa91-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:37:51 devstack cinder-volume[87007]: DEBUG oslo_service.periodic_task [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87007) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 14:37:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:37:51 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:37:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:51 devstack sudo[108325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:37:51 devstack sudo[108325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:51 devstack sudo[108325]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:51 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.294s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:51 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:37:51 devstack cinder-volume[87007]: DEBUG oslo_service.periodic_task [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] Running periodic task VolumeManager._thread_info {{(pid=87007) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 14:37:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] thread count: 28 {{(pid=87007) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 14:37:51 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-ffa33d80-2400-485a-acf1-40aab74d61c9 None None] thread info: [<_MainThread(MainThread, started 123689171054720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87007) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 14:37:55 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa654c5a-c688-4ef2-b222-bc6e430d4808 tempest-SnapshotDependencyTests-865664036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:37:55 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fa654c5a-c688-4ef2-b222-bc6e430d4808 tempest-SnapshotDependencyTests-865664036 None] Flow 'volume_create_manager' (cb331e90-5073-440a-b248-fabb8cae0cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:37:55 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fa654c5a-c688-4ef2-b222-bc6e430d4808 tempest-SnapshotDependencyTests-865664036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85b8a507-c3bc-470b-afac-cad3c7a2ad47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:55 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fa654c5a-c688-4ef2-b222-bc6e430d4808 tempest-SnapshotDependencyTests-865664036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85b8a507-c3bc-470b-afac-cad3c7a2ad47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-940484701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63fed748-4dfa-4c14-9f3a-999bd2f3c664,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0b32834a0e846b9bf32a5990d265da3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:37:56Z,use_quota=True,user_id='4c0ee0adf81a48758e6873e832ea62b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:55 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fa654c5a-c688-4ef2-b222-bc6e430d4808 tempest-SnapshotDependencyTests-865664036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bcd62a7-646d-4ba7-a5bc-db37ef6a53b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:55 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fa654c5a-c688-4ef2-b222-bc6e430d4808 tempest-SnapshotDependencyTests-865664036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bcd62a7-646d-4ba7-a5bc-db37ef6a53b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:55 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fa654c5a-c688-4ef2-b222-bc6e430d4808 tempest-SnapshotDependencyTests-865664036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df01ac8f-cf9e-493a-9b92-fab54e073681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:55 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fa654c5a-c688-4ef2-b222-bc6e430d4808 tempest-SnapshotDependencyTests-865664036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df01ac8f-cf9e-493a-9b92-fab54e073681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63fed748-4dfa-4c14-9f3a-999bd2f3c664', 'volume_name': 'volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:55 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fa654c5a-c688-4ef2-b222-bc6e430d4808 tempest-SnapshotDependencyTests-865664036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (418d3d93-93c2-40c5-b91f-acd41dc17dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:55 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fa654c5a-c688-4ef2-b222-bc6e430d4808 tempest-SnapshotDependencyTests-865664036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (418d3d93-93c2-40c5-b91f-acd41dc17dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:55 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fa654c5a-c688-4ef2-b222-bc6e430d4808 tempest-SnapshotDependencyTests-865664036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e75e987-98e7-4103-80a4-8db3216198b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:55 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-fa654c5a-c688-4ef2-b222-bc6e430d4808 tempest-SnapshotDependencyTests-865664036 None] Volume 63fed748-4dfa-4c14-9f3a-999bd2f3c664: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664', 'volume_size': 1} Sep 03 14:37:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-fa654c5a-c688-4ef2-b222-bc6e430d4808 tempest-SnapshotDependencyTests-865664036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-fa654c5a-c688-4ef2-b222-bc6e430d4808 tempest-SnapshotDependencyTests-865664036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:55 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-fa654c5a-c688-4ef2-b222-bc6e430d4808 tempest-SnapshotDependencyTests-865664036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-940484701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63fed748-4dfa-4c14-9f3a-999bd2f3c664,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0b32834a0e846b9bf32a5990d265da3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:37:56Z,use_quota=True,user_id='4c0ee0adf81a48758e6873e832ea62b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)}" {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 14:37:55 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-fa654c5a-c688-4ef2-b222-bc6e430d4808 tempest-SnapshotDependencyTests-865664036 None] Creating volume 63fed748-4dfa-4c14-9f3a-999bd2f3c664 {{(pid=87007) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 14:37:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-fa654c5a-c688-4ef2-b222-bc6e430d4808 tempest-SnapshotDependencyTests-865664036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-fa654c5a-c688-4ef2-b222-bc6e430d4808 tempest-SnapshotDependencyTests-865664036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:55 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-fa654c5a-c688-4ef2-b222-bc6e430d4808 tempest-SnapshotDependencyTests-865664036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:37:55 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-fa654c5a-c688-4ef2-b222-bc6e430d4808 tempest-SnapshotDependencyTests-865664036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:37:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-fa654c5a-c688-4ef2-b222-bc6e430d4808 tempest-SnapshotDependencyTests-865664036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:55 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-fa654c5a-c688-4ef2-b222-bc6e430d4808 tempest-SnapshotDependencyTests-865664036 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:37:55 devstack cinder-volume[87007]: INFO cinder.volume.drivers.remotefs [None req-fa654c5a-c688-4ef2-b222-bc6e430d4808 tempest-SnapshotDependencyTests-865664036 None] casted to osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 Sep 03 14:37:55 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fa654c5a-c688-4ef2-b222-bc6e430d4808 tempest-SnapshotDependencyTests-865664036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664 1073741824 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:55 devstack sudo[108328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664 1073741824 Sep 03 14:37:55 devstack sudo[108328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:56 devstack sudo[108328]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fa654c5a-c688-4ef2-b222-bc6e430d4808 tempest-SnapshotDependencyTests-865664036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664 1073741824" returned: 0 in 0.398s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fa654c5a-c688-4ef2-b222-bc6e430d4808 tempest-SnapshotDependencyTests-865664036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:56 devstack sudo[108334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664 Sep 03 14:37:56 devstack sudo[108334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:56 devstack sudo[108334]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-fa654c5a-c688-4ef2-b222-bc6e430d4808 tempest-SnapshotDependencyTests-865664036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664" returned: 0 in 0.243s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:56 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-fa654c5a-c688-4ef2-b222-bc6e430d4808 tempest-SnapshotDependencyTests-865664036 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'} {{(pid=87007) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 14:37:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-fa654c5a-c688-4ef2-b222-bc6e430d4808 tempest-SnapshotDependencyTests-865664036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:56 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fa654c5a-c688-4ef2-b222-bc6e430d4808 tempest-SnapshotDependencyTests-865664036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e75e987-98e7-4103-80a4-8db3216198b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664', 'volume_size': 1}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:56 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fa654c5a-c688-4ef2-b222-bc6e430d4808 tempest-SnapshotDependencyTests-865664036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b488f2a-aed2-4366-ae9c-32e2e67a108b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:56 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-fa654c5a-c688-4ef2-b222-bc6e430d4808 tempest-SnapshotDependencyTests-865664036 None] Volume volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664 (63fed748-4dfa-4c14-9f3a-999bd2f3c664): created successfully Sep 03 14:37:56 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fa654c5a-c688-4ef2-b222-bc6e430d4808 tempest-SnapshotDependencyTests-865664036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b488f2a-aed2-4366-ae9c-32e2e67a108b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:56 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-fa654c5a-c688-4ef2-b222-bc6e430d4808 tempest-SnapshotDependencyTests-865664036 None] Flow 'volume_create_manager' (cb331e90-5073-440a-b248-fabb8cae0cda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:37:56 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-fa654c5a-c688-4ef2-b222-bc6e430d4808 tempest-SnapshotDependencyTests-865664036 None] Created volume successfully. Sep 03 14:37:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-5a087356-5a77-4636-8937-bc53bc599358 tempest-SnapshotDependencyTests-865664036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:56 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-5a087356-5a77-4636-8937-bc53bc599358 tempest-SnapshotDependencyTests-865664036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:56 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-5a087356-5a77-4636-8937-bc53bc599358 tempest-SnapshotDependencyTests-865664036 None] Creating offline snapshot 4be88869-7580-485d-992e-9d43bcbd53fc of volume 63fed748-4dfa-4c14-9f3a-999bd2f3c664 {{(pid=87007) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 14:37:57 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[884ea936-2708-48f9-b548-1cd060e414cd]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:37:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5a087356-5a77-4636-8937-bc53bc599358 tempest-SnapshotDependencyTests-865664036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:57 devstack sudo[108338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664 Sep 03 14:37:57 devstack sudo[108338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:57 devstack sudo[108338]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5a087356-5a77-4636-8937-bc53bc599358 tempest-SnapshotDependencyTests-865664036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664" returned: 0 in 0.356s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5a087356-5a77-4636-8937-bc53bc599358 tempest-SnapshotDependencyTests-865664036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664.4be88869-7580-485d-992e-9d43bcbd53fc 1G {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:57 devstack sudo[108343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664.4be88869-7580-485d-992e-9d43bcbd53fc 1G Sep 03 14:37:57 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:57 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5a087356-5a77-4636-8937-bc53bc599358 tempest-SnapshotDependencyTests-865664036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664.4be88869-7580-485d-992e-9d43bcbd53fc 1G" returned: 0 in 0.380s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:57 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5a087356-5a77-4636-8937-bc53bc599358 tempest-SnapshotDependencyTests-865664036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664.4be88869-7580-485d-992e-9d43bcbd53fc {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:57 devstack sudo[108348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664.4be88869-7580-485d-992e-9d43bcbd53fc Sep 03 14:37:57 devstack sudo[108348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:58 devstack sudo[108348]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5a087356-5a77-4636-8937-bc53bc599358 tempest-SnapshotDependencyTests-865664036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664 -F qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664.4be88869-7580-485d-992e-9d43bcbd53fc" returned: 0 in 0.286s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:58 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-5a087356-5a77-4636-8937-bc53bc599358 tempest-SnapshotDependencyTests-865664036 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664.4be88869-7580-485d-992e-9d43bcbd53fc is being set with open permissions: ugo+rw Sep 03 14:37:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5a087356-5a77-4636-8937-bc53bc599358 tempest-SnapshotDependencyTests-865664036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664.4be88869-7580-485d-992e-9d43bcbd53fc {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:58 devstack sudo[108353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664.4be88869-7580-485d-992e-9d43bcbd53fc Sep 03 14:37:58 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:58 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5a087356-5a77-4636-8937-bc53bc599358 tempest-SnapshotDependencyTests-865664036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664.4be88869-7580-485d-992e-9d43bcbd53fc" returned: 0 in 0.238s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5a087356-5a77-4636-8937-bc53bc599358 tempest-SnapshotDependencyTests-865664036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:58 devstack sudo[108356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664.info Sep 03 14:37:58 devstack sudo[108356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:58 devstack sudo[108356]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5a087356-5a77-4636-8937-bc53bc599358 tempest-SnapshotDependencyTests-865664036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664.info" returned: 0 in 0.245s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:58 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-5a087356-5a77-4636-8937-bc53bc599358 tempest-SnapshotDependencyTests-865664036 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664.info is being set with open permissions: ugo+rw Sep 03 14:37:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5a087356-5a77-4636-8937-bc53bc599358 tempest-SnapshotDependencyTests-865664036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664.info {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:58 devstack sudo[108359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664.info Sep 03 14:37:58 devstack sudo[108359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:37:58 devstack sudo[108359]: pam_unix(sudo:session): session closed for user root Sep 03 14:37:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-5a087356-5a77-4636-8937-bc53bc599358 tempest-SnapshotDependencyTests-865664036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664.info" returned: 0 in 0.240s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:37:58 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-5a087356-5a77-4636-8937-bc53bc599358 tempest-SnapshotDependencyTests-865664036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.824s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:58 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-5a087356-5a77-4636-8937-bc53bc599358 tempest-SnapshotDependencyTests-865664036 None] Create snapshot completed successfully Sep 03 14:37:59 devstack cinder-volume[87007]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87007) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 14:37:59 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Flow 'volume_create_manager' (8fad9962-e4e7-4f53-8336-be1d5d0ac288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:37:59 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (501e60fc-0efc-4d0d-845c-bb2708ec233e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:59 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (501e60fc-0efc-4d0d-845c-bb2708ec233e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T12:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e79a666-98f8-4a1c-9c35-a4d20512d062,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0b32834a0e846b9bf32a5990d265da3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T12:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4be88869-7580-485d-992e-9d43bcbd53fc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T12:38:00Z,use_quota=True,user_id='4c0ee0adf81a48758e6873e832ea62b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48),volume_type_id=6c1ff0e0-2b25-4cec-a5d3-737b75c2fd48)' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:59 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72309313-146d-4563-b400-c10dc10f2828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:59 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72309313-146d-4563-b400-c10dc10f2828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:59 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccac5388-9121-40e3-941d-11b21ddf2c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:59 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccac5388-9121-40e3-941d-11b21ddf2c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6e79a666-98f8-4a1c-9c35-a4d20512d062', 'volume_name': 'volume-6e79a666-98f8-4a1c-9c35-a4d20512d062', 'volume_size': 1, 'snapshot_id': '4be88869-7580-485d-992e-9d43bcbd53fc'}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:59 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0df02e78-6253-49ba-b35b-26fc4bf2d879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:59 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0df02e78-6253-49ba-b35b-26fc4bf2d879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:37:59 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb13c18b-826a-4e0b-ae16-21dbc66fe04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:37:59 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Volume 6e79a666-98f8-4a1c-9c35-a4d20512d062: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6e79a666-98f8-4a1c-9c35-a4d20512d062', 'volume_size': 1, 'snapshot_id': '4be88869-7580-485d-992e-9d43bcbd53fc'} Sep 03 14:37:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:59 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Acquiring lock "cinder-quobyte-4be88869-7580-485d-992e-9d43bcbd53fc-6e79a666-98f8-4a1c-9c35-a4d20512d062" by "_create_volume_from_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:59 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Lock "cinder-quobyte-4be88869-7580-485d-992e-9d43bcbd53fc-6e79a666-98f8-4a1c-9c35-a4d20512d062" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:59 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Creating volume 6e79a666-98f8-4a1c-9c35-a4d20512d062 from snapshot 4be88869-7580-485d-992e-9d43bcbd53fc {{(pid=87007) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 14:37:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:59 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:37:59 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:37:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:59 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Selected osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713 as target Quobyte volume. {{(pid=87007) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 14:37:59 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Acquiring lock "cinder-quobyte-6e79a666-98f8-4a1c-9c35-a4d20512d062" by "_copy_volume_from_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:37:59 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Lock "cinder-quobyte-6e79a666-98f8-4a1c-9c35-a4d20512d062" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:37:59 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] snapshot: 4be88869-7580-485d-992e-9d43bcbd53fc, volume: 6e79a666-98f8-4a1c-9c35-a4d20512d062, {{(pid=87007) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 14:37:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:37:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:37:59 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:37:59 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:37:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:37:59 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[42eee387-e7e2-4d6e-9ada-9dce68426023]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:37:59 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664.4be88869-7580-485d-992e-9d43bcbd53fc {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:37:59 devstack sudo[108362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664.4be88869-7580-485d-992e-9d43bcbd53fc Sep 03 14:37:59 devstack sudo[108362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:38:00 devstack sudo[108362]: pam_unix(sudo:session): session closed for user root Sep 03 14:38:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664.4be88869-7580-485d-992e-9d43bcbd53fc" returned: 0 in 0.358s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:38:00 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:38:00 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6789d15-4108-4cdf-81b4-08ce46e670be]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:38:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:38:00 devstack sudo[108367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664 Sep 03 14:38:00 devstack sudo[108367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:38:00 devstack sudo[108367]: pam_unix(sudo:session): session closed for user root Sep 03 14:38:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664" returned: 0 in 0.362s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:38:00 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664 {{(pid=87007) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 14:38:00 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Creating direct copy from snapshot {{(pid=87007) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 14:38:00 devstack cinder-volume[87007]: DEBUG cinder.utils [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Path /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6e79a666-98f8-4a1c-9c35-a4d20512d062 not found in is_blk_device check {{(pid=87007) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 14:38:00 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6e79a666-98f8-4a1c-9c35-a4d20512d062 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:38:00 devstack sudo[108372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6e79a666-98f8-4a1c-9c35-a4d20512d062 Sep 03 14:38:00 devstack sudo[108372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:38:04 devstack sudo[108372]: pam_unix(sudo:session): session closed for user root Sep 03 14:38:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6e79a666-98f8-4a1c-9c35-a4d20512d062" returned: 0 in 4.031s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:38:04 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Image conversion details: src /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664, size 1024.00 MB, duration 4.03 sec, destination /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6e79a666-98f8-4a1c-9c35-a4d20512d062 {{(pid=87007) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 14:38:04 devstack cinder-volume[87007]: INFO cinder.image.image_utils [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Converted 1024.00 MB image at 253.97 MB/s Sep 03 14:38:04 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.remotefs [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6e79a666-98f8-4a1c-9c35-a4d20512d062 is being set with open permissions: ugo+rw Sep 03 14:38:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6e79a666-98f8-4a1c-9c35-a4d20512d062 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:38:04 devstack sudo[108385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6e79a666-98f8-4a1c-9c35-a4d20512d062 Sep 03 14:38:04 devstack sudo[108385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:38:04 devstack sudo[108385]: pam_unix(sudo:session): session closed for user root Sep 03 14:38:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6e79a666-98f8-4a1c-9c35-a4d20512d062" returned: 0 in 0.238s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:38:04 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Lock "cinder-quobyte-6e79a666-98f8-4a1c-9c35-a4d20512d062" released by "_copy_volume_from_snapshot" :: held 5.068s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:38:04 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Lock "cinder-quobyte-4be88869-7580-485d-992e-9d43bcbd53fc-6e79a666-98f8-4a1c-9c35-a4d20512d062" released by "_create_volume_from_snapshot" :: held 5.126s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:38:04 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.141s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:38:04 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb13c18b-826a-4e0b-ae16-21dbc66fe04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e79a666-98f8-4a1c-9c35-a4d20512d062', 'volume_size': 1, 'snapshot_id': '4be88869-7580-485d-992e-9d43bcbd53fc'}' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:38:04 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2222e7f3-d39c-4f1b-8641-7c6d4187ab72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 14:38:04 devstack cinder-volume[87007]: INFO cinder.volume.flows.manager.create_volume [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Volume volume-6e79a666-98f8-4a1c-9c35-a4d20512d062 (6e79a666-98f8-4a1c-9c35-a4d20512d062): created successfully Sep 03 14:38:04 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2222e7f3-d39c-4f1b-8641-7c6d4187ab72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87007) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 14:38:04 devstack cinder-volume[87007]: DEBUG cinder.volume.manager [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Flow 'volume_create_manager' (8fad9962-e4e7-4f53-8336-be1d5d0ac288) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87007) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 14:38:04 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-f3f164df-b600-44e9-a959-407725812462 tempest-SnapshotDependencyTests-865664036 None] Created volume successfully. Sep 03 14:38:05 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-bc342018-9e19-4b1d-b499-cbb7a98065dc tempest-SnapshotDependencyTests-865664036 None] Acquiring lock "cinder-4be88869-7580-485d-992e-9d43bcbd53fc-delete_snapshot" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:38:05 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-bc342018-9e19-4b1d-b499-cbb7a98065dc tempest-SnapshotDependencyTests-865664036 None] Lock "cinder-4be88869-7580-485d-992e-9d43bcbd53fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:38:05 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-bc342018-9e19-4b1d-b499-cbb7a98065dc tempest-SnapshotDependencyTests-865664036 None] Acquiring lock "cinder-quobyte-63fed748-4dfa-4c14-9f3a-999bd2f3c664" by "delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:38:05 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-bc342018-9e19-4b1d-b499-cbb7a98065dc tempest-SnapshotDependencyTests-865664036 None] Lock "cinder-quobyte-63fed748-4dfa-4c14-9f3a-999bd2f3c664" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:38:05 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-bc342018-9e19-4b1d-b499-cbb7a98065dc tempest-SnapshotDependencyTests-865664036 None] Acquiring lock "cinder-quobyte-4be88869-7580-485d-992e-9d43bcbd53fc" by "_delete_snapshot" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:38:05 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-bc342018-9e19-4b1d-b499-cbb7a98065dc tempest-SnapshotDependencyTests-865664036 None] Lock "cinder-quobyte-4be88869-7580-485d-992e-9d43bcbd53fc" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:38:05 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-bc342018-9e19-4b1d-b499-cbb7a98065dc tempest-SnapshotDependencyTests-865664036 None] Deleting offline snapshot 4be88869-7580-485d-992e-9d43bcbd53fc of volume 63fed748-4dfa-4c14-9f3a-999bd2f3c664 {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 14:38:05 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-bc342018-9e19-4b1d-b499-cbb7a98065dc tempest-SnapshotDependencyTests-865664036 None] snapshot_file for this snap is: volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664.4be88869-7580-485d-992e-9d43bcbd53fc {{(pid=87007) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 14:38:05 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a7c0f4-c995-4183-a779-ec26be93eda6]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:38:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bc342018-9e19-4b1d-b499-cbb7a98065dc tempest-SnapshotDependencyTests-865664036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664.4be88869-7580-485d-992e-9d43bcbd53fc {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:38:05 devstack sudo[108388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664.4be88869-7580-485d-992e-9d43bcbd53fc Sep 03 14:38:05 devstack sudo[108388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:38:05 devstack sudo[108388]: pam_unix(sudo:session): session closed for user root Sep 03 14:38:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bc342018-9e19-4b1d-b499-cbb7a98065dc tempest-SnapshotDependencyTests-865664036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664.4be88869-7580-485d-992e-9d43bcbd53fc" returned: 0 in 0.348s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:38:05 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-bc342018-9e19-4b1d-b499-cbb7a98065dc tempest-SnapshotDependencyTests-865664036 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87007) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 14:38:05 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3b0974-bcb9-43cb-bfac-9ab836e325d5]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:38:05 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bc342018-9e19-4b1d-b499-cbb7a98065dc tempest-SnapshotDependencyTests-865664036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:38:05 devstack sudo[108393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664 Sep 03 14:38:05 devstack sudo[108393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:38:06 devstack sudo[108393]: pam_unix(sudo:session): session closed for user root Sep 03 14:38:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bc342018-9e19-4b1d-b499-cbb7a98065dc tempest-SnapshotDependencyTests-865664036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664" returned: 0 in 0.519s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:38:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bc342018-9e19-4b1d-b499-cbb7a98065dc tempest-SnapshotDependencyTests-865664036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664.4be88869-7580-485d-992e-9d43bcbd53fc {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:38:06 devstack sudo[108398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664.4be88869-7580-485d-992e-9d43bcbd53fc Sep 03 14:38:06 devstack sudo[108398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:38:06 devstack sudo[108398]: pam_unix(sudo:session): session closed for user root Sep 03 14:38:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bc342018-9e19-4b1d-b499-cbb7a98065dc tempest-SnapshotDependencyTests-865664036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664.4be88869-7580-485d-992e-9d43bcbd53fc" returned: 0 in 0.322s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:38:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bc342018-9e19-4b1d-b499-cbb7a98065dc tempest-SnapshotDependencyTests-865664036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664.4be88869-7580-485d-992e-9d43bcbd53fc {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:38:06 devstack sudo[108404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664.4be88869-7580-485d-992e-9d43bcbd53fc Sep 03 14:38:06 devstack sudo[108404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:38:06 devstack sudo[108404]: pam_unix(sudo:session): session closed for user root Sep 03 14:38:06 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-bc342018-9e19-4b1d-b499-cbb7a98065dc tempest-SnapshotDependencyTests-865664036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664.4be88869-7580-485d-992e-9d43bcbd53fc" returned: 0 in 0.241s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:38:06 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-bc342018-9e19-4b1d-b499-cbb7a98065dc tempest-SnapshotDependencyTests-865664036 None] Lock "cinder-quobyte-4be88869-7580-485d-992e-9d43bcbd53fc" released by "_delete_snapshot" :: held 1.524s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:38:06 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-bc342018-9e19-4b1d-b499-cbb7a98065dc tempest-SnapshotDependencyTests-865664036 None] Lock "cinder-quobyte-63fed748-4dfa-4c14-9f3a-999bd2f3c664" released by "delete_snapshot" :: held 1.547s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:38:06 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-bc342018-9e19-4b1d-b499-cbb7a98065dc tempest-SnapshotDependencyTests-865664036 None] Created reservations ['791cde55-4edd-439d-812a-d42c58df5e01', '6966f96a-05a6-4d50-ac8c-5f3da4c7dbc4', '41423dcf-0390-4087-a518-30691b2d6bca', '7ca1adb4-4614-4240-a7b7-2b8fd7f1b19e'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:38:06 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-bc342018-9e19-4b1d-b499-cbb7a98065dc tempest-SnapshotDependencyTests-865664036 None] Delete snapshot completed successfully. Sep 03 14:38:06 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-bc342018-9e19-4b1d-b499-cbb7a98065dc tempest-SnapshotDependencyTests-865664036 None] Lock "cinder-4be88869-7580-485d-992e-9d43bcbd53fc-delete_snapshot" released by "delete_snapshot" :: held 1.678s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:38:07 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-eee4fe1a-bc12-4759-86d1-c87676aceaf9 tempest-SnapshotDependencyTests-865664036 None] Acquiring lock "cinder-63fed748-4dfa-4c14-9f3a-999bd2f3c664-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:38:07 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-eee4fe1a-bc12-4759-86d1-c87676aceaf9 tempest-SnapshotDependencyTests-865664036 None] Lock "cinder-63fed748-4dfa-4c14-9f3a-999bd2f3c664-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:38:07 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-eee4fe1a-bc12-4759-86d1-c87676aceaf9 tempest-SnapshotDependencyTests-865664036 None] Acquiring lock "cinder-quobyte-63fed748-4dfa-4c14-9f3a-999bd2f3c664" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:38:07 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-eee4fe1a-bc12-4759-86d1-c87676aceaf9 tempest-SnapshotDependencyTests-865664036 None] Lock "cinder-quobyte-63fed748-4dfa-4c14-9f3a-999bd2f3c664" acquired by "delete_volume" :: waited 0.015s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:38:07 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c149dc3a-6f81-413d-9f57-50a94fcc271c]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:38:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eee4fe1a-bc12-4759-86d1-c87676aceaf9 tempest-SnapshotDependencyTests-865664036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:38:07 devstack sudo[108408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664 Sep 03 14:38:07 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:38:07 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root Sep 03 14:38:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eee4fe1a-bc12-4759-86d1-c87676aceaf9 tempest-SnapshotDependencyTests-865664036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664" returned: 0 in 0.347s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:38:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eee4fe1a-bc12-4759-86d1-c87676aceaf9 tempest-SnapshotDependencyTests-865664036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:38:07 devstack sudo[108413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664 Sep 03 14:38:07 devstack sudo[108413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:38:07 devstack sudo[108413]: pam_unix(sudo:session): session closed for user root Sep 03 14:38:07 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eee4fe1a-bc12-4759-86d1-c87676aceaf9 tempest-SnapshotDependencyTests-865664036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-63fed748-4dfa-4c14-9f3a-999bd2f3c664" returned: 0 in 0.234s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:38:08 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-eee4fe1a-bc12-4759-86d1-c87676aceaf9 tempest-SnapshotDependencyTests-865664036 None] Lock "cinder-quobyte-63fed748-4dfa-4c14-9f3a-999bd2f3c664" released by "delete_volume" :: held 0.639s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:38:08 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-eee4fe1a-bc12-4759-86d1-c87676aceaf9 tempest-SnapshotDependencyTests-865664036 None] Created reservations ['4ed4ebed-bacc-4f0c-a647-e672967e6202', '879963aa-c77b-42c0-8ee3-f16940c2c9ae', '5d38e444-8f5b-45bb-8b96-4c2242992071', 'b5af8c33-19a4-4831-81d9-857b4adcad63'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:38:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-eee4fe1a-bc12-4759-86d1-c87676aceaf9 tempest-SnapshotDependencyTests-865664036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:38:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-eee4fe1a-bc12-4759-86d1-c87676aceaf9 tempest-SnapshotDependencyTests-865664036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:38:08 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-eee4fe1a-bc12-4759-86d1-c87676aceaf9 tempest-SnapshotDependencyTests-865664036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:38:08 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-eee4fe1a-bc12-4759-86d1-c87676aceaf9 tempest-SnapshotDependencyTests-865664036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:38:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-eee4fe1a-bc12-4759-86d1-c87676aceaf9 tempest-SnapshotDependencyTests-865664036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:38:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eee4fe1a-bc12-4759-86d1-c87676aceaf9 tempest-SnapshotDependencyTests-865664036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:38:08 devstack sudo[108416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:38:08 devstack sudo[108416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:38:08 devstack sudo[108416]: pam_unix(sudo:session): session closed for user root Sep 03 14:38:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-eee4fe1a-bc12-4759-86d1-c87676aceaf9 tempest-SnapshotDependencyTests-865664036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.234s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:38:08 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-eee4fe1a-bc12-4759-86d1-c87676aceaf9 tempest-SnapshotDependencyTests-865664036 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:38:08 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-eee4fe1a-bc12-4759-86d1-c87676aceaf9 tempest-SnapshotDependencyTests-865664036 None] Deleted volume successfully. Sep 03 14:38:08 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-eee4fe1a-bc12-4759-86d1-c87676aceaf9 tempest-SnapshotDependencyTests-865664036 None] Lock "cinder-63fed748-4dfa-4c14-9f3a-999bd2f3c664-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:38:08 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d03ae879-7f32-4234-af85-06935d7df334 tempest-SnapshotDependencyTests-865664036 None] Acquiring lock "cinder-6e79a666-98f8-4a1c-9c35-a4d20512d062-delete_volume" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:38:08 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d03ae879-7f32-4234-af85-06935d7df334 tempest-SnapshotDependencyTests-865664036 None] Lock "cinder-6e79a666-98f8-4a1c-9c35-a4d20512d062-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:38:08 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d03ae879-7f32-4234-af85-06935d7df334 tempest-SnapshotDependencyTests-865664036 None] Acquiring lock "cinder-quobyte-6e79a666-98f8-4a1c-9c35-a4d20512d062" by "delete_volume" {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 14:38:08 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d03ae879-7f32-4234-af85-06935d7df334 tempest-SnapshotDependencyTests-865664036 None] Lock "cinder-quobyte-6e79a666-98f8-4a1c-9c35-a4d20512d062" acquired by "delete_volume" :: waited 0.013s {{(pid=87007) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 14:38:08 devstack cinder-volume[87007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b353c01a-3f02-4a89-b515-ea39f82fc24d]: (4, 'qcow2') {{(pid=88654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 14:38:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d03ae879-7f32-4234-af85-06935d7df334 tempest-SnapshotDependencyTests-865664036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6e79a666-98f8-4a1c-9c35-a4d20512d062 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:38:08 devstack sudo[108420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6e79a666-98f8-4a1c-9c35-a4d20512d062 Sep 03 14:38:08 devstack sudo[108420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:38:08 devstack sudo[108420]: pam_unix(sudo:session): session closed for user root Sep 03 14:38:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d03ae879-7f32-4234-af85-06935d7df334 tempest-SnapshotDependencyTests-865664036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6e79a666-98f8-4a1c-9c35-a4d20512d062" returned: 0 in 0.353s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:38:08 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d03ae879-7f32-4234-af85-06935d7df334 tempest-SnapshotDependencyTests-865664036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6e79a666-98f8-4a1c-9c35-a4d20512d062 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:38:08 devstack sudo[108425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6e79a666-98f8-4a1c-9c35-a4d20512d062 Sep 03 14:38:08 devstack sudo[108425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:38:09 devstack sudo[108425]: pam_unix(sudo:session): session closed for user root Sep 03 14:38:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d03ae879-7f32-4234-af85-06935d7df334 tempest-SnapshotDependencyTests-865664036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71/volume-6e79a666-98f8-4a1c-9c35-a4d20512d062" returned: 0 in 0.242s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:38:09 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d03ae879-7f32-4234-af85-06935d7df334 tempest-SnapshotDependencyTests-865664036 None] Lock "cinder-quobyte-6e79a666-98f8-4a1c-9c35-a4d20512d062" released by "delete_volume" :: held 0.632s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:38:09 devstack cinder-volume[87007]: DEBUG cinder.quota [None req-d03ae879-7f32-4234-af85-06935d7df334 tempest-SnapshotDependencyTests-865664036 None] Created reservations ['ecaa7560-47bc-4d5c-bfb5-792f1e26d53c', '1c8e8bc2-3893-4f09-aa8e-360363f70f98', '41a245d4-6259-49cd-b67c-3fb605d3268e', '407b6166-3d29-427b-983b-c25bd3996d2f'] {{(pid=87007) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 14:38:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d03ae879-7f32-4234-af85-06935d7df334 tempest-SnapshotDependencyTests-865664036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 14:38:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d03ae879-7f32-4234-af85-06935d7df334 tempest-SnapshotDependencyTests-865664036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 14:38:09 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d03ae879-7f32-4234-af85-06935d7df334 tempest-SnapshotDependencyTests-865664036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 14:38:09 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-d03ae879-7f32-4234-af85-06935d7df334 tempest-SnapshotDependencyTests-865664036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99eb5cab-6802-4565-a97d-edf6b1841713'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 14:38:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-d03ae879-7f32-4234-af85-06935d7df334 tempest-SnapshotDependencyTests-865664036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 14:38:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d03ae879-7f32-4234-af85-06935d7df334 tempest-SnapshotDependencyTests-865664036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 14:38:09 devstack sudo[108428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71 Sep 03 14:38:09 devstack sudo[108428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 14:38:09 devstack sudo[108428]: pam_unix(sudo:session): session closed for user root Sep 03 14:38:09 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-d03ae879-7f32-4234-af85-06935d7df334 tempest-SnapshotDependencyTests-865664036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f515e4527743d2bf728c5675e81e8d71" returned: 0 in 0.242s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 14:38:09 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-d03ae879-7f32-4234-af85-06935d7df334 tempest-SnapshotDependencyTests-865664036 None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 14:38:09 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-d03ae879-7f32-4234-af85-06935d7df334 tempest-SnapshotDependencyTests-865664036 None] Deleted volume successfully. Sep 03 14:38:09 devstack cinder-volume[87007]: DEBUG cinder.coordination [None req-d03ae879-7f32-4234-af85-06935d7df334 tempest-SnapshotDependencyTests-865664036 None] Lock "cinder-6e79a666-98f8-4a1c-9c35-a4d20512d062-delete_volume" released by "delete_volume" :: held 1.080s {{(pid=87007) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 14:38:19 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:SELECT=49,cinder:UPDATE=60,cinder:DELETE=6,cinder:INSERT=16 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 14:38:19 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writing DB stats cinder:SELECT=41,cinder:INSERT=14,cinder:UPDATE=63,cinder:DELETE=5 {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}